-- Logs begin at Mon 2022-07-18 15:49:41 UTC, end at Mon 2022-07-18 17:11:59 UTC. -- Jul 18 16:26:34.646987 dv-cinder-846173-3-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 18 16:26:34.656783 dv-cinder-846173-3-smb devstack@keystone.service[80532]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 18 16:26:34.658813 dv-cinder-846173-3-smb devstack@keystone.service[80532]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 18 16:26:34 2022] *** Jul 18 16:26:34.658813 dv-cinder-846173-3-smb devstack@keystone.service[80532]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 18 16:26:34.658813 dv-cinder-846173-3-smb devstack@keystone.service[80532]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 18 16:26:34.658813 dv-cinder-846173-3-smb devstack@keystone.service[80532]: nodename: dv-cinder-846173-3-smb Jul 18 16:26:34.658813 dv-cinder-846173-3-smb devstack@keystone.service[80532]: machine: x86_64 Jul 18 16:26:34.658813 dv-cinder-846173-3-smb devstack@keystone.service[80532]: clock source: unix Jul 18 16:26:34.658813 dv-cinder-846173-3-smb devstack@keystone.service[80532]: pcre jit disabled Jul 18 16:26:34.658813 dv-cinder-846173-3-smb devstack@keystone.service[80532]: detected number of CPU cores: 4 Jul 18 16:26:34.658813 dv-cinder-846173-3-smb devstack@keystone.service[80532]: current working directory: / Jul 18 16:26:34.658813 dv-cinder-846173-3-smb devstack@keystone.service[80532]: detected binary path: /usr/bin/uwsgi-core Jul 18 16:26:34.658813 dv-cinder-846173-3-smb devstack@keystone.service[80532]: your processes number limit is 47680 Jul 18 16:26:34.659405 dv-cinder-846173-3-smb devstack@keystone.service[80532]: your memory page size is 4096 bytes Jul 18 16:26:34.659405 dv-cinder-846173-3-smb devstack@keystone.service[80532]: detected max file descriptor number: 2048 Jul 18 16:26:34.659405 dv-cinder-846173-3-smb devstack@keystone.service[80532]: lock engine: pthread robust mutexes Jul 18 16:26:34.659405 dv-cinder-846173-3-smb devstack@keystone.service[80532]: thunder lock: enabled Jul 18 16:26:34.659405 dv-cinder-846173-3-smb devstack@keystone.service[80532]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 18 16:26:34.659405 dv-cinder-846173-3-smb devstack@keystone.service[80532]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 18 16:26:34.699593 dv-cinder-846173-3-smb devstack@keystone.service[80532]: Python main interpreter initialized at 0x55bd2702d9c0 Jul 18 16:26:34.699593 dv-cinder-846173-3-smb devstack@keystone.service[80532]: python threads support enabled Jul 18 16:26:34.699593 dv-cinder-846173-3-smb devstack@keystone.service[80532]: your server socket listen backlog is limited to 100 connections Jul 18 16:26:34.699593 dv-cinder-846173-3-smb devstack@keystone.service[80532]: your mercy for graceful operations on workers is 90 seconds Jul 18 16:26:34.699987 dv-cinder-846173-3-smb devstack@keystone.service[80532]: mapped 403077 bytes (393 KB) for 2 cores Jul 18 16:26:34.700065 dv-cinder-846173-3-smb devstack@keystone.service[80532]: *** Operational MODE: preforking *** Jul 18 16:26:34.700318 dv-cinder-846173-3-smb devstack@keystone.service[80532]: *** uWSGI is running in multiple interpreter mode *** Jul 18 16:26:34.700318 dv-cinder-846173-3-smb devstack@keystone.service[80532]: spawned uWSGI master process (pid: 80532) Jul 18 16:26:34.700530 dv-cinder-846173-3-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 18 16:26:34.701557 dv-cinder-846173-3-smb devstack@keystone.service[80532]: spawned uWSGI worker 1 (pid: 80544, cores: 1) Jul 18 16:26:34.701557 dv-cinder-846173-3-smb devstack@keystone.service[80532]: spawned uWSGI worker 2 (pid: 80545, cores: 1) Jul 18 16:26:34.701557 dv-cinder-846173-3-smb devstack@keystone.service[80532]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 18 16:26:40.172358 dv-cinder-846173-3-smb devstack@keystone.service[80544]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 16:26:40.172358 dv-cinder-846173-3-smb devstack@keystone.service[80544]: from cryptography.utils import int_from_bytes Jul 18 16:26:40.173176 dv-cinder-846173-3-smb devstack@keystone.service[80544]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 16:26:40.173176 dv-cinder-846173-3-smb devstack@keystone.service[80544]: from cryptography.utils import int_from_bytes Jul 18 16:26:40.173303 dv-cinder-846173-3-smb devstack@keystone.service[80545]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 16:26:40.173303 dv-cinder-846173-3-smb devstack@keystone.service[80545]: from cryptography.utils import int_from_bytes Jul 18 16:26:40.173714 dv-cinder-846173-3-smb devstack@keystone.service[80545]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 16:26:40.173714 dv-cinder-846173-3-smb devstack@keystone.service[80545]: from cryptography.utils import int_from_bytes Jul 18 16:26:40.222603 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 16:26:40.222776 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 16:26:40.222865 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 16:26:40.222949 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] command line args: [] {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 16:26:40.223017 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 16:26:40.223201 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] command line args: [] {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 16:26:40.223297 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 16:26:40.223376 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] ================================================================================ {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 16:26:40.223457 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 16:26:40.223608 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] admin_token = **** {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.223696 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] ================================================================================ {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 16:26:40.223873 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] config_dir = [] {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.223955 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] admin_token = **** {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.224037 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.224110 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] config_dir = [] {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.224218 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] config_source = [] {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.224309 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.224388 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] debug = True {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.224466 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] config_source = [] {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.224574 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.224871 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] debug = True {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.224871 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.225088 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.225188 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.225295 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.225393 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.225500 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.225596 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.225700 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.225803 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.225918 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] list_limit = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.226016 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] list_limit = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.226111 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] log_config_append = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.226224 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] log_config_append = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.226328 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.226441 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.226552 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] log_dir = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.226671 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] log_dir = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.226775 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] log_file = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.226877 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] log_file = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.226979 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.227092 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.227205 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.227308 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.227419 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.227522 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.227619 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.227761 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.233976 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.234129 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.234246 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.234325 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.234411 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.234486 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.234557 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.234628 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.234705 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.234787 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.234869 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.234942 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.235018 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.235089 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.235160 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.235229 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.235307 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.235390 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.235463 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.235533 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.235653 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.235761 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.235902 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.81/identity {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.236003 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.81/identity {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.236083 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] publish_errors = False {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.236164 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] publish_errors = False {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.236237 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.236312 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.236382 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.238662 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.238764 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.238835 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.238901 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.238981 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.239052 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.239118 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.239178 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] standard_threads = False {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.239236 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] standard_threads = False {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.239333 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.239412 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.239485 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.239485 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.239599 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.239663 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] use_journal = False {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.239768 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.239836 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] use_json = False {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.239981 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] use_journal = False {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.240051 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] use_stderr = False {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.240112 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] use_json = False {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.240170 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] use_syslog = False {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.240228 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] use_stderr = False {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.240228 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] use_syslog = False {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.240338 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.240398 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:26:40.240456 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.240520 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.240580 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.240643 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.240709 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.240770 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.240828 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.240891 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.240970 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.241031 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.241102 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.241163 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.241227 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.241291 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.241356 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.241415 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.241481 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.241542 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.241601 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.241659 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.241717 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.241717 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.241827 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.241887 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.241946 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.242004 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.242004 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.242106 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.242106 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.242226 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.242226 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.242337 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.242401 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.242465 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.242465 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.242584 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.242584 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.242794 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.242928 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.243008 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.243159 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.243235 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.243306 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.243383 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.243462 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.243534 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.243612 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.243685 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.243820 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.243920 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.244133 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.244257 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.244323 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.244381 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.244439 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.244496 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.244496 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.244606 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.244729 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.244806 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.244884 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.244956 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.244956 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.245140 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.245140 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.245275 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.245346 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.245421 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.245493 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.245571 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.245649 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.245721 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.245821 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.245905 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.245984 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.246064 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.246064 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.246269 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.246374 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.246374 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.246577 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.246687 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.246687 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.246869 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.246966 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.247062 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.247177 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.247283 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.247392 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.247464 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.247570 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.247690 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.247836 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.247923 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.248056 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.248129 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.248208 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.248281 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.248400 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.248506 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.248599 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.248713 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.248801 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.248876 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.249000 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.249079 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.249149 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.249227 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.249419 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.249538 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.249618 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.249618 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.249784 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.249784 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.249966 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.250092 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.250170 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.250288 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.250373 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.250448 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.250566 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.250652 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.250727 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.250846 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.250936 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.251011 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.251128 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.251205 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.251277 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.251395 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.251481 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.251563 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.251637 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.251774 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.251895 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.251983 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.252682 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.252763 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.252763 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.252889 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.252969 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.253042 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.253171 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.253250 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.253322 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.253394 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.253464 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.253544 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.253617 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.253680 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.253813 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.253893 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.254003 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.254107 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.254181 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.254310 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.254398 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.254473 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.254551 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.254625 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.254702 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.254702 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.254854 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.254929 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.255001 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.255073 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.255151 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.255224 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.255303 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.255377 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.255449 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.255520 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.255640 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.255732 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.255829 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.255906 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.255906 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.256043 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.256115 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.256187 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.256267 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.256341 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.256416 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.256489 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.256561 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.256632 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.256759 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.256838 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.256911 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.256911 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.257039 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.257108 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.257177 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.257237 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.257309 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.257371 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.257441 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.257557 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.257689 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.257805 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.257961 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.258039 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.258245 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.258333 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.258527 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.258646 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.258767 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.258847 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.259251 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] auth.external = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.259340 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] auth.external = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.259484 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.259602 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.259800 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.262617 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.262742 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.262827 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.262901 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] auth.password = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.262982 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] auth.password = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.263057 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] auth.token = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.263137 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] auth.token = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.263221 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.263221 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.263354 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.263435 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.263511 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.263584 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.263657 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.263746 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.263834 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.263919 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.264000 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.264076 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.264149 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.264222 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] credential.caching = True {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.264295 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.264295 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] credential.caching = True {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.264436 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.264509 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.264587 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.264667 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.264746 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.264828 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.264903 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.264976 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.265048 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.265121 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.265193 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.265273 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.265380 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.265464 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.265538 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.265618 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.265693 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.265844 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.265928 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.265928 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.266061 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.266135 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.266207 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.266277 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.266352 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.266414 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.266486 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.266557 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.266630 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.266710 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] federation.caching = True {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.266784 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.266847 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.266907 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] federation.caching = True {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.266978 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.267050 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.267134 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.267210 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.267282 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.267354 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.267427 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.267500 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.267580 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.267655 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.268357 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.268435 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.268554 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.268638 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.268809 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.268897 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.269047 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.269135 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.269281 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.269359 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.269515 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] identity.caching = True {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.269584 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.269800 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] identity.caching = True {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.269947 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.270085 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.270218 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.270349 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.270480 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.270610 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.270741 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.270872 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.271011 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.271141 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.271225 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.271333 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.271470 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.271615 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.271788 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.271939 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.272025 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.272088 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.272213 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.272339 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.272484 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.272617 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.272748 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.272870 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.272968 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.273102 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.273235 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.273320 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.273467 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.273551 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.273626 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.273699 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.273781 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.273857 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.273931 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.274004 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.274076 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.274149 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.274272 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.274356 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.274505 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.274588 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.274743 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.274823 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.274975 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.275057 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.275206 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.275285 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.275579 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.275658 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.275842 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.275933 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.276093 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.276173 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.276326 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.276406 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.276572 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.276654 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.276817 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.276896 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.277069 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.277161 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.277298 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.277377 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.277529 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.277608 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.277756 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.277837 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.277993 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.278077 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.278220 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.278358 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.278456 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.278538 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.278692 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.278774 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.278932 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.279013 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.279166 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.279246 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.279401 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.279483 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.279702 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.279817 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.279914 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.279996 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.280142 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.280227 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.280371 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.280452 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.280615 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.280705 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.280858 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.280940 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.281091 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.281172 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.281324 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.281414 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.281560 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.281646 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.281788 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] ldap.user = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.281867 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] ldap.user = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.282027 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.282118 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.282299 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.282424 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.282510 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.282587 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.282746 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.282846 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.282987 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.283069 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.283294 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.283380 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.283536 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.283626 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.283790 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.283874 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.284028 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.284106 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.284260 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.284355 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.284495 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.284611 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.284720 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.284800 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.284961 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.285055 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.285205 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.285285 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.285444 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.285533 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.285685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.285784 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.285926 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.286007 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.286152 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.286232 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.286396 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.286484 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.286627 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.286707 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.286859 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.286938 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.287089 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.287177 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.287320 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.287400 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.287558 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.287637 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.287857 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.288030 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.288109 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.288182 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.288296 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.288377 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.288529 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.288634 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.288762 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.288850 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.288992 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.289071 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.289222 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.289312 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.289455 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.289536 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.289697 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.289787 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.289933 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.290025 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.290162 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.290243 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.290396 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.290475 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.290630 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] resource.caching = True {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.290718 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] resource.caching = True {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.290873 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.290953 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.291116 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.291226 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.291348 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.291439 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.291594 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.291676 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.291867 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.291949 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.292102 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.292196 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.292343 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.292425 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.292575 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.292656 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.292811 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.292900 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.293066 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] role.caching = True {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.293152 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] role.caching = True {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.293299 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] role.driver = sql {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.293881 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] role.driver = sql {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.293984 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.294184 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.294265 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.294339 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.294411 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.294485 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.294636 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.294722 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.294797 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.294876 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.294994 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.295074 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.295157 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.295234 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.295307 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.295380 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.295453 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.295526 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.295612 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.295688 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.295832 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.295941 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.296076 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.296189 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.296318 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.296436 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.296560 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.296682 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.296995 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.297104 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.297234 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.297340 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.297482 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.297572 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.297730 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.297815 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.297977 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.298060 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.298227 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.298308 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.298461 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.298541 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.298717 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.298805 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.299025 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.299107 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.299266 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.299357 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.299500 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.299581 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.299792 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.299884 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.299982 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.300076 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.300233 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.300658 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.300658 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.300798 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.300872 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.300955 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.301032 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.301106 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.301179 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.301252 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.301374 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.301465 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.301608 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] token.caching = True {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.301689 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] token.caching = True {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.301842 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.301923 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.302086 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.302175 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.302320 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.302408 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.302573 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.302654 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.302816 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.302905 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.303055 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.303136 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.303293 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.303378 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.303522 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.303613 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.303787 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.303873 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.304024 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.304105 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.304260 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.308475 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.308475 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.308617 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.308691 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.308764 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.308838 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.308924 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.309001 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.309074 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.309146 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.309219 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.309292 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.309372 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.309447 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] database.connection = **** {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.309528 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] database.connection = **** {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.309620 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.309703 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.309785 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.309861 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.309934 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.310006 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.310157 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.310235 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.310308 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.310380 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.310453 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.310526 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.310606 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.310682 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.310755 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.310827 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.310899 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.310971 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.311051 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.311127 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.311200 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.311271 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.311344 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.311416 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.311496 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.311571 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.311644 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.311740 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.311817 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.311891 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.311978 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.312055 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.312127 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.312200 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.312272 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.312272 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 16:26:40.312400 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:26:40.312400 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 16:26:40.342155 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:26:40.342377 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:26:40.342596 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:26:40.343055 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:26:40.343268 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:26:40.343443 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:26:40.351149 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:26:40.351984 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:26:40.379879 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:26:40.380104 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:26:40.381111 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:26:40.381344 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:26:40.526660 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:26:40.527481 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:26:40.581011 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:26:40.581232 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:26:40.581328 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:26:40.581478 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:26:40.655924 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:26:40.656115 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:26:40.656189 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:26:40.656317 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:26:40.656402 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:26:40.656540 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:26:40.656626 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:26:40.656751 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:26:40.656833 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:26:40.656962 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:26:40.657056 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:26:40.657173 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:26:40.682575 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:26:40.682807 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:26:40.682903 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:26:40.683026 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:26:40.683169 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:26:40.683247 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:26:40.683314 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:26:40.683444 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:26:40.683526 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:26:40.683656 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:26:40.683776 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:26:40.683896 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:26:40.683976 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:26:40.684113 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:26:40.695171 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:26:40.695733 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:26:40.722958 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:26:40.723095 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:26:40.723168 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:26:40.723275 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:26:40.723374 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:26:40.723498 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:26:40.723582 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:26:40.723739 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:26:40.723825 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:26:40.723954 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:26:40.724039 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:26:40.724160 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:26:40.724244 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:26:40.724370 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80544) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:26:40.741351 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.741651 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 18 16:26:40.741816 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.741902 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.742028 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 18 16:26:40.742112 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 18 16:26:40.742318 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.742402 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.742549 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 18 16:26:40.742637 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.742815 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.742906 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.743062 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.743145 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.743316 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.743572 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.754063 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.754334 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.754601 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.754764 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.754872 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.755037 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.755305 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.755698 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.763187 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80545) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 16:26:40.764237 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80544) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 16:26:40.766452 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80545) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 16:26:40.766727 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.767004 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.767391 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.768112 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80544) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 16:26:40.768207 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.768406 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.768503 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.768676 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.768759 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.768976 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.769145 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.769238 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.769431 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.769522 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.769694 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.769784 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.769961 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.770231 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.770500 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.770772 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.771048 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.796546 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.799828 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80545) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 16:26:40.800064 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.800140 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.800207 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80544) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 16:26:40.800207 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.803632 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80545) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 16:26:40.803929 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.804204 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.805532 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80544) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 16:26:40.805808 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.806088 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.811443 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80545) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 16:26:40.811730 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.813400 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80544) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 16:26:40.813679 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.816338 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80545) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 16:26:40.816619 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.816893 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.817171 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.817440 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.817708 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.817972 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.818236 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.818317 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80544) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 16:26:40.818585 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.818865 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.819147 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.819424 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.819693 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.819983 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.820254 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.837284 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.842541 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.842644 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.842644 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.842784 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80545) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 16:26:40.844290 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80544) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 16:26:40.846900 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.847186 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.848593 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.848971 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.852223 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80545) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 16:26:40.853901 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80544) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 16:26:40.855837 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80545) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 16:26:40.857528 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80544) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 16:26:40.859536 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.859857 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.860135 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.860411 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.860690 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.860970 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.861263 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.861589 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.861884 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.862176 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.862458 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.862744 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.879854 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80545) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 16:26:40.880222 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.880488 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.880753 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.881827 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80544) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 16:26:40.882201 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.882469 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.882736 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.888916 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.890603 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.890874 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.890959 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.893162 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.893439 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.894423 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80545) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 16:26:40.894719 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.894987 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.895266 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.895545 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.896502 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80544) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 16:26:40.896792 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.897077 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.897356 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.897639 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.909052 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80545) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 16:26:40.909326 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.909599 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.909872 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.910169 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.910438 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.910705 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.911134 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80544) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 16:26:40.911417 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.911697 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.911991 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.912266 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.916830 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.916830 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.930383 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80545) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 16:26:40.932842 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80544) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 16:26:40.933621 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80545) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 16:26:40.936032 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80544) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 16:26:40.936905 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.938571 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.939311 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.940257 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80545) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 16:26:40.940532 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.940805 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.941002 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.942636 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80544) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 16:26:40.942916 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.943194 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.948327 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.949906 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80545) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 16:26:40.950629 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.952263 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80544) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 16:26:40.953169 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.953450 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.953727 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.953996 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.956020 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.956304 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.959903 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.959903 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.963736 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80545) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 16:26:40.964019 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.964295 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.966229 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80544) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 16:26:40.966511 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.966798 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.972183 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80545) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 16:26:40.972456 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.972733 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.973053 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.973266 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.973540 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.973805 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.974075 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.974343 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.974616 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.974760 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80544) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 16:26:40.974930 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.975039 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.975249 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.975347 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.975425 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.975559 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.975644 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.975853 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.976140 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.976411 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.976681 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.976952 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.977219 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.977502 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.977758 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.978018 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:40.978277 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80544) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:26:41.013827 dv-cinder-846173-3-smb devstack@keystone.service[80545]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55bd2702d9c0 pid: 80545 (default app) Jul 18 16:26:41.016755 dv-cinder-846173-3-smb devstack@keystone.service[80544]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55bd2702d9c0 pid: 80544 (default app) Jul 18 16:26:41.017238 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa411f-2221-413d-962b-e5dc7b222cb8 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:26:41.017528 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa411f-2221-413d-962b-e5dc7b222cb8 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:26:41.017858 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa411f-2221-413d-962b-e5dc7b222cb8 None None] PATH_INFO: `/v3` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:26:41.022053 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1/1] 10.222.0.81 () {50 vars in 791 bytes} [Mon Jul 18 16:26:41 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:26:49.843103 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f00b4-6293-40c1-b11c-71466bcbdb41 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:26:49.843757 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f00b4-6293-40c1-b11c-71466bcbdb41 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:26:49.843757 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f00b4-6293-40c1-b11c-71466bcbdb41 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:26:49.848051 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1/2] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:26:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:26:49.853918 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40315fd8-86c1-4cab-8fd0-364c8fbd081c None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:26:49.854441 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40315fd8-86c1-4cab-8fd0-364c8fbd081c None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:26:49.854441 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40315fd8-86c1-4cab-8fd0-364c8fbd081c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:26:49.922154 dv-cinder-846173-3-smb devstack@keystone.service[80545]: INFO dbcounter [None req-40315fd8-86c1-4cab-8fd0-364c8fbd081c None None] Registered counter for database keystone Jul 18 16:26:49.945169 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG oslo_db.sqlalchemy.engines [None req-40315fd8-86c1-4cab-8fd0-364c8fbd081c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80545) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 16:26:49.951623 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writer thread running {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 16:26:50.134864 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG passlib.handlers.bcrypt [None req-40315fd8-86c1-4cab-8fd0-364c8fbd081c None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80545) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 18 16:26:50.135191 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG passlib.handlers.bcrypt [None req-40315fd8-86c1-4cab-8fd0-364c8fbd081c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80545) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 18 16:26:50.190330 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-40315fd8-86c1-4cab-8fd0-364c8fbd081c None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:26:50.192003 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-40315fd8-86c1-4cab-8fd0-364c8fbd081c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:26:50.314180 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 2/3] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:26:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 461 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 18 16:26:50.467739 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f00b4-6293-40c1-b11c-71466bcbdb41 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:26:50.543326 dv-cinder-846173-3-smb devstack@keystone.service[80544]: INFO dbcounter [None req-a46f00b4-6293-40c1-b11c-71466bcbdb41 None None] Registered counter for database keystone Jul 18 16:26:50.565309 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG oslo_db.sqlalchemy.engines [None req-a46f00b4-6293-40c1-b11c-71466bcbdb41 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80544) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 16:26:50.571547 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writer thread running {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 16:26:50.712049 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f00b4-6293-40c1-b11c-71466bcbdb41 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:26:50.716611 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae010e-318a-4e02-a6f4-56aa3cd452dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:26:50.717216 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae010e-318a-4e02-a6f4-56aa3cd452dc admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:26:50.717496 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae010e-318a-4e02-a6f4-56aa3cd452dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:26:50.717769 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae010e-318a-4e02-a6f4-56aa3cd452dc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:26:50.727180 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ae010e-318a-4e02-a6f4-56aa3cd452dc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:26:50.780117 dv-cinder-846173-3-smb devstack@keystone.service[80544]: WARNING keystone.common.rbac_enforcer.enforcer [None req-38ae010e-318a-4e02-a6f4-56aa3cd452dc admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 18 16:26:50.780449 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ae010e-318a-4e02-a6f4-56aa3cd452dc admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:26:50.791485 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 2/4] 10.222.0.81 () {58 vars in 1324 bytes} [Mon Jul 18 16:26:50 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 18 16:26:50.797589 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40315fd8-86c1-4cab-8fd0-364c8fbd081c None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:26:50.812641 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40315fd8-86c1-4cab-8fd0-364c8fbd081c None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:26:50.817127 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf540193-d6c1-4f11-9fb0-886abe9a0b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:26:50.818236 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf540193-d6c1-4f11-9fb0-886abe9a0b8d admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:26:50.818525 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf540193-d6c1-4f11-9fb0-886abe9a0b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:26:50.818802 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf540193-d6c1-4f11-9fb0-886abe9a0b8d admin admin] PATH_INFO: `/v3/projects/33688c7877734008b9dfee18021dbcd6` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:26:50.820362 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf540193-d6c1-4f11-9fb0-886abe9a0b8d admin admin] RBAC: Authorizing `identity:get_project(project_id=33688c7877734008b9dfee18021dbcd6)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:26:50.874023 dv-cinder-846173-3-smb devstack@keystone.service[80545]: WARNING keystone.common.rbac_enforcer.enforcer [None req-cf540193-d6c1-4f11-9fb0-886abe9a0b8d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 18 16:26:50.874627 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf540193-d6c1-4f11-9fb0-886abe9a0b8d admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:26:50.879135 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 3/5] 10.222.0.81 () {56 vars in 1207 bytes} [Mon Jul 18 16:26:50 2022] GET /identity/v3/projects/33688c7877734008b9dfee18021dbcd6 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:26:52.881501 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f348a2-348b-444d-be9b-c7c033cd83f2 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:26:52.882035 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f348a2-348b-444d-be9b-c7c033cd83f2 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:26:52.882035 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f348a2-348b-444d-be9b-c7c033cd83f2 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:26:52.886433 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 3/6] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:26:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:26:52.891971 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a59a19-532d-4c58-a9b5-65195d1988bf None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:26:52.892897 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a59a19-532d-4c58-a9b5-65195d1988bf None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:26:52.893029 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a59a19-532d-4c58-a9b5-65195d1988bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:26:52.912255 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-89a59a19-532d-4c58-a9b5-65195d1988bf None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:26:52.913779 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-89a59a19-532d-4c58-a9b5-65195d1988bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:26:52.921649 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 4/7] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:26:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 18 16:26:52.943406 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f348a2-348b-444d-be9b-c7c033cd83f2 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:26:52.956260 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f348a2-348b-444d-be9b-c7c033cd83f2 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:26:52.960525 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f7bd5-ee2f-42c7-852d-49dc0077974c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:26:52.961152 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f7bd5-ee2f-42c7-852d-49dc0077974c admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:26:52.961440 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f7bd5-ee2f-42c7-852d-49dc0077974c admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:26:52.961720 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f7bd5-ee2f-42c7-852d-49dc0077974c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:26:52.969429 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246f7bd5-ee2f-42c7-852d-49dc0077974c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:26:52.971811 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246f7bd5-ee2f-42c7-852d-49dc0077974c admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:26:52.980714 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 4/8] 10.222.0.81 () {58 vars in 1324 bytes} [Mon Jul 18 16:26:52 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 16:26:52.986237 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a59a19-532d-4c58-a9b5-65195d1988bf None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:26:52.995238 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a59a19-532d-4c58-a9b5-65195d1988bf None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:26:52.999622 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dc7295-30d0-4556-a8ac-0ce041547df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:26:53.000509 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc7295-30d0-4556-a8ac-0ce041547df5 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:26:53.000794 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc7295-30d0-4556-a8ac-0ce041547df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:26:53.001073 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc7295-30d0-4556-a8ac-0ce041547df5 admin admin] PATH_INFO: `/v3/users/3dccf69cde3442c68200f8a9b9ed4ebb` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:26:53.003003 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dc7295-30d0-4556-a8ac-0ce041547df5 admin admin] RBAC: Authorizing `identity:get_user(user_id=3dccf69cde3442c68200f8a9b9ed4ebb)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:26:53.004864 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dc7295-30d0-4556-a8ac-0ce041547df5 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:26:53.006431 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 5/9] 10.222.0.81 () {56 vars in 1198 bytes} [Mon Jul 18 16:26:52 2022] GET /identity/v3/users/3dccf69cde3442c68200f8a9b9ed4ebb => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:26:55.044331 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae0f5a-c318-4265-a430-869cf4bb75eb None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:26:55.044903 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae0f5a-c318-4265-a430-869cf4bb75eb None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:26:55.044903 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae0f5a-c318-4265-a430-869cf4bb75eb None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:26:55.046246 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 5/10] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:26:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:26:55.051928 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb36b0c-4577-4bbc-a607-122faef45919 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:26:55.052332 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb36b0c-4577-4bbc-a607-122faef45919 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:26:55.052500 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb36b0c-4577-4bbc-a607-122faef45919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:26:55.069477 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-0eb36b0c-4577-4bbc-a607-122faef45919 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:26:55.070708 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-0eb36b0c-4577-4bbc-a607-122faef45919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:26:55.117661 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172e689-8e70-4aeb-8403-0ec215824b5d None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:26:55.117944 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172e689-8e70-4aeb-8403-0ec215824b5d None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:26:55.118224 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172e689-8e70-4aeb-8403-0ec215824b5d None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:26:55.119588 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 6/11] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:26:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:26:55.124643 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb2555-8bfb-4e38-b298-889dd651ddcf None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:26:55.124931 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb2555-8bfb-4e38-b298-889dd651ddcf None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:26:55.125370 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb2555-8bfb-4e38-b298-889dd651ddcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:26:55.156600 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 6/12] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:26:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:26:55.170445 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG passlib.handlers.bcrypt [None req-85eb2555-8bfb-4e38-b298-889dd651ddcf None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80544) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 18 16:26:55.170861 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG passlib.handlers.bcrypt [None req-85eb2555-8bfb-4e38-b298-889dd651ddcf None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80544) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 18 16:26:55.179834 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb36b0c-4577-4bbc-a607-122faef45919 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:26:55.203773 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:26:55.217116 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-85eb2555-8bfb-4e38-b298-889dd651ddcf None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:26:55.218744 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-85eb2555-8bfb-4e38-b298-889dd651ddcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:26:55.284367 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb36b0c-4577-4bbc-a607-122faef45919 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:26:55.318814 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4859c834-612c-4c9b-8f4e-00330cb88dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:26:55.319533 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859c834-612c-4c9b-8f4e-00330cb88dcd None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:26:55.319849 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859c834-612c-4c9b-8f4e-00330cb88dcd None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:26:55.320131 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859c834-612c-4c9b-8f4e-00330cb88dcd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:26:55.320237 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 7/13] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:26:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 16:26:55.331762 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4859c834-612c-4c9b-8f4e-00330cb88dcd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:26:55.341818 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eb2555-8bfb-4e38-b298-889dd651ddcf None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:26:55.342832 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-4859c834-612c-4c9b-8f4e-00330cb88dcd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:26:55.342832 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:26:55.342832 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:26:55.342832 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:26:55.342832 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:26:55.342832 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:26:55.342832 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:26:55.342832 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:26:55.342832 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:26:55.342832 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:26:55.342832 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:26:55.342832 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:26:55.342832 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:26:55.342832 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:26:55.342832 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:26:55.342832 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:26:55.344050 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:26:55.344050 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:26:55.344050 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:26:55.344050 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:26:55.344050 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:26:55.344050 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:26:55.344050 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:26:55.344050 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:26:55.344050 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:26:55.344050 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:26:55.344050 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:26:55.344050 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:26:55.344050 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:26:55.344050 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:26:55.344050 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:26:55.344050 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:26:55.344979 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:26:55.344979 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:26:55.344979 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:26:55.344979 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:26:55.344979 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:26:55.344979 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:26:55.344979 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:26:55.344979 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:26:55.344979 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:26:55.344979 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:26:55.344979 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:26:55.344979 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:26:55.344979 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 7/14] 10.222.0.81 () {56 vars in 1096 bytes} [Mon Jul 18 16:26:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:26:55.350545 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4859c834-612c-4c9b-8f4e-00330cb88dcd None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:26:55.434258 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:26:55.447119 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eb2555-8bfb-4e38-b298-889dd651ddcf None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:26:55.449572 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:26:55.452711 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4859c834-612c-4c9b-8f4e-00330cb88dcd None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:26:55.488969 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0564ff5-6226-45de-9354-469f13cf122d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:26:55.489701 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8ea4a4-3d36-4e17-9f50-79b4f569f00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:26:55.489865 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0564ff5-6226-45de-9354-469f13cf122d None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:26:55.490149 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0564ff5-6226-45de-9354-469f13cf122d None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:26:55.490361 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ea4a4-3d36-4e17-9f50-79b4f569f00d None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:26:55.490448 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0564ff5-6226-45de-9354-469f13cf122d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:26:55.490640 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ea4a4-3d36-4e17-9f50-79b4f569f00d None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:26:55.490910 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ea4a4-3d36-4e17-9f50-79b4f569f00d None admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:26:55.491662 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8ea4a4-3d36-4e17-9f50-79b4f569f00d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:26:55.491989 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8ea4a4-3d36-4e17-9f50-79b4f569f00d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:26:55.493378 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8ea4a4-3d36-4e17-9f50-79b4f569f00d None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:26:55.505592 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 8/15] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Jul 18 16:26:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:26:55.511349 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8ea4a4-3d36-4e17-9f50-79b4f569f00d None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:26:55.561096 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0564ff5-6226-45de-9354-469f13cf122d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:26:55.562630 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0564ff5-6226-45de-9354-469f13cf122d None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:26:55.614867 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8ea4a4-3d36-4e17-9f50-79b4f569f00d None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:26:55.649895 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a364e0-388f-42dc-980f-d6c5115f99ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:26:55.650828 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a364e0-388f-42dc-980f-d6c5115f99ef None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:26:55.651227 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a364e0-388f-42dc-980f-d6c5115f99ef None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:26:55.651398 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a364e0-388f-42dc-980f-d6c5115f99ef None admin] PATH_INFO: `/v3/users/3dccf69cde3442c68200f8a9b9ed4ebb` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:26:55.652760 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a364e0-388f-42dc-980f-d6c5115f99ef None admin] RBAC: Authorizing `identity:get_user(user_id=3dccf69cde3442c68200f8a9b9ed4ebb)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:26:55.654119 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a364e0-388f-42dc-980f-d6c5115f99ef None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:26:55.655971 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 9/16] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Jul 18 16:26:55 2022] GET /identity/v3/users/3dccf69cde3442c68200f8a9b9ed4ebb => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:26:55.661687 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a364e0-388f-42dc-980f-d6c5115f99ef None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:26:55.663988 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 8/17] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Jul 18 16:26:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 18 16:26:55.669273 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0564ff5-6226-45de-9354-469f13cf122d None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:26:55.672226 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:26:55.677126 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:26:55.766560 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a364e0-388f-42dc-980f-d6c5115f99ef None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:26:55.773536 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0564ff5-6226-45de-9354-469f13cf122d None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:26:55.802010 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601469db-3e9f-4122-8190-f817d440108a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:26:55.802812 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601469db-3e9f-4122-8190-f817d440108a None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:26:55.803101 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601469db-3e9f-4122-8190-f817d440108a None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:26:55.803378 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601469db-3e9f-4122-8190-f817d440108a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:26:55.804595 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601469db-3e9f-4122-8190-f817d440108a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:26:55.806048 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601469db-3e9f-4122-8190-f817d440108a None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:26:55.807660 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 10/18] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:26:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:26:55.809798 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63308c04-544d-4421-bfa3-8922b05743a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:26:55.810582 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63308c04-544d-4421-bfa3-8922b05743a5 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:26:55.810859 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63308c04-544d-4421-bfa3-8922b05743a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:26:55.811129 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63308c04-544d-4421-bfa3-8922b05743a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:26:55.813316 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601469db-3e9f-4122-8190-f817d440108a None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:26:55.834311 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63308c04-544d-4421-bfa3-8922b05743a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:26:55.835810 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63308c04-544d-4421-bfa3-8922b05743a5 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:26:55.857282 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-63308c04-544d-4421-bfa3-8922b05743a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:26:55.857282 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:26:55.857282 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:26:55.857282 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:26:55.857282 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:26:55.857282 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:26:55.857282 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:26:55.857282 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:26:55.857282 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:26:55.857282 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:26:55.857282 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:26:55.857282 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:26:55.857282 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:26:55.857282 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:26:55.857282 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:26:55.858200 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:26:55.858200 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:26:55.858200 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:26:55.858200 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:26:55.858200 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:26:55.858200 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:26:55.858200 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:26:55.858200 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:26:55.858200 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:26:55.858200 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:26:55.858200 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:26:55.858200 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:26:55.858200 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:26:55.858200 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:26:55.858200 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:26:55.858200 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:26:55.858200 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:26:55.859022 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:26:55.859022 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:26:55.859022 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:26:55.859022 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:26:55.859022 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 9/19] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:26:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:26:55.864950 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63308c04-544d-4421-bfa3-8922b05743a5 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:26:55.896380 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:26:55.915925 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601469db-3e9f-4122-8190-f817d440108a None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:26:55.925633 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:26:55.950024 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc172fe-7a57-4d2f-8619-7d4235a30d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:26:55.950662 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc172fe-7a57-4d2f-8619-7d4235a30d95 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:26:55.950949 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc172fe-7a57-4d2f-8619-7d4235a30d95 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:26:55.951265 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc172fe-7a57-4d2f-8619-7d4235a30d95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:26:55.952119 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc172fe-7a57-4d2f-8619-7d4235a30d95 None admin] RBAC: Adding query filter params (role.id=fd83eab44cb343a2b532ce32a2ac31d8, scope.domain.id=default, user.id=3dccf69cde3442c68200f8a9b9ed4ebb) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:26:55.952429 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc172fe-7a57-4d2f-8619-7d4235a30d95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:26:55.953879 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc172fe-7a57-4d2f-8619-7d4235a30d95 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:26:55.961274 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 11/20] 10.222.0.81 () {56 vars in 1322 bytes} [Mon Jul 18 16:26:55 2022] GET /identity/v3/role_assignments?user.id=3dccf69cde3442c68200f8a9b9ed4ebb&scope.domain.id=default&role.id=fd83eab44cb343a2b532ce32a2ac31d8 => generated 233 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:26:55.974005 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63308c04-544d-4421-bfa3-8922b05743a5 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:26:56.012220 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e49a56c-3611-42fb-a159-df2e4f3ebe89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:26:56.012916 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49a56c-3611-42fb-a159-df2e4f3ebe89 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:26:56.013203 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49a56c-3611-42fb-a159-df2e4f3ebe89 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:26:56.013477 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49a56c-3611-42fb-a159-df2e4f3ebe89 None admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:26:56.014222 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e49a56c-3611-42fb-a159-df2e4f3ebe89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:26:56.015168 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e49a56c-3611-42fb-a159-df2e4f3ebe89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:26:56.016337 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e49a56c-3611-42fb-a159-df2e4f3ebe89 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:26:56.036333 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 10/21] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:26:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:26:58.112333 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63568fa-fa44-4fba-991c-9800a63b1547 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:26:58.112873 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63568fa-fa44-4fba-991c-9800a63b1547 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:26:58.112873 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63568fa-fa44-4fba-991c-9800a63b1547 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:26:58.114568 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 12/22] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:26:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:26:58.119835 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e748298f-3406-4576-854e-16f3c55c59ef None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:26:58.120292 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e748298f-3406-4576-854e-16f3c55c59ef None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:26:58.120374 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e748298f-3406-4576-854e-16f3c55c59ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:26:58.146515 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-e748298f-3406-4576-854e-16f3c55c59ef None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:26:58.147821 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-e748298f-3406-4576-854e-16f3c55c59ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:26:58.237815 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 11/23] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:26:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:26:58.268574 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63568fa-fa44-4fba-991c-9800a63b1547 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:26:58.405604 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63568fa-fa44-4fba-991c-9800a63b1547 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:26:58.456430 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf119a0c-d963-42e1-92df-7be43c1459e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:26:58.457235 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf119a0c-d963-42e1-92df-7be43c1459e9 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:26:58.457520 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf119a0c-d963-42e1-92df-7be43c1459e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:26:58.457796 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf119a0c-d963-42e1-92df-7be43c1459e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:26:58.481149 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf119a0c-d963-42e1-92df-7be43c1459e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:26:58.489419 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-cf119a0c-d963-42e1-92df-7be43c1459e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:26:58.489419 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:26:58.489419 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:26:58.489419 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:26:58.489419 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:26:58.489419 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:26:58.489419 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:26:58.489419 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:26:58.489419 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:26:58.489419 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:26:58.489419 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:26:58.489419 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:26:58.489419 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:26:58.489419 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:26:58.489419 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:26:58.489419 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:26:58.490279 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:26:58.490279 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:26:58.490279 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:26:58.490279 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:26:58.490279 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:26:58.490279 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:26:58.490279 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:26:58.490279 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:26:58.490279 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:26:58.490279 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:26:58.490279 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:26:58.490279 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:26:58.490279 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:26:58.490279 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:26:58.490279 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:26:58.490279 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:26:58.491468 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:26:58.491468 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:26:58.491468 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:26:58.491468 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:26:58.491468 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:26:58.491468 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:26:58.491468 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:26:58.491468 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:26:58.491468 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:26:58.491468 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:26:58.491468 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:26:58.491468 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:26:58.491468 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 13/24] 10.222.0.81 () {56 vars in 1096 bytes} [Mon Jul 18 16:26:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:26:58.496665 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e748298f-3406-4576-854e-16f3c55c59ef None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:26:58.555196 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:26:58.616931 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e748298f-3406-4576-854e-16f3c55c59ef None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:26:58.662327 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd1c105-f347-4ffc-b330-3ced2b1dcfe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:26:58.662968 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd1c105-f347-4ffc-b330-3ced2b1dcfe2 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:26:58.663259 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd1c105-f347-4ffc-b330-3ced2b1dcfe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:26:58.663539 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd1c105-f347-4ffc-b330-3ced2b1dcfe2 None admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:26:58.664319 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd1c105-f347-4ffc-b330-3ced2b1dcfe2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:26:58.664623 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd1c105-f347-4ffc-b330-3ced2b1dcfe2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:26:58.666020 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd1c105-f347-4ffc-b330-3ced2b1dcfe2 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:26:58.689498 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 12/25] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Jul 18 16:26:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:26:58.695232 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf119a0c-d963-42e1-92df-7be43c1459e9 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:26:58.705445 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:26:58.775892 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b438d-5225-43d4-bfdc-67e26a48c372 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:26:58.776180 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b438d-5225-43d4-bfdc-67e26a48c372 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:26:58.776645 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b438d-5225-43d4-bfdc-67e26a48c372 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:26:58.778218 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 13/26] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:26:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:26:58.785693 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc78bfb-668d-432c-8a2e-1b3d74213edc None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:26:58.785982 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc78bfb-668d-432c-8a2e-1b3d74213edc None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:26:58.786261 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc78bfb-668d-432c-8a2e-1b3d74213edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:26:58.822546 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-cdc78bfb-668d-432c-8a2e-1b3d74213edc None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:26:58.824102 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-cdc78bfb-668d-432c-8a2e-1b3d74213edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:26:58.871248 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf119a0c-d963-42e1-92df-7be43c1459e9 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:26:58.934733 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e50563-62e2-4823-b34a-5165445aaaae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:26:58.935992 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e50563-62e2-4823-b34a-5165445aaaae None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:26:58.936450 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e50563-62e2-4823-b34a-5165445aaaae None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:26:58.936897 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e50563-62e2-4823-b34a-5165445aaaae None admin] PATH_INFO: `/v3/users/3dccf69cde3442c68200f8a9b9ed4ebb` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:26:58.938860 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e50563-62e2-4823-b34a-5165445aaaae None admin] RBAC: Authorizing `identity:get_user(user_id=3dccf69cde3442c68200f8a9b9ed4ebb)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:26:58.941842 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e50563-62e2-4823-b34a-5165445aaaae None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:26:58.945679 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 14/27] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Jul 18 16:26:58 2022] GET /identity/v3/users/3dccf69cde3442c68200f8a9b9ed4ebb => generated 247 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:26:58.953625 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e50563-62e2-4823-b34a-5165445aaaae None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:26:58.975369 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 14/28] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:26:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 16:26:59.017677 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc78bfb-668d-432c-8a2e-1b3d74213edc None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:26:59.095380 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:26:59.100863 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:26:59.136360 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e50563-62e2-4823-b34a-5165445aaaae None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:26:59.169601 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc78bfb-668d-432c-8a2e-1b3d74213edc None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:26:59.184674 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3661415d-f84a-4852-a662-5352e90ee66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:26:59.185817 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661415d-f84a-4852-a662-5352e90ee66e None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:26:59.186048 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661415d-f84a-4852-a662-5352e90ee66e None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:26:59.186332 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661415d-f84a-4852-a662-5352e90ee66e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:26:59.187794 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3661415d-f84a-4852-a662-5352e90ee66e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:26:59.189829 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3661415d-f84a-4852-a662-5352e90ee66e None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:26:59.192253 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 15/29] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:26:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:26:59.193703 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4e115-0138-46ab-9c4d-447f1fa003b6 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:26:59.193993 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4e115-0138-46ab-9c4d-447f1fa003b6 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:26:59.194277 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4e115-0138-46ab-9c4d-447f1fa003b6 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:26:59.200333 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 16/30] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:26:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:26:59.200333 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69690cdb-5ea2-4152-9ebd-c490aaa59735 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:26:59.200333 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69690cdb-5ea2-4152-9ebd-c490aaa59735 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:26:59.200333 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69690cdb-5ea2-4152-9ebd-c490aaa59735 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:26:59.200769 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 17/31] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:26:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:26:59.201478 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69690cdb-5ea2-4152-9ebd-c490aaa59735 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:26:59.228536 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24b6c66-169c-4e8e-bac8-f8de74ea0d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:26:59.229213 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b6c66-169c-4e8e-bac8-f8de74ea0d9b None admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:26:59.229557 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b6c66-169c-4e8e-bac8-f8de74ea0d9b None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:26:59.230394 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b6c66-169c-4e8e-bac8-f8de74ea0d9b None admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:26:59.231163 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24b6c66-169c-4e8e-bac8-f8de74ea0d9b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:26:59.232882 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24b6c66-169c-4e8e-bac8-f8de74ea0d9b None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:26:59.319371 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69690cdb-5ea2-4152-9ebd-c490aaa59735 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:26:59.359439 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09538ecb-8a91-46b1-bd0f-c368820b59f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:26:59.360379 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09538ecb-8a91-46b1-bd0f-c368820b59f7 None admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:26:59.360823 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09538ecb-8a91-46b1-bd0f-c368820b59f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:26:59.361110 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09538ecb-8a91-46b1-bd0f-c368820b59f7 None admin] PATH_INFO: `/v3/domains/default/users/3dccf69cde3442c68200f8a9b9ed4ebb/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:26:59.363194 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09538ecb-8a91-46b1-bd0f-c368820b59f7 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=3dccf69cde3442c68200f8a9b9ed4ebb, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:26:59.364652 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09538ecb-8a91-46b1-bd0f-c368820b59f7 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:26:59.447908 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:26:59.473861 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 15/32] 10.222.0.81 () {60 vars in 1131 bytes} [Mon Jul 18 16:26:59 2022] POST /identity/v3/roles => generated 219 bytes in 457 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:26:59.475524 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba412d7-4ba0-4c45-b60a-5a07ef8eae59 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:26:59.475860 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba412d7-4ba0-4c45-b60a-5a07ef8eae59 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:26:59.476144 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba412d7-4ba0-4c45-b60a-5a07ef8eae59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:26:59.520959 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-5ba412d7-4ba0-4c45-b60a-5a07ef8eae59 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:26:59.522541 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-5ba412d7-4ba0-4c45-b60a-5a07ef8eae59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:26:59.568474 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 18/33] 10.222.0.81 () {58 vars in 1361 bytes} [Mon Jul 18 16:26:59 2022] PUT /identity/v3/domains/default/users/3dccf69cde3442c68200f8a9b9ed4ebb/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:26:59.576599 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6017d64f-dd5b-42be-b90a-723155e2b05e None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:26:59.577324 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6017d64f-dd5b-42be-b90a-723155e2b05e None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:26:59.577812 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6017d64f-dd5b-42be-b90a-723155e2b05e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:26:59.637019 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-6017d64f-dd5b-42be-b90a-723155e2b05e None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:26:59.638610 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-6017d64f-dd5b-42be-b90a-723155e2b05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:26:59.665112 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 16/34] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:26:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:26:59.699086 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa81ae-a98d-44e8-975e-507d9b143549 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:26:59.699370 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa81ae-a98d-44e8-975e-507d9b143549 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:26:59.699656 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa81ae-a98d-44e8-975e-507d9b143549 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:26:59.701619 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 17/35] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:26:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:26:59.705805 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa81ae-a98d-44e8-975e-507d9b143549 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:26:59.742861 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 19/36] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:26:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:26:59.744958 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2e20e-a085-4b1a-966a-b8118543bef5 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:26:59.745307 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2e20e-a085-4b1a-966a-b8118543bef5 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:26:59.745594 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2e20e-a085-4b1a-966a-b8118543bef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:26:59.768242 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:26:59.768542 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-c7d2e20e-a085-4b1a-966a-b8118543bef5 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:26:59.769755 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-c7d2e20e-a085-4b1a-966a-b8118543bef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:26:59.858907 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 20/37] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:26:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:26:59.864467 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d2e20e-a085-4b1a-966a-b8118543bef5 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:26:59.881431 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa81ae-a98d-44e8-975e-507d9b143549 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:26:59.926018 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f19447-6558-43db-9b1c-25dfc2d004c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:26:59.926755 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f19447-6558-43db-9b1c-25dfc2d004c9 None admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:26:59.927045 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f19447-6558-43db-9b1c-25dfc2d004c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:26:59.927382 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f19447-6558-43db-9b1c-25dfc2d004c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:26:59.928261 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f19447-6558-43db-9b1c-25dfc2d004c9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:26:59.930450 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f19447-6558-43db-9b1c-25dfc2d004c9 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:26:59.937497 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:00.015852 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 18/38] 10.222.0.81 () {60 vars in 1131 bytes} [Mon Jul 18 16:26:59 2022] POST /identity/v3/roles => generated 225 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:27:00.016552 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f19447-6558-43db-9b1c-25dfc2d004c9 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:00.152842 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d2e20e-a085-4b1a-966a-b8118543bef5 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:00.164441 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:00.179449 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f19447-6558-43db-9b1c-25dfc2d004c9 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:00.198947 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d04650-0493-4435-9500-0e13f93efb59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:00.199775 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d04650-0493-4435-9500-0e13f93efb59 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:00.200069 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d04650-0493-4435-9500-0e13f93efb59 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:00.200347 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d04650-0493-4435-9500-0e13f93efb59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:00.211988 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d04650-0493-4435-9500-0e13f93efb59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:00.221614 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d04650-0493-4435-9500-0e13f93efb59 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:00.225526 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c2bb2-2869-4f6c-8986-69aa4dd18349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:00.226312 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c2bb2-2869-4f6c-8986-69aa4dd18349 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:00.226596 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c2bb2-2869-4f6c-8986-69aa4dd18349 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:00.226868 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c2bb2-2869-4f6c-8986-69aa4dd18349 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:00.230317 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682c2bb2-2869-4f6c-8986-69aa4dd18349 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:00.230317 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682c2bb2-2869-4f6c-8986-69aa4dd18349 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:00.231701 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 19/39] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:27:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:00.234370 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffdc0b6-f9e7-4543-9c44-e6e5583d15b0 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:00.234370 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffdc0b6-f9e7-4543-9c44-e6e5583d15b0 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:00.234538 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-99d04650-0493-4435-9500-0e13f93efb59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:27:00.234538 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:27:00.234538 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:27:00.234538 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:27:00.234538 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:27:00.234538 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:27:00.234538 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:27:00.234538 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:27:00.234538 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:27:00.234538 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:27:00.234538 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:27:00.234538 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:27:00.234538 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:27:00.234538 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:27:00.234538 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:27:00.235305 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:27:00.235305 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:27:00.235305 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:27:00.235305 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:27:00.235305 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:27:00.235305 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:27:00.235305 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:27:00.235305 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:27:00.235305 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:27:00.235305 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:27:00.235305 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:27:00.235305 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:27:00.235305 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:27:00.235305 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:27:00.235305 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:27:00.235305 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:27:00.235305 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:27:00.237452 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:27:00.237452 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:27:00.237452 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:27:00.237452 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:27:00.237672 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffdc0b6-f9e7-4543-9c44-e6e5583d15b0 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:00.237672 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 20/40] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:27:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:27:00.237672 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffdc0b6-f9e7-4543-9c44-e6e5583d15b0 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:00.242792 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 21/41] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:26:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:27:00.242792 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64deb6-6184-4cd5-a409-653443cbafb0 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:00.242792 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64deb6-6184-4cd5-a409-653443cbafb0 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:00.243056 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64deb6-6184-4cd5-a409-653443cbafb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:00.268697 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-0b64deb6-6184-4cd5-a409-653443cbafb0 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:27:00.271203 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-0b64deb6-6184-4cd5-a409-653443cbafb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:27:00.353973 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 22/42] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:27:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:27:00.354605 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b64deb6-6184-4cd5-a409-653443cbafb0 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:00.379265 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffdc0b6-f9e7-4543-9c44-e6e5583d15b0 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:00.398989 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:00.418005 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e227191-7979-42e1-85ab-4059676baea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:00.418877 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e227191-7979-42e1-85ab-4059676baea5 None admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:00.419335 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e227191-7979-42e1-85ab-4059676baea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:00.419787 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e227191-7979-42e1-85ab-4059676baea5 None admin] PATH_INFO: `/v3/projects` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:00.420642 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e227191-7979-42e1-85ab-4059676baea5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:00.422261 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e227191-7979-42e1-85ab-4059676baea5 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:00.457636 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b64deb6-6184-4cd5-a409-653443cbafb0 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:00.494607 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13663d2f-345f-4774-b3a8-ba029f7b5b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:00.495272 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13663d2f-345f-4774-b3a8-ba029f7b5b4c None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:00.495553 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13663d2f-345f-4774-b3a8-ba029f7b5b4c None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:00.495868 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13663d2f-345f-4774-b3a8-ba029f7b5b4c None admin] PATH_INFO: `/v3/domains` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:00.496593 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13663d2f-345f-4774-b3a8-ba029f7b5b4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:00.496901 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13663d2f-345f-4774-b3a8-ba029f7b5b4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:00.498275 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13663d2f-345f-4774-b3a8-ba029f7b5b4c None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:00.519290 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 23/43] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:27:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:00.519859 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13663d2f-345f-4774-b3a8-ba029f7b5b4c None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:00.530705 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 21/44] 10.222.0.81 () {60 vars in 1141 bytes} [Mon Jul 18 16:27:00 2022] POST /identity/v3/projects => generated 312 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:27:00.531915 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e227191-7979-42e1-85ab-4059676baea5 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:00.553307 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:00.660143 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e227191-7979-42e1-85ab-4059676baea5 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:00.677349 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13663d2f-345f-4774-b3a8-ba029f7b5b4c None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:00.679099 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:00.706217 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a686a1-0793-44a0-a2c3-84684d85eac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:00.706895 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a686a1-0793-44a0-a2c3-84684d85eac9 None admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:00.707184 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a686a1-0793-44a0-a2c3-84684d85eac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:00.707461 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a686a1-0793-44a0-a2c3-84684d85eac9 None admin] PATH_INFO: `/v3/projects` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:00.708220 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a686a1-0793-44a0-a2c3-84684d85eac9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:00.709723 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a686a1-0793-44a0-a2c3-84684d85eac9 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:00.721369 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb53842-13f2-4398-a0a3-ccb46074b3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:00.722246 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb53842-13f2-4398-a0a3-ccb46074b3c8 None admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:00.722675 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb53842-13f2-4398-a0a3-ccb46074b3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:00.722966 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb53842-13f2-4398-a0a3-ccb46074b3c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:00.723751 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb53842-13f2-4398-a0a3-ccb46074b3c8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:00.725332 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb53842-13f2-4398-a0a3-ccb46074b3c8 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:00.792823 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 22/45] 10.222.0.81 () {60 vars in 1141 bytes} [Mon Jul 18 16:27:00 2022] POST /identity/v3/projects => generated 301 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:27:00.835062 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 24/46] 10.222.0.81 () {60 vars in 1131 bytes} [Mon Jul 18 16:27:00 2022] POST /identity/v3/roles => generated 223 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:27:01.778139 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a131e9-ac13-4ec9-9245-bbc307f2a5be None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:01.782826 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a131e9-ac13-4ec9-9245-bbc307f2a5be None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:01.782826 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a131e9-ac13-4ec9-9245-bbc307f2a5be None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:01.782826 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 23/47] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:27:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:27:01.785620 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ba9dc-e655-4540-a815-ee59637d2d52 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:01.786019 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ba9dc-e655-4540-a815-ee59637d2d52 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:01.786191 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ba9dc-e655-4540-a815-ee59637d2d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:01.803284 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-6f3ba9dc-e655-4540-a815-ee59637d2d52 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:27:01.804519 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-6f3ba9dc-e655-4540-a815-ee59637d2d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:27:01.870936 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 25/48] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:27:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:27:01.894453 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a131e9-ac13-4ec9-9245-bbc307f2a5be None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:01.962608 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:02.005538 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a131e9-ac13-4ec9-9245-bbc307f2a5be None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:02.040488 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bbe84d-a751-4b44-b14a-a8bea46caa86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:02.041203 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bbe84d-a751-4b44-b14a-a8bea46caa86 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:02.041492 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bbe84d-a751-4b44-b14a-a8bea46caa86 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:02.041769 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bbe84d-a751-4b44-b14a-a8bea46caa86 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:02.159015 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bbe84d-a751-4b44-b14a-a8bea46caa86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:27:02.167943 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-e2bbe84d-a751-4b44-b14a-a8bea46caa86 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:27:02.167943 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:27:02.167943 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:27:02.167943 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:27:02.167943 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:27:02.167943 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:27:02.167943 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:27:02.167943 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:27:02.167943 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:27:02.167943 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:27:02.167943 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:27:02.167943 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:27:02.167943 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:27:02.167943 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:27:02.167943 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:27:02.167943 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:27:02.168897 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:27:02.168897 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:27:02.168897 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:27:02.168897 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:27:02.168897 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:27:02.168897 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:27:02.168897 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:27:02.168897 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:27:02.168897 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:27:02.168897 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:27:02.168897 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:27:02.168897 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:27:02.168897 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:27:02.168897 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:27:02.168897 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:27:02.168897 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:27:02.169954 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:27:02.169954 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:27:02.169954 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:27:02.169954 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:27:02.169954 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:27:02.169954 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:27:02.169954 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:27:02.169954 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:27:02.169954 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:27:02.169954 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:27:02.169954 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:27:02.169954 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:27:02.169954 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 24/49] 10.222.0.81 () {56 vars in 1096 bytes} [Mon Jul 18 16:27:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:27:02.175588 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ba9dc-e655-4540-a815-ee59637d2d52 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:02.271891 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:02.280328 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ba9dc-e655-4540-a815-ee59637d2d52 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:02.315071 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc395f83-86f2-46e2-8846-663f614dcd15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:02.315666 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc395f83-86f2-46e2-8846-663f614dcd15 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:02.315980 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc395f83-86f2-46e2-8846-663f614dcd15 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:02.316258 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc395f83-86f2-46e2-8846-663f614dcd15 None admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:02.317054 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc395f83-86f2-46e2-8846-663f614dcd15 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:02.317364 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc395f83-86f2-46e2-8846-663f614dcd15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:02.318740 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc395f83-86f2-46e2-8846-663f614dcd15 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:02.326885 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 26/50] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Jul 18 16:27:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:02.333141 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bbe84d-a751-4b44-b14a-a8bea46caa86 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:02.434494 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bbe84d-a751-4b44-b14a-a8bea46caa86 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:02.455018 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:02.471667 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7246db06-c07e-4007-a8b1-d8a933c68f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:02.472564 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246db06-c07e-4007-a8b1-d8a933c68f95 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:02.472844 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246db06-c07e-4007-a8b1-d8a933c68f95 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:02.473115 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246db06-c07e-4007-a8b1-d8a933c68f95 None admin] PATH_INFO: `/v3/users/3dccf69cde3442c68200f8a9b9ed4ebb` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:02.474549 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7246db06-c07e-4007-a8b1-d8a933c68f95 None admin] RBAC: Authorizing `identity:get_user(user_id=3dccf69cde3442c68200f8a9b9ed4ebb)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:02.476039 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7246db06-c07e-4007-a8b1-d8a933c68f95 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:02.477679 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 25/51] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Jul 18 16:27:02 2022] GET /identity/v3/users/3dccf69cde3442c68200f8a9b9ed4ebb => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:02.483309 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc395f83-86f2-46e2-8846-663f614dcd15 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:02.588769 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc395f83-86f2-46e2-8846-663f614dcd15 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:02.617171 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c338bd-c56f-4822-947d-6d81c3678d36 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:02.617463 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c338bd-c56f-4822-947d-6d81c3678d36 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:02.617747 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c338bd-c56f-4822-947d-6d81c3678d36 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:02.619121 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 26/52] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:27:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:27:02.621784 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a825a4b-d504-41e9-8eb9-ae846d7a2ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:02.622642 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a825a4b-d504-41e9-8eb9-ae846d7a2ab1 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:02.622944 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a825a4b-d504-41e9-8eb9-ae846d7a2ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:02.623223 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a825a4b-d504-41e9-8eb9-ae846d7a2ab1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:02.624083 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd6f2d-d698-4953-a86f-2d7d66b51aab None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:02.624378 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd6f2d-d698-4953-a86f-2d7d66b51aab None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:02.624471 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a825a4b-d504-41e9-8eb9-ae846d7a2ab1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:02.624665 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd6f2d-d698-4953-a86f-2d7d66b51aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:02.625869 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a825a4b-d504-41e9-8eb9-ae846d7a2ab1 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:02.627553 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 27/53] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:27:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:02.633275 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a825a4b-d504-41e9-8eb9-ae846d7a2ab1 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:02.642255 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-6ecd6f2d-d698-4953-a86f-2d7d66b51aab None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:27:02.643469 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-6ecd6f2d-d698-4953-a86f-2d7d66b51aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:27:02.662070 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:02.709770 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 27/54] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:27:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 16:27:02.733070 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd6f2d-d698-4953-a86f-2d7d66b51aab None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:02.736734 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a825a4b-d504-41e9-8eb9-ae846d7a2ab1 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:02.771878 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a57946-8a20-4f00-a159-e57b1af25cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:02.772549 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a57946-8a20-4f00-a159-e57b1af25cbe None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:02.772824 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a57946-8a20-4f00-a159-e57b1af25cbe None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:02.773103 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a57946-8a20-4f00-a159-e57b1af25cbe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:02.773929 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a57946-8a20-4f00-a159-e57b1af25cbe None admin] RBAC: Adding query filter params (role.id=fd83eab44cb343a2b532ce32a2ac31d8, scope.domain.id=default, user.id=3dccf69cde3442c68200f8a9b9ed4ebb) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:02.774235 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a57946-8a20-4f00-a159-e57b1af25cbe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:02.775690 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a57946-8a20-4f00-a159-e57b1af25cbe None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:02.781756 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 28/55] 10.222.0.81 () {56 vars in 1322 bytes} [Mon Jul 18 16:27:02 2022] GET /identity/v3/role_assignments?user.id=3dccf69cde3442c68200f8a9b9ed4ebb&scope.domain.id=default&role.id=fd83eab44cb343a2b532ce32a2ac31d8 => generated 530 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:27:02.840949 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd6f2d-d698-4953-a86f-2d7d66b51aab None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:02.860424 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:02.877982 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3857eb-0d26-48ab-9fde-b5fa372fe42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:02.878795 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3857eb-0d26-48ab-9fde-b5fa372fe42e None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:02.879087 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3857eb-0d26-48ab-9fde-b5fa372fe42e None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:02.879373 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3857eb-0d26-48ab-9fde-b5fa372fe42e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:02.880631 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3857eb-0d26-48ab-9fde-b5fa372fe42e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:02.882120 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3857eb-0d26-48ab-9fde-b5fa372fe42e None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:02.884089 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 28/56] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:27:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:27:02.890091 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a57946-8a20-4f00-a159-e57b1af25cbe None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:02.980310 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:02.995226 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a57946-8a20-4f00-a159-e57b1af25cbe None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:03.029881 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc8a6c0-189c-45bc-be30-1ebc80d533ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:03.030544 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8a6c0-189c-45bc-be30-1ebc80d533ae None admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:03.030830 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8a6c0-189c-45bc-be30-1ebc80d533ae None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:03.031111 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8a6c0-189c-45bc-be30-1ebc80d533ae None admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:03.031856 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc8a6c0-189c-45bc-be30-1ebc80d533ae None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:03.033882 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc8a6c0-189c-45bc-be30-1ebc80d533ae None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:03.136773 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 29/57] 10.222.0.81 () {60 vars in 1140 bytes} [Mon Jul 18 16:27:02 2022] POST /identity/v3/projects => generated 298 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:27:05.125131 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a5fca-a118-4e08-848b-1fd2a80a34fd None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:05.125645 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a5fca-a118-4e08-848b-1fd2a80a34fd None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:05.125733 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a5fca-a118-4e08-848b-1fd2a80a34fd None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:05.127063 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 29/58] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:27:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:27:05.132511 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed67fce-8b76-4141-829a-2d5005a28fb6 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:05.132941 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed67fce-8b76-4141-829a-2d5005a28fb6 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:05.133161 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed67fce-8b76-4141-829a-2d5005a28fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:05.151218 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-aed67fce-8b76-4141-829a-2d5005a28fb6 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:27:05.152440 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-aed67fce-8b76-4141-829a-2d5005a28fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:27:05.216610 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 30/59] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:27:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:27:05.241740 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06a5fca-a118-4e08-848b-1fd2a80a34fd None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:05.344891 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06a5fca-a118-4e08-848b-1fd2a80a34fd None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:05.377962 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075ec3ec-5d76-4404-87d4-e01c774c4593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:05.378685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075ec3ec-5d76-4404-87d4-e01c774c4593 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:05.378971 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075ec3ec-5d76-4404-87d4-e01c774c4593 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:05.379250 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075ec3ec-5d76-4404-87d4-e01c774c4593 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:05.380459 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075ec3ec-5d76-4404-87d4-e01c774c4593 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:05.381922 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075ec3ec-5d76-4404-87d4-e01c774c4593 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:05.383535 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 30/60] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:27:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:05.389347 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed67fce-8b76-4141-829a-2d5005a28fb6 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:05.453962 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:05.487079 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed67fce-8b76-4141-829a-2d5005a28fb6 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:05.521072 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2efa45-4220-45a0-9640-39af5f26455a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:05.521765 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2efa45-4220-45a0-9640-39af5f26455a None admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:05.522025 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2efa45-4220-45a0-9640-39af5f26455a None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:05.522394 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2efa45-4220-45a0-9640-39af5f26455a None admin] PATH_INFO: `/v3/users` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:05.523059 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2efa45-4220-45a0-9640-39af5f26455a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:05.524967 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2efa45-4220-45a0-9640-39af5f26455a None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:05.621085 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 31/61] 10.222.0.81 () {60 vars in 1132 bytes} [Mon Jul 18 16:27:05 2022] POST /identity/v3/users => generated 275 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:27:08.883990 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b0fe7-4ef4-4cd3-b9de-423b02c2e7da None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:08.885031 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b0fe7-4ef4-4cd3-b9de-423b02c2e7da None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:08.885615 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b0fe7-4ef4-4cd3-b9de-423b02c2e7da None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:08.887360 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 31/62] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:27:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:27:08.893217 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4848b-139a-468c-8097-f95b4232456c None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:08.894702 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4848b-139a-468c-8097-f95b4232456c None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:08.895189 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4848b-139a-468c-8097-f95b4232456c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:08.920833 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-dfa4848b-139a-468c-8097-f95b4232456c None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:27:08.924470 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e9c2c-85f1-4389-8e52-f2b02b5115af None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:08.925031 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e9c2c-85f1-4389-8e52-f2b02b5115af None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:08.925510 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e9c2c-85f1-4389-8e52-f2b02b5115af None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:08.927174 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 32/63] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:27:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:27:08.927469 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-dfa4848b-139a-468c-8097-f95b4232456c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:27:08.933602 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f211b0-7b65-436a-afca-8dc836289b09 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:08.934230 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f211b0-7b65-436a-afca-8dc836289b09 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:08.934705 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f211b0-7b65-436a-afca-8dc836289b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:08.968467 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-46f211b0-7b65-436a-afca-8dc836289b09 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:27:08.970638 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-46f211b0-7b65-436a-afca-8dc836289b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:27:09.060162 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:09.064992 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 32/64] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:27:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:27:09.087406 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 33/65] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:27:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:27:09.100032 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa4848b-139a-468c-8097-f95b4232456c None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:09.100977 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7caac12-4c37-4766-8fdb-b08dd38e7a3d None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:09.101435 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7caac12-4c37-4766-8fdb-b08dd38e7a3d None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:09.101893 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7caac12-4c37-4766-8fdb-b08dd38e7a3d None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:09.105114 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 34/66] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:27:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:27:09.112412 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a97669-6336-400d-ab01-c87672b273a7 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:09.112949 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a97669-6336-400d-ab01-c87672b273a7 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:09.113356 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a97669-6336-400d-ab01-c87672b273a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:09.137070 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-04a97669-6336-400d-ab01-c87672b273a7 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:27:09.138420 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-04a97669-6336-400d-ab01-c87672b273a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:27:09.170235 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:09.219283 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 35/67] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:27:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 16:27:09.227741 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a97669-6336-400d-ab01-c87672b273a7 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:09.228247 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa4848b-139a-468c-8097-f95b4232456c None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:09.278969 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a011820-4dee-464d-a2db-b96fd46db37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:09.280171 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a011820-4dee-464d-a2db-b96fd46db37d None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:09.280633 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a011820-4dee-464d-a2db-b96fd46db37d None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:09.281096 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a011820-4dee-464d-a2db-b96fd46db37d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:09.294429 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a011820-4dee-464d-a2db-b96fd46db37d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:27:09.303630 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-3a011820-4dee-464d-a2db-b96fd46db37d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:27:09.303630 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:27:09.303630 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:27:09.303630 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:27:09.303630 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:27:09.303630 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:27:09.303630 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:27:09.303630 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:27:09.303630 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:27:09.303630 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:27:09.303630 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:27:09.303630 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:27:09.303630 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:27:09.303630 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:27:09.303630 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:27:09.303630 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:27:09.304599 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:27:09.304599 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:27:09.304599 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:27:09.304599 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:27:09.304599 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:27:09.304599 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:27:09.304599 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:27:09.304599 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:27:09.304599 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:27:09.304599 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:27:09.304599 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:27:09.304599 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:27:09.304599 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:27:09.304599 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:27:09.304599 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:27:09.304599 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:27:09.305382 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:27:09.305382 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:27:09.305382 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:27:09.305382 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:27:09.305382 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:27:09.305382 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:27:09.305382 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:27:09.305382 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:27:09.305382 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:27:09.305382 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:27:09.305382 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:27:09.305382 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:27:09.308333 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 33/68] 10.222.0.81 () {56 vars in 1096 bytes} [Mon Jul 18 16:27:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:27:09.309440 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a011820-4dee-464d-a2db-b96fd46db37d None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:09.358812 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a97669-6336-400d-ab01-c87672b273a7 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:09.376153 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:09.399816 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef334ec-d4dc-4534-8698-a9765170d50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:09.400684 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef334ec-d4dc-4534-8698-a9765170d50d None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:09.401384 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef334ec-d4dc-4534-8698-a9765170d50d None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:09.401508 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef334ec-d4dc-4534-8698-a9765170d50d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:09.415619 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef334ec-d4dc-4534-8698-a9765170d50d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:27:09.425450 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-5ef334ec-d4dc-4534-8698-a9765170d50d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 16:27:09.425450 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:27:09.425450 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:27:09.425450 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:27:09.425450 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:27:09.425450 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:27:09.425450 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:27:09.425450 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:27:09.425450 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:27:09.425450 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:27:09.425450 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:27:09.425450 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:27:09.425450 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:27:09.425450 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:27:09.425450 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:27:09.425450 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:27:09.426384 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:27:09.426384 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:27:09.426384 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:27:09.426384 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:27:09.426384 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:27:09.426384 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:27:09.426384 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:27:09.426384 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:27:09.426384 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:27:09.426384 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:27:09.426384 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:27:09.426384 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:27:09.426384 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:27:09.426384 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:27:09.426384 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:27:09.426384 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:27:09.427177 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:27:09.427177 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:27:09.427177 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:27:09.427177 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:27:09.427177 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:27:09.427177 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:27:09.427177 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:27:09.427177 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:27:09.427177 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:27:09.427177 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:27:09.427177 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 16:27:09.427177 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:27:09.429076 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a011820-4dee-464d-a2db-b96fd46db37d None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:09.432267 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 36/69] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Jul 18 16:27:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:27:09.433099 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef334ec-d4dc-4534-8698-a9765170d50d None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:09.452385 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:09.488054 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0431f047-cbf8-497c-810a-11d486f813eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:09.489039 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0431f047-cbf8-497c-810a-11d486f813eb None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:09.489352 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0431f047-cbf8-497c-810a-11d486f813eb None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:09.489829 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0431f047-cbf8-497c-810a-11d486f813eb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:09.507219 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0431f047-cbf8-497c-810a-11d486f813eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:27:09.516426 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-0431f047-cbf8-497c-810a-11d486f813eb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 16:27:09.516426 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:27:09.516426 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:27:09.516426 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:27:09.516426 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:27:09.516426 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:27:09.516426 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:27:09.516426 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:27:09.516426 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:27:09.516426 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:27:09.516426 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:27:09.516426 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:27:09.516426 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:27:09.516426 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:27:09.516426 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:27:09.516426 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:27:09.517353 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:27:09.517353 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:27:09.517353 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:27:09.517353 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:27:09.517353 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:27:09.517353 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:27:09.517353 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:27:09.517353 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:27:09.517353 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:27:09.517353 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:27:09.517353 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:27:09.517353 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:27:09.517353 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:27:09.517353 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:27:09.517353 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:27:09.517353 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:27:09.518131 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:27:09.518131 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:27:09.518131 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:27:09.518131 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:27:09.518131 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:27:09.518131 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:27:09.518131 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:27:09.518131 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:27:09.518131 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:27:09.518131 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:27:09.518131 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 16:27:09.518131 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:27:09.518131 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 34/70] 10.222.0.81 () {56 vars in 1114 bytes} [Mon Jul 18 16:27:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:27:09.518790 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0431f047-cbf8-497c-810a-11d486f813eb None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:09.583506 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef334ec-d4dc-4534-8698-a9765170d50d None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:09.635108 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92435a38-377c-444c-9991-cff53bbbca12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:09.636560 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92435a38-377c-444c-9991-cff53bbbca12 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:09.637153 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92435a38-377c-444c-9991-cff53bbbca12 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:09.637668 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92435a38-377c-444c-9991-cff53bbbca12 None admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:09.639142 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92435a38-377c-444c-9991-cff53bbbca12 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:09.639743 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92435a38-377c-444c-9991-cff53bbbca12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:09.642972 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92435a38-377c-444c-9991-cff53bbbca12 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:09.659837 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 37/71] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Jul 18 16:27:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:09.661332 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92435a38-377c-444c-9991-cff53bbbca12 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:09.675974 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0431f047-cbf8-497c-810a-11d486f813eb None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:09.705426 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:09.715891 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f4261-cea0-4bf3-9522-b0f588b3b047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:09.719005 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f4261-cea0-4bf3-9522-b0f588b3b047 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:09.719005 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f4261-cea0-4bf3-9522-b0f588b3b047 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:09.719005 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f4261-cea0-4bf3-9522-b0f588b3b047 None admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:09.719631 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1f4261-cea0-4bf3-9522-b0f588b3b047 None admin] RBAC: Adding query filter params (name=member) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:09.720229 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1f4261-cea0-4bf3-9522-b0f588b3b047 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:09.722943 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1f4261-cea0-4bf3-9522-b0f588b3b047 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:09.732846 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 35/72] 10.222.0.81 () {56 vars in 1101 bytes} [Mon Jul 18 16:27:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:09.734207 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a844211-465f-48c8-8b6f-4c9e93065624 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:09.734503 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a844211-465f-48c8-8b6f-4c9e93065624 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:09.734790 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a844211-465f-48c8-8b6f-4c9e93065624 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:09.736757 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 36/73] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:27:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:27:09.737960 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86e63d-41cc-4ca0-86fb-38866bfbc458 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:09.738251 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86e63d-41cc-4ca0-86fb-38866bfbc458 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:09.738535 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86e63d-41cc-4ca0-86fb-38866bfbc458 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:09.739868 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 37/74] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:27:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:27:09.740874 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb86e63d-41cc-4ca0-86fb-38866bfbc458 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:09.781948 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92435a38-377c-444c-9991-cff53bbbca12 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:09.789085 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:09.824951 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45ee66d-e680-4ff6-bd2f-46b68c227adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:09.825696 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ee66d-e680-4ff6-bd2f-46b68c227adb None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:09.825992 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ee66d-e680-4ff6-bd2f-46b68c227adb None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:09.826271 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ee66d-e680-4ff6-bd2f-46b68c227adb None admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:09.827046 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45ee66d-e680-4ff6-bd2f-46b68c227adb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:09.827348 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45ee66d-e680-4ff6-bd2f-46b68c227adb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:09.828904 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45ee66d-e680-4ff6-bd2f-46b68c227adb None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:09.838447 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 38/75] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Jul 18 16:27:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:09.839331 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45ee66d-e680-4ff6-bd2f-46b68c227adb None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:09.865081 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb86e63d-41cc-4ca0-86fb-38866bfbc458 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:09.901252 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0dee23-fa08-4eef-aea3-3fb14a70f1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:09.902187 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0dee23-fa08-4eef-aea3-3fb14a70f1b4 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:09.902467 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0dee23-fa08-4eef-aea3-3fb14a70f1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:09.902741 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0dee23-fa08-4eef-aea3-3fb14a70f1b4 None admin] PATH_INFO: `/v3/users/3dccf69cde3442c68200f8a9b9ed4ebb` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:09.904039 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0dee23-fa08-4eef-aea3-3fb14a70f1b4 None admin] RBAC: Authorizing `identity:get_user(user_id=3dccf69cde3442c68200f8a9b9ed4ebb)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:09.905490 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0dee23-fa08-4eef-aea3-3fb14a70f1b4 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:09.907705 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 38/76] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Jul 18 16:27:09 2022] GET /identity/v3/users/3dccf69cde3442c68200f8a9b9ed4ebb => generated 247 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:09.908898 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1152ffe4-c153-4575-b4b2-40c84288fe84 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:09.909189 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1152ffe4-c153-4575-b4b2-40c84288fe84 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:09.909466 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1152ffe4-c153-4575-b4b2-40c84288fe84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:09.926413 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-1152ffe4-c153-4575-b4b2-40c84288fe84 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:27:09.927701 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-1152ffe4-c153-4575-b4b2-40c84288fe84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:27:09.949749 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:09.953421 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45ee66d-e680-4ff6-bd2f-46b68c227adb None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:09.990442 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93fdd41-2393-4b78-9612-37f4a208a126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:09.991334 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93fdd41-2393-4b78-9612-37f4a208a126 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:09.991622 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93fdd41-2393-4b78-9612-37f4a208a126 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:09.991929 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93fdd41-2393-4b78-9612-37f4a208a126 None admin] PATH_INFO: `/v3/users/c43109bed5da4b9d873232adae450346` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:10.004609 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 39/77] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:27:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:27:10.005921 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf009080-6e4e-4697-ade8-0f80035c1588 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:10.006207 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf009080-6e4e-4697-ade8-0f80035c1588 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:10.009734 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf009080-6e4e-4697-ade8-0f80035c1588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:10.016127 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93fdd41-2393-4b78-9612-37f4a208a126 None admin] RBAC: Authorizing `identity:get_user(user_id=c43109bed5da4b9d873232adae450346)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:10.017685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93fdd41-2393-4b78-9612-37f4a208a126 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:10.019759 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 39/78] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Jul 18 16:27:09 2022] GET /identity/v3/users/c43109bed5da4b9d873232adae450346 => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:10.020244 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93fdd41-2393-4b78-9612-37f4a208a126 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:10.026641 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-cf009080-6e4e-4697-ade8-0f80035c1588 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:27:10.027875 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-cf009080-6e4e-4697-ade8-0f80035c1588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:27:10.057149 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:10.103894 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 40/79] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:27:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:27:10.105757 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf009080-6e4e-4697-ade8-0f80035c1588 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:10.132883 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93fdd41-2393-4b78-9612-37f4a208a126 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:10.169793 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36bc1cb-905c-4a34-930b-67b748f72758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:10.170671 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36bc1cb-905c-4a34-930b-67b748f72758 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:10.170961 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36bc1cb-905c-4a34-930b-67b748f72758 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:10.171242 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36bc1cb-905c-4a34-930b-67b748f72758 None admin] PATH_INFO: `/v3/users/c43109bed5da4b9d873232adae450346` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:10.172534 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36bc1cb-905c-4a34-930b-67b748f72758 None admin] RBAC: Authorizing `identity:get_user(user_id=c43109bed5da4b9d873232adae450346)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:10.173999 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36bc1cb-905c-4a34-930b-67b748f72758 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:10.175842 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 40/80] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Jul 18 16:27:10 2022] GET /identity/v3/users/c43109bed5da4b9d873232adae450346 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:10.176517 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36bc1cb-905c-4a34-930b-67b748f72758 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:10.208747 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:10.225028 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf009080-6e4e-4697-ade8-0f80035c1588 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:10.267088 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf6394-fdee-4afb-a909-243b08da278b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:10.267772 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf6394-fdee-4afb-a909-243b08da278b None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:10.268055 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf6394-fdee-4afb-a909-243b08da278b None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:10.268330 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf6394-fdee-4afb-a909-243b08da278b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:10.293394 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36bc1cb-905c-4a34-930b-67b748f72758 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:10.302311 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:10.330419 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe93042-701b-4134-8125-0843d5fea0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:10.331083 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe93042-701b-4134-8125-0843d5fea0ba None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:10.331389 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe93042-701b-4134-8125-0843d5fea0ba None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:10.331693 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe93042-701b-4134-8125-0843d5fea0ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:10.341850 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaf6394-fdee-4afb-a909-243b08da278b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:10.343252 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaf6394-fdee-4afb-a909-243b08da278b None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:10.400435 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe93042-701b-4134-8125-0843d5fea0ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:10.401917 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe93042-701b-4134-8125-0843d5fea0ba None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:10.429936 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:10.442969 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 41/81] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Jul 18 16:27:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:27:10.443861 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf6394-fdee-4afb-a909-243b08da278b None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:10.516956 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:10.529555 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 41/82] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Jul 18 16:27:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:27:10.532607 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe93042-701b-4134-8125-0843d5fea0ba None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:10.562786 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf6394-fdee-4afb-a909-243b08da278b None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:10.597103 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e9d26d-c73d-47a0-9b21-51539828cc2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:10.597905 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9d26d-c73d-47a0-9b21-51539828cc2a None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:10.598189 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9d26d-c73d-47a0-9b21-51539828cc2a None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:10.598468 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9d26d-c73d-47a0-9b21-51539828cc2a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:10.609438 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e9d26d-c73d-47a0-9b21-51539828cc2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:27:10.617868 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-82e9d26d-c73d-47a0-9b21-51539828cc2a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 16:27:10.617868 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:27:10.617868 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:27:10.617868 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:27:10.617868 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:27:10.617868 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:27:10.617868 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:27:10.617868 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:27:10.617868 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:27:10.617868 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:27:10.617868 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:27:10.617868 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:27:10.617868 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:27:10.617868 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:27:10.617868 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:27:10.617868 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:27:10.618917 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:27:10.618917 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:27:10.618917 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:27:10.618917 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:27:10.618917 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:27:10.618917 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:27:10.618917 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:27:10.618917 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:27:10.618917 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:27:10.618917 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:27:10.618917 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:27:10.618917 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:27:10.618917 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:27:10.618917 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:27:10.618917 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:27:10.618917 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:27:10.619735 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:27:10.619735 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:27:10.619735 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:27:10.619735 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:27:10.619735 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:27:10.619735 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:27:10.619735 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:27:10.619735 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:27:10.619735 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:27:10.619735 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:27:10.619735 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 16:27:10.619735 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:27:10.619735 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 42/83] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Jul 18 16:27:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:27:10.620393 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e9d26d-c73d-47a0-9b21-51539828cc2a None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:10.648630 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe93042-701b-4134-8125-0843d5fea0ba None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:10.678190 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:10.692597 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be197d-5a64-40f7-99a9-642303e968e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:10.692597 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be197d-5a64-40f7-99a9-642303e968e7 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:10.692597 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be197d-5a64-40f7-99a9-642303e968e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:10.692597 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be197d-5a64-40f7-99a9-642303e968e7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:10.693137 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0be197d-5a64-40f7-99a9-642303e968e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:10.694608 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0be197d-5a64-40f7-99a9-642303e968e7 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:10.696475 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 42/84] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:27:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:10.697066 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be197d-5a64-40f7-99a9-642303e968e7 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:10.733875 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e9d26d-c73d-47a0-9b21-51539828cc2a None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:10.757750 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:10.769330 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6df759f-0027-4f41-b177-8b8a30ae7b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:10.773143 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df759f-0027-4f41-b177-8b8a30ae7b52 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:10.773143 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df759f-0027-4f41-b177-8b8a30ae7b52 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:10.773143 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df759f-0027-4f41-b177-8b8a30ae7b52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:10.802891 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be197d-5a64-40f7-99a9-642303e968e7 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:10.836712 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f53e24a-ca1d-43a3-a17a-867bca0f7b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:10.837587 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53e24a-ca1d-43a3-a17a-867bca0f7b2b None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:10.837869 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53e24a-ca1d-43a3-a17a-867bca0f7b2b None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:10.838142 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53e24a-ca1d-43a3-a17a-867bca0f7b2b None admin] PATH_INFO: `/v3/projects/edc913ab51354b1da43bd3c47b3b2c51` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:10.838509 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6df759f-0027-4f41-b177-8b8a30ae7b52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:10.839343 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f53e24a-ca1d-43a3-a17a-867bca0f7b2b None admin] RBAC: Authorizing `identity:get_project(project_id=edc913ab51354b1da43bd3c47b3b2c51)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:10.840019 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6df759f-0027-4f41-b177-8b8a30ae7b52 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:10.840813 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f53e24a-ca1d-43a3-a17a-867bca0f7b2b None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:10.842524 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 43/85] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Jul 18 16:27:10 2022] GET /identity/v3/projects/edc913ab51354b1da43bd3c47b3b2c51 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:10.843288 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f53e24a-ca1d-43a3-a17a-867bca0f7b2b None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:10.903462 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:10.941952 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 43/86] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Jul 18 16:27:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:27:10.942898 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6df759f-0027-4f41-b177-8b8a30ae7b52 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:10.945345 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f53e24a-ca1d-43a3-a17a-867bca0f7b2b None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:10.969794 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:10.980502 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b4aba-2f29-4e34-bd85-28d9f6eaf0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:10.981371 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b4aba-2f29-4e34-bd85-28d9f6eaf0fb None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:10.981656 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b4aba-2f29-4e34-bd85-28d9f6eaf0fb None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:10.981935 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b4aba-2f29-4e34-bd85-28d9f6eaf0fb None admin] PATH_INFO: `/v3/projects/edc913ab51354b1da43bd3c47b3b2c51` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:10.983153 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b4aba-2f29-4e34-bd85-28d9f6eaf0fb None admin] RBAC: Authorizing `identity:get_project(project_id=edc913ab51354b1da43bd3c47b3b2c51)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:10.984640 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b4aba-2f29-4e34-bd85-28d9f6eaf0fb None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:10.986482 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 44/87] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Jul 18 16:27:10 2022] GET /identity/v3/projects/edc913ab51354b1da43bd3c47b3b2c51 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:10.987246 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b4aba-2f29-4e34-bd85-28d9f6eaf0fb None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:11.047252 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6df759f-0027-4f41-b177-8b8a30ae7b52 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:11.082950 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a345084f-17ba-451f-8441-6b1b04917f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:11.083623 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a345084f-17ba-451f-8441-6b1b04917f6a None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:11.083932 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a345084f-17ba-451f-8441-6b1b04917f6a None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:11.084210 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a345084f-17ba-451f-8441-6b1b04917f6a None admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:11.085150 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a345084f-17ba-451f-8441-6b1b04917f6a None admin] RBAC: Adding query filter params (name=member) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:11.085699 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a345084f-17ba-451f-8441-6b1b04917f6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:11.087494 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a345084f-17ba-451f-8441-6b1b04917f6a None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:11.089062 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b4aba-2f29-4e34-bd85-28d9f6eaf0fb None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:11.101430 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 44/88] 10.222.0.81 () {56 vars in 1101 bytes} [Mon Jul 18 16:27:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:11.101430 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a345084f-17ba-451f-8441-6b1b04917f6a None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:11.117386 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:11.125200 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b233d1-64a6-4304-b7bf-e8fb225887df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:11.129085 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b233d1-64a6-4304-b7bf-e8fb225887df None admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:11.129085 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b233d1-64a6-4304-b7bf-e8fb225887df None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:11.129085 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b233d1-64a6-4304-b7bf-e8fb225887df None admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:11.129085 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b233d1-64a6-4304-b7bf-e8fb225887df None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:11.129582 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b233d1-64a6-4304-b7bf-e8fb225887df None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:11.187065 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:11.203477 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a345084f-17ba-451f-8441-6b1b04917f6a None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:11.226746 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 45/89] 10.222.0.81 () {60 vars in 1132 bytes} [Mon Jul 18 16:27:10 2022] POST /identity/v3/users => generated 289 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:27:11.227610 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b233d1-64a6-4304-b7bf-e8fb225887df None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:11.246020 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e964c27-9abe-4228-9b7c-b7b775aaf094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:11.247124 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e964c27-9abe-4228-9b7c-b7b775aaf094 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:11.247770 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e964c27-9abe-4228-9b7c-b7b775aaf094 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:11.248249 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e964c27-9abe-4228-9b7c-b7b775aaf094 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:11.249280 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e964c27-9abe-4228-9b7c-b7b775aaf094 None admin] RBAC: Adding query filter params (role.id=fd83eab44cb343a2b532ce32a2ac31d8, scope.project.id=edc913ab51354b1da43bd3c47b3b2c51, user.id=3dccf69cde3442c68200f8a9b9ed4ebb) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:11.249786 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e964c27-9abe-4228-9b7c-b7b775aaf094 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:11.252601 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e964c27-9abe-4228-9b7c-b7b775aaf094 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:11.271749 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 45/90] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Jul 18 16:27:11 2022] GET /identity/v3/role_assignments?user.id=3dccf69cde3442c68200f8a9b9ed4ebb&scope.project.id=edc913ab51354b1da43bd3c47b3b2c51&role.id=fd83eab44cb343a2b532ce32a2ac31d8 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:11.271749 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e964c27-9abe-4228-9b7c-b7b775aaf094 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:11.399190 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b233d1-64a6-4304-b7bf-e8fb225887df None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:11.432693 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e964c27-9abe-4228-9b7c-b7b775aaf094 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:11.455501 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5809a6b9-cb91-4975-a8da-705b9450f5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:11.456386 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809a6b9-cb91-4975-a8da-705b9450f5c9 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:11.456677 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809a6b9-cb91-4975-a8da-705b9450f5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:11.456960 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809a6b9-cb91-4975-a8da-705b9450f5c9 None admin] PATH_INFO: `/v3/projects/edc913ab51354b1da43bd3c47b3b2c51` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:11.458246 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5809a6b9-cb91-4975-a8da-705b9450f5c9 None admin] RBAC: Authorizing `identity:get_project(project_id=edc913ab51354b1da43bd3c47b3b2c51)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:11.460076 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5809a6b9-cb91-4975-a8da-705b9450f5c9 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:11.461877 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 46/91] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Jul 18 16:27:11 2022] GET /identity/v3/projects/edc913ab51354b1da43bd3c47b3b2c51 => generated 298 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:11.462471 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5809a6b9-cb91-4975-a8da-705b9450f5c9 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:11.501875 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae46a2b-ecb4-41d7-a5c8-5940c6254508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:11.503351 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae46a2b-ecb4-41d7-a5c8-5940c6254508 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:11.503660 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae46a2b-ecb4-41d7-a5c8-5940c6254508 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:11.504117 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae46a2b-ecb4-41d7-a5c8-5940c6254508 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:11.504895 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae46a2b-ecb4-41d7-a5c8-5940c6254508 None admin] RBAC: Adding query filter params (role.id=ad3a2bc7b2094a4da1a95a143c8d9436, scope.project.id=edc913ab51354b1da43bd3c47b3b2c51, user.id=c43109bed5da4b9d873232adae450346) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:11.505210 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae46a2b-ecb4-41d7-a5c8-5940c6254508 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:11.506790 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae46a2b-ecb4-41d7-a5c8-5940c6254508 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:11.514305 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 46/92] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Jul 18 16:27:11 2022] GET /identity/v3/role_assignments?user.id=c43109bed5da4b9d873232adae450346&scope.project.id=edc913ab51354b1da43bd3c47b3b2c51&role.id=ad3a2bc7b2094a4da1a95a143c8d9436 => generated 259 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:11.515157 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae46a2b-ecb4-41d7-a5c8-5940c6254508 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:11.536911 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:11.538989 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:11.603355 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5809a6b9-cb91-4975-a8da-705b9450f5c9 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:11.649561 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc56c38-a21c-4424-9d48-03ab688fb21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:11.650462 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc56c38-a21c-4424-9d48-03ab688fb21d None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:11.650750 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc56c38-a21c-4424-9d48-03ab688fb21d None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:11.651032 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc56c38-a21c-4424-9d48-03ab688fb21d None admin] PATH_INFO: `/v3/users/c43109bed5da4b9d873232adae450346` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:11.652984 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc56c38-a21c-4424-9d48-03ab688fb21d None admin] RBAC: Authorizing `identity:get_user(user_id=c43109bed5da4b9d873232adae450346)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:11.654036 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc56c38-a21c-4424-9d48-03ab688fb21d None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:11.655837 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 47/93] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Jul 18 16:27:11 2022] GET /identity/v3/users/c43109bed5da4b9d873232adae450346 => generated 275 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:11.661692 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc56c38-a21c-4424-9d48-03ab688fb21d None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:11.669513 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae46a2b-ecb4-41d7-a5c8-5940c6254508 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:11.732415 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da1eae-9bdb-4649-a3ff-e1a605e82e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:11.733490 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da1eae-9bdb-4649-a3ff-e1a605e82e29 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:11.733964 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da1eae-9bdb-4649-a3ff-e1a605e82e29 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:11.734424 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da1eae-9bdb-4649-a3ff-e1a605e82e29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:11.735984 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26da1eae-9bdb-4649-a3ff-e1a605e82e29 None admin] RBAC: Adding query filter params (role.id=6bfa001ddac347da894c7231f853c3df, scope.project.id=edc913ab51354b1da43bd3c47b3b2c51, user.id=c43109bed5da4b9d873232adae450346) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:11.736536 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26da1eae-9bdb-4649-a3ff-e1a605e82e29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:11.739253 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26da1eae-9bdb-4649-a3ff-e1a605e82e29 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:11.749443 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 47/94] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Jul 18 16:27:11 2022] GET /identity/v3/role_assignments?user.id=c43109bed5da4b9d873232adae450346&scope.project.id=edc913ab51354b1da43bd3c47b3b2c51&role.id=6bfa001ddac347da894c7231f853c3df => generated 259 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:11.811193 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc56c38-a21c-4424-9d48-03ab688fb21d None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:11.869919 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:11.894112 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1661696-65fa-4959-9a61-e0a1ce2fd254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:11.894785 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1661696-65fa-4959-9a61-e0a1ce2fd254 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:11.895070 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1661696-65fa-4959-9a61-e0a1ce2fd254 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:11.895347 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1661696-65fa-4959-9a61-e0a1ce2fd254 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:11.985680 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1661696-65fa-4959-9a61-e0a1ce2fd254 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:11.987079 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1661696-65fa-4959-9a61-e0a1ce2fd254 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:12.127887 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 48/95] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Jul 18 16:27:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:27:12.134030 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da1eae-9bdb-4649-a3ff-e1a605e82e29 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:12.287506 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:12.325170 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da1eae-9bdb-4649-a3ff-e1a605e82e29 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:12.387298 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b829d18a-3a02-426d-8121-120ca5860a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:12.388814 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829d18a-3a02-426d-8121-120ca5860a02 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:12.389305 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829d18a-3a02-426d-8121-120ca5860a02 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:12.389789 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829d18a-3a02-426d-8121-120ca5860a02 None admin] PATH_INFO: `/v3/projects/4e9d997e3210479cb2de18f16738b320` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:12.392414 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b829d18a-3a02-426d-8121-120ca5860a02 None admin] RBAC: Authorizing `identity:get_project(project_id=4e9d997e3210479cb2de18f16738b320)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:12.395024 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b829d18a-3a02-426d-8121-120ca5860a02 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:12.397941 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 48/96] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Jul 18 16:27:12 2022] GET /identity/v3/projects/4e9d997e3210479cb2de18f16738b320 => generated 312 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:12.404542 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1661696-65fa-4959-9a61-e0a1ce2fd254 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:12.454623 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:12.647277 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1661696-65fa-4959-9a61-e0a1ce2fd254 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:12.752319 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a674a2-dc16-4800-8055-fd42674f0029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:12.753482 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a674a2-dc16-4800-8055-fd42674f0029 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:12.753979 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a674a2-dc16-4800-8055-fd42674f0029 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:12.754457 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a674a2-dc16-4800-8055-fd42674f0029 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:12.756074 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a674a2-dc16-4800-8055-fd42674f0029 None admin] RBAC: Adding query filter params (role.id=ad3a2bc7b2094a4da1a95a143c8d9436, scope.project.id=4e9d997e3210479cb2de18f16738b320, user.id=c43109bed5da4b9d873232adae450346) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:12.756633 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a674a2-dc16-4800-8055-fd42674f0029 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:12.759644 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a674a2-dc16-4800-8055-fd42674f0029 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:12.777533 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 49/97] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Jul 18 16:27:12 2022] GET /identity/v3/role_assignments?user.id=c43109bed5da4b9d873232adae450346&scope.project.id=4e9d997e3210479cb2de18f16738b320&role.id=ad3a2bc7b2094a4da1a95a143c8d9436 => generated 259 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:14.073649 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6919ad-a479-4781-a348-60405a8a16d4 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:14.074212 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6919ad-a479-4781-a348-60405a8a16d4 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:14.074212 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6919ad-a479-4781-a348-60405a8a16d4 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:14.075861 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 49/98] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:27:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:27:14.082111 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d4fe47-b5ed-45c3-b60e-223a223ab009 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:14.082601 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d4fe47-b5ed-45c3-b60e-223a223ab009 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:14.082675 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d4fe47-b5ed-45c3-b60e-223a223ab009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:14.109374 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-c2d4fe47-b5ed-45c3-b60e-223a223ab009 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:27:14.111490 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-c2d4fe47-b5ed-45c3-b60e-223a223ab009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:27:14.218018 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 50/99] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:27:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:27:14.270310 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6919ad-a479-4781-a348-60405a8a16d4 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:14.412342 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6919ad-a479-4781-a348-60405a8a16d4 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:14.456826 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c14683-8985-450d-af9c-b81b8baca81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:14.457671 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c14683-8985-450d-af9c-b81b8baca81d None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:14.457961 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c14683-8985-450d-af9c-b81b8baca81d None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:14.458302 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c14683-8985-450d-af9c-b81b8baca81d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:14.475750 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c14683-8985-450d-af9c-b81b8baca81d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:27:14.485853 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-e2c14683-8985-450d-af9c-b81b8baca81d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:27:14.485853 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:27:14.485853 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:27:14.485853 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:27:14.485853 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:27:14.485853 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:27:14.485853 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:27:14.485853 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:27:14.485853 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:27:14.485853 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:27:14.485853 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:27:14.485853 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:27:14.485853 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:27:14.485853 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:27:14.485853 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:27:14.485853 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:27:14.488057 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:27:14.488057 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:27:14.488057 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:27:14.488057 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:27:14.488057 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:27:14.488057 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:27:14.488057 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:27:14.488057 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:27:14.488057 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:27:14.488057 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:27:14.488057 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:27:14.488057 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:27:14.488057 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:27:14.488057 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:27:14.488057 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:27:14.488057 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:27:14.489910 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:27:14.489910 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:27:14.489910 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:27:14.489910 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:27:14.489910 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:27:14.489910 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:27:14.489910 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:27:14.489910 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:27:14.489910 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:27:14.489910 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:27:14.489910 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:27:14.489910 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:27:14.489910 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 50/100] 10.222.0.81 () {56 vars in 1096 bytes} [Mon Jul 18 16:27:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:27:14.492933 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d4fe47-b5ed-45c3-b60e-223a223ab009 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:14.529273 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:14.664065 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d4fe47-b5ed-45c3-b60e-223a223ab009 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:14.702800 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd79ba1-add2-4b15-b97d-7e1cbdaafd2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:14.703559 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd79ba1-add2-4b15-b97d-7e1cbdaafd2d None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:14.703896 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd79ba1-add2-4b15-b97d-7e1cbdaafd2d None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:14.704163 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd79ba1-add2-4b15-b97d-7e1cbdaafd2d None admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:14.704978 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd79ba1-add2-4b15-b97d-7e1cbdaafd2d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:14.705285 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd79ba1-add2-4b15-b97d-7e1cbdaafd2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:14.706745 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd79ba1-add2-4b15-b97d-7e1cbdaafd2d None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:14.716509 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 51/101] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Jul 18 16:27:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:14.723822 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c14683-8985-450d-af9c-b81b8baca81d None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:14.750348 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:14.862084 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74dc86-ef33-4619-8155-ae47dce9433e None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:14.862561 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74dc86-ef33-4619-8155-ae47dce9433e None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:14.863033 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74dc86-ef33-4619-8155-ae47dce9433e None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:14.870425 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 52/102] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:27:14 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:27:14.876983 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824262d4-c405-44c1-970a-1f851fb7e2da None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:14.877387 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824262d4-c405-44c1-970a-1f851fb7e2da None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:14.877769 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824262d4-c405-44c1-970a-1f851fb7e2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:14.900684 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c14683-8985-450d-af9c-b81b8baca81d None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:14.925677 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-824262d4-c405-44c1-970a-1f851fb7e2da None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:27:14.927435 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-824262d4-c405-44c1-970a-1f851fb7e2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:27:14.966014 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f67fb-3ebb-4cc2-8f68-a29ce54cbb25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:14.966919 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f67fb-3ebb-4cc2-8f68-a29ce54cbb25 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:14.967203 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f67fb-3ebb-4cc2-8f68-a29ce54cbb25 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:14.967515 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f67fb-3ebb-4cc2-8f68-a29ce54cbb25 None admin] PATH_INFO: `/v3/users/3dccf69cde3442c68200f8a9b9ed4ebb` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:14.971005 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22f67fb-3ebb-4cc2-8f68-a29ce54cbb25 None admin] RBAC: Authorizing `identity:get_user(user_id=3dccf69cde3442c68200f8a9b9ed4ebb)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:14.972547 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22f67fb-3ebb-4cc2-8f68-a29ce54cbb25 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:14.974531 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 51/103] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Jul 18 16:27:14 2022] GET /identity/v3/users/3dccf69cde3442c68200f8a9b9ed4ebb => generated 247 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:14.985189 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f67fb-3ebb-4cc2-8f68-a29ce54cbb25 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:15.116766 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 53/104] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:27:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:27:15.126557 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:15.151132 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824262d4-c405-44c1-970a-1f851fb7e2da None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:15.160361 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:15.189683 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f67fb-3ebb-4cc2-8f68-a29ce54cbb25 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:15.246100 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f89f627-8aed-4bdc-9153-fce1d6f818fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:15.248841 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f89f627-8aed-4bdc-9153-fce1d6f818fe None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:15.248841 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f89f627-8aed-4bdc-9153-fce1d6f818fe None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:15.248841 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f89f627-8aed-4bdc-9153-fce1d6f818fe None admin] PATH_INFO: `/v3/projects/edc913ab51354b1da43bd3c47b3b2c51` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:15.251079 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f89f627-8aed-4bdc-9153-fce1d6f818fe None admin] RBAC: Authorizing `identity:get_project(project_id=edc913ab51354b1da43bd3c47b3b2c51)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:15.253220 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f89f627-8aed-4bdc-9153-fce1d6f818fe None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:15.256026 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 52/105] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Jul 18 16:27:14 2022] GET /identity/v3/projects/edc913ab51354b1da43bd3c47b3b2c51 => generated 298 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:15.257749 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589abb1-7879-474c-ba30-9331b6823d30 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:15.258135 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589abb1-7879-474c-ba30-9331b6823d30 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:15.258849 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589abb1-7879-474c-ba30-9331b6823d30 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:15.260784 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 53/106] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:27:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:27:15.263952 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b589abb1-7879-474c-ba30-9331b6823d30 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:15.317042 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824262d4-c405-44c1-970a-1f851fb7e2da None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:15.357844 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ee7b2a-5273-4d76-80ed-cc86de544fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:15.358720 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee7b2a-5273-4d76-80ed-cc86de544fee None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:15.359007 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee7b2a-5273-4d76-80ed-cc86de544fee None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:15.359290 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee7b2a-5273-4d76-80ed-cc86de544fee None admin] PATH_INFO: `/v3/domains/default` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:15.360597 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ee7b2a-5273-4d76-80ed-cc86de544fee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:15.362092 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ee7b2a-5273-4d76-80ed-cc86de544fee None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:15.363782 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 54/107] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:27:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:27:15.365119 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453afb56-9881-47a2-922d-ddca4de8598e None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:15.365404 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453afb56-9881-47a2-922d-ddca4de8598e None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:15.365681 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453afb56-9881-47a2-922d-ddca4de8598e None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:15.367255 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 55/108] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:27:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:27:15.368293 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb227e-8ce4-421d-868c-bc0d3517d1a5 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:15.368577 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb227e-8ce4-421d-868c-bc0d3517d1a5 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:15.368852 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb227e-8ce4-421d-868c-bc0d3517d1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:15.388101 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b589abb1-7879-474c-ba30-9331b6823d30 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:15.388677 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-0adb227e-8ce4-421d-868c-bc0d3517d1a5 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:27:15.389860 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-0adb227e-8ce4-421d-868c-bc0d3517d1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:27:15.433805 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7030e82a-ab27-4781-99ae-41af1a77d13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:15.435459 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7030e82a-ab27-4781-99ae-41af1a77d13b None admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:15.436274 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7030e82a-ab27-4781-99ae-41af1a77d13b None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:15.437028 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7030e82a-ab27-4781-99ae-41af1a77d13b None admin] PATH_INFO: `/v3/projects/edc913ab51354b1da43bd3c47b3b2c51/users/3dccf69cde3442c68200f8a9b9ed4ebb/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:15.440519 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7030e82a-ab27-4781-99ae-41af1a77d13b None admin] RBAC: Authorizing `identity:create_grant(project_id=edc913ab51354b1da43bd3c47b3b2c51, user_id=3dccf69cde3442c68200f8a9b9ed4ebb, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:15.442684 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7030e82a-ab27-4781-99ae-41af1a77d13b None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:15.465845 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 56/109] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:27:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:27:15.465845 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a860b7f-2d22-4558-9aef-700b83971edf None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:15.465845 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a860b7f-2d22-4558-9aef-700b83971edf None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:15.465845 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a860b7f-2d22-4558-9aef-700b83971edf None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:15.467196 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 57/110] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:27:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:27:15.472087 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a860b7f-2d22-4558-9aef-700b83971edf None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:15.477037 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:15.535799 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 54/111] 10.222.0.81 () {58 vars in 1439 bytes} [Mon Jul 18 16:27:15 2022] PUT /identity/v3/projects/edc913ab51354b1da43bd3c47b3b2c51/users/3dccf69cde3442c68200f8a9b9ed4ebb/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:27:15.546450 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0fa6f6-230a-4518-b896-783bd8b5e892 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:15.546776 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0fa6f6-230a-4518-b896-783bd8b5e892 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:15.547019 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0fa6f6-230a-4518-b896-783bd8b5e892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:15.557882 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:15.577327 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-af0fa6f6-230a-4518-b896-783bd8b5e892 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:27:15.579664 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-af0fa6f6-230a-4518-b896-783bd8b5e892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:27:15.603536 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a860b7f-2d22-4558-9aef-700b83971edf None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:15.659840 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc747244-a00f-4464-96c1-37031994fedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:15.660561 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc747244-a00f-4464-96c1-37031994fedc None admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:15.660918 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc747244-a00f-4464-96c1-37031994fedc None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:15.661439 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc747244-a00f-4464-96c1-37031994fedc None admin] PATH_INFO: `/v3/projects` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:15.662795 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc747244-a00f-4464-96c1-37031994fedc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:15.665055 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc747244-a00f-4464-96c1-37031994fedc None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:15.668155 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 55/112] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:27:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:27:15.679227 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ffbbf-a01b-493c-9b84-6104457353d3 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:15.680651 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ffbbf-a01b-493c-9b84-6104457353d3 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:15.684377 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ffbbf-a01b-493c-9b84-6104457353d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:15.716425 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-980ffbbf-a01b-493c-9b84-6104457353d3 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:27:15.716425 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-980ffbbf-a01b-493c-9b84-6104457353d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:27:15.795328 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 56/113] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:27:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:27:15.796502 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980ffbbf-a01b-493c-9b84-6104457353d3 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:15.816905 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 58/114] 10.222.0.81 () {60 vars in 1141 bytes} [Mon Jul 18 16:27:15 2022] POST /identity/v3/projects => generated 302 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:27:15.818119 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc747244-a00f-4464-96c1-37031994fedc None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:15.983318 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:16.005534 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:16.043766 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980ffbbf-a01b-493c-9b84-6104457353d3 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:16.074907 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc747244-a00f-4464-96c1-37031994fedc None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:16.106106 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd14dff6-2b9d-490a-9c96-2fe5943ea536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:16.107089 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd14dff6-2b9d-490a-9c96-2fe5943ea536 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:16.107371 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd14dff6-2b9d-490a-9c96-2fe5943ea536 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:16.107645 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd14dff6-2b9d-490a-9c96-2fe5943ea536 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:16.124049 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a406c060-0340-4f94-a6d2-d3e97eed6386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:16.125772 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd14dff6-2b9d-490a-9c96-2fe5943ea536 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:27:16.126262 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406c060-0340-4f94-a6d2-d3e97eed6386 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:16.126716 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406c060-0340-4f94-a6d2-d3e97eed6386 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:16.127278 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406c060-0340-4f94-a6d2-d3e97eed6386 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:16.139511 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-fd14dff6-2b9d-490a-9c96-2fe5943ea536 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 16:27:16.139511 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:27:16.139511 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:27:16.139511 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:27:16.139511 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:27:16.139511 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:27:16.139511 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:27:16.139511 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:27:16.139511 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:27:16.139511 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:27:16.139511 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:27:16.139511 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:27:16.139511 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:27:16.139511 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:27:16.139511 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:27:16.139511 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:27:16.141276 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:27:16.141276 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:27:16.141276 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:27:16.141276 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:27:16.141276 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:27:16.141276 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:27:16.141276 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:27:16.141276 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:27:16.141276 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:27:16.141276 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:27:16.141276 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:27:16.141276 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:27:16.141276 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:27:16.141276 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:27:16.141276 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:27:16.141276 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:27:16.142426 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:27:16.142426 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:27:16.142426 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:27:16.142426 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:27:16.142426 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:27:16.142426 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:27:16.142426 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:27:16.142426 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:27:16.142426 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:27:16.142426 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:27:16.142426 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 16:27:16.142426 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:27:16.142426 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 57/115] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Jul 18 16:27:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:27:16.143076 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd14dff6-2b9d-490a-9c96-2fe5943ea536 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:16.158531 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a406c060-0340-4f94-a6d2-d3e97eed6386 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:27:16.176463 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-a406c060-0340-4f94-a6d2-d3e97eed6386 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 16:27:16.176463 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:27:16.176463 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:27:16.176463 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:27:16.176463 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:27:16.176463 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:27:16.176463 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:27:16.176463 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:27:16.176463 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:27:16.176463 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:27:16.176463 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:27:16.176463 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:27:16.176463 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:27:16.176463 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:27:16.176463 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:27:16.176463 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:27:16.178343 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:27:16.178343 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:27:16.178343 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:27:16.178343 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:27:16.178343 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:27:16.178343 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:27:16.178343 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:27:16.178343 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:27:16.178343 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:27:16.178343 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:27:16.178343 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:27:16.178343 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:27:16.178343 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:27:16.178343 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:27:16.178343 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:27:16.178343 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:27:16.180126 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:27:16.180126 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:27:16.180126 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:27:16.180126 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:27:16.180126 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:27:16.180126 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:27:16.180126 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:27:16.180126 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:27:16.180126 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:27:16.180126 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:27:16.180126 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 16:27:16.180126 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:27:16.184359 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 59/116] 10.222.0.81 () {56 vars in 1114 bytes} [Mon Jul 18 16:27:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:27:16.186934 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80998a9-0147-4255-8220-6fa955c79af5 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:16.187675 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80998a9-0147-4255-8220-6fa955c79af5 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:16.188433 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80998a9-0147-4255-8220-6fa955c79af5 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:16.191002 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 60/117] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:27:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:27:16.192083 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80998a9-0147-4255-8220-6fa955c79af5 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:16.285901 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd14dff6-2b9d-490a-9c96-2fe5943ea536 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:16.316415 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:16.333302 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766bc443-9931-4b11-a330-69f32b0a041e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:16.336826 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766bc443-9931-4b11-a330-69f32b0a041e None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:16.336826 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766bc443-9931-4b11-a330-69f32b0a041e None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:16.336826 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766bc443-9931-4b11-a330-69f32b0a041e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:16.350743 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80998a9-0147-4255-8220-6fa955c79af5 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:16.351768 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766bc443-9931-4b11-a330-69f32b0a041e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:27:16.362586 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-766bc443-9931-4b11-a330-69f32b0a041e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 16:27:16.362586 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:27:16.362586 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:27:16.362586 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:27:16.362586 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:27:16.362586 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:27:16.362586 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:27:16.362586 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:27:16.362586 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:27:16.362586 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:27:16.362586 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:27:16.362586 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:27:16.362586 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:27:16.362586 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:27:16.362586 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:27:16.362586 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:27:16.363537 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:27:16.363537 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:27:16.363537 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:27:16.363537 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:27:16.363537 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:27:16.363537 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:27:16.363537 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:27:16.363537 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:27:16.363537 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:27:16.363537 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:27:16.363537 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:27:16.363537 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:27:16.363537 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:27:16.363537 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:27:16.363537 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:27:16.363537 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:27:16.364387 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:27:16.364387 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:27:16.364387 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:27:16.364387 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:27:16.364387 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:27:16.364387 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:27:16.364387 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:27:16.364387 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:27:16.364387 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:27:16.364387 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:27:16.364387 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 16:27:16.364387 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:27:16.364387 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 58/118] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Jul 18 16:27:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:27:16.365030 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766bc443-9931-4b11-a330-69f32b0a041e None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:16.383281 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:16.413214 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c1ab9-31a7-4230-9493-8637f029ed09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:16.414297 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c1ab9-31a7-4230-9493-8637f029ed09 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:16.415382 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c1ab9-31a7-4230-9493-8637f029ed09 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:16.416730 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c1ab9-31a7-4230-9493-8637f029ed09 None admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:16.417757 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4c1ab9-31a7-4230-9493-8637f029ed09 None admin] RBAC: Adding query filter params (name=member) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:16.418985 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4c1ab9-31a7-4230-9493-8637f029ed09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:16.421003 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4c1ab9-31a7-4230-9493-8637f029ed09 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:16.433347 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 61/119] 10.222.0.81 () {56 vars in 1101 bytes} [Mon Jul 18 16:27:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:16.435040 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a718c8-bcd2-4f81-943b-734b7916a144 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:16.435551 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a718c8-bcd2-4f81-943b-734b7916a144 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:16.436057 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a718c8-bcd2-4f81-943b-734b7916a144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:16.455175 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-40a718c8-bcd2-4f81-943b-734b7916a144 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:27:16.456888 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-40a718c8-bcd2-4f81-943b-734b7916a144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:27:16.519944 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766bc443-9931-4b11-a330-69f32b0a041e None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:16.550298 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 62/120] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:27:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:27:16.551606 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a718c8-bcd2-4f81-943b-734b7916a144 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:16.570947 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf08241d-9ff0-4d59-96ea-f1049afd6138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:16.572099 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf08241d-9ff0-4d59-96ea-f1049afd6138 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:16.572730 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf08241d-9ff0-4d59-96ea-f1049afd6138 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:16.573209 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf08241d-9ff0-4d59-96ea-f1049afd6138 None admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:16.574306 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf08241d-9ff0-4d59-96ea-f1049afd6138 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:16.574881 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf08241d-9ff0-4d59-96ea-f1049afd6138 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:16.577542 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf08241d-9ff0-4d59-96ea-f1049afd6138 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:16.589829 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 59/121] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Jul 18 16:27:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:16.591019 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf08241d-9ff0-4d59-96ea-f1049afd6138 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:16.644754 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:16.675864 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a718c8-bcd2-4f81-943b-734b7916a144 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:16.686991 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:16.725299 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf08241d-9ff0-4d59-96ea-f1049afd6138 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:16.729793 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f7eb7e-1d7b-450b-a3b7-ac59d13a1499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:16.732657 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f7eb7e-1d7b-450b-a3b7-ac59d13a1499 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:16.733296 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f7eb7e-1d7b-450b-a3b7-ac59d13a1499 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:16.733872 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f7eb7e-1d7b-450b-a3b7-ac59d13a1499 None admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:16.735264 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f7eb7e-1d7b-450b-a3b7-ac59d13a1499 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:16.735857 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f7eb7e-1d7b-450b-a3b7-ac59d13a1499 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:16.739304 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f7eb7e-1d7b-450b-a3b7-ac59d13a1499 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:16.759750 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 63/122] 10.222.0.81 () {56 vars in 1101 bytes} [Mon Jul 18 16:27:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:16.759750 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f7eb7e-1d7b-450b-a3b7-ac59d13a1499 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:16.779127 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d934a8e1-81a9-41e8-b74c-bed9ab91bd8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:16.780365 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934a8e1-81a9-41e8-b74c-bed9ab91bd8f None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:16.780869 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934a8e1-81a9-41e8-b74c-bed9ab91bd8f None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:16.781449 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934a8e1-81a9-41e8-b74c-bed9ab91bd8f None admin] PATH_INFO: `/v3/users/c43109bed5da4b9d873232adae450346` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:16.783592 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d934a8e1-81a9-41e8-b74c-bed9ab91bd8f None admin] RBAC: Authorizing `identity:get_user(user_id=c43109bed5da4b9d873232adae450346)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:16.785314 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d934a8e1-81a9-41e8-b74c-bed9ab91bd8f None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:16.792028 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 60/123] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Jul 18 16:27:16 2022] GET /identity/v3/users/c43109bed5da4b9d873232adae450346 => generated 275 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:16.793292 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d934a8e1-81a9-41e8-b74c-bed9ab91bd8f None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:16.881014 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f7eb7e-1d7b-450b-a3b7-ac59d13a1499 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:16.918453 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f7afbc-b1e5-4f23-83f3-cddcbddcd4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:16.919741 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7afbc-b1e5-4f23-83f3-cddcbddcd4ca None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:16.920230 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7afbc-b1e5-4f23-83f3-cddcbddcd4ca None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:16.920734 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7afbc-b1e5-4f23-83f3-cddcbddcd4ca None admin] PATH_INFO: `/v3/roles/member` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:16.929893 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d934a8e1-81a9-41e8-b74c-bed9ab91bd8f None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:16.937006 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f7afbc-b1e5-4f23-83f3-cddcbddcd4ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:27:16.944786 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:16.950161 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-93f7afbc-b1e5-4f23-83f3-cddcbddcd4ca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 16:27:16.950161 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:27:16.950161 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:27:16.950161 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:27:16.950161 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:27:16.950161 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:27:16.950161 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:27:16.950161 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:27:16.950161 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:27:16.950161 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:27:16.950161 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:27:16.950161 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:27:16.950161 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:27:16.950161 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:27:16.950161 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:27:16.950161 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:27:16.951065 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:27:16.951065 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:27:16.951065 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:27:16.951065 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:27:16.951065 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:27:16.951065 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:27:16.951065 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:27:16.951065 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:27:16.951065 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:27:16.951065 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:27:16.951065 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:27:16.951065 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:27:16.951065 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:27:16.951065 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:27:16.951065 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:27:16.951065 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:27:16.951885 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:27:16.951885 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:27:16.951885 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:27:16.951885 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:27:16.951885 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:27:16.951885 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:27:16.951885 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:27:16.951885 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:27:16.951885 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:27:16.951885 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:27:16.951885 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 16:27:16.951885 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:27:16.955171 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 64/124] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Jul 18 16:27:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:27:16.956473 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f7afbc-b1e5-4f23-83f3-cddcbddcd4ca None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:16.968590 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5926981-2267-410a-a148-d7961a0b872c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:16.970388 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5926981-2267-410a-a148-d7961a0b872c None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:16.970583 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5926981-2267-410a-a148-d7961a0b872c None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:16.971011 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5926981-2267-410a-a148-d7961a0b872c None admin] PATH_INFO: `/v3/users/c43109bed5da4b9d873232adae450346` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:16.972504 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5926981-2267-410a-a148-d7961a0b872c None admin] RBAC: Authorizing `identity:get_user(user_id=c43109bed5da4b9d873232adae450346)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:16.974615 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5926981-2267-410a-a148-d7961a0b872c None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:16.976395 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 61/125] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Jul 18 16:27:16 2022] GET /identity/v3/users/c43109bed5da4b9d873232adae450346 => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:16.977260 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5926981-2267-410a-a148-d7961a0b872c None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:16.997982 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:17.087881 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f7afbc-b1e5-4f23-83f3-cddcbddcd4ca None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:17.106132 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5926981-2267-410a-a148-d7961a0b872c None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:17.138258 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2282ad08-e7b8-432b-ad9c-352a7ee4461c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:17.139414 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282ad08-e7b8-432b-ad9c-352a7ee4461c None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:17.139821 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282ad08-e7b8-432b-ad9c-352a7ee4461c None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:17.140190 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282ad08-e7b8-432b-ad9c-352a7ee4461c None admin] PATH_INFO: `/v3/users/0ae8900034164ba19f88e94f1401cb7a` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:17.151415 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93fa18c-7f1f-43d3-ae49-a1a83d0b0d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:17.152363 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93fa18c-7f1f-43d3-ae49-a1a83d0b0d5b None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:17.152852 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93fa18c-7f1f-43d3-ae49-a1a83d0b0d5b None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:17.153136 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93fa18c-7f1f-43d3-ae49-a1a83d0b0d5b None admin] PATH_INFO: `/v3/projects/edc913ab51354b1da43bd3c47b3b2c51` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:17.154603 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93fa18c-7f1f-43d3-ae49-a1a83d0b0d5b None admin] RBAC: Authorizing `identity:get_project(project_id=edc913ab51354b1da43bd3c47b3b2c51)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:17.156132 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2282ad08-e7b8-432b-ad9c-352a7ee4461c None admin] RBAC: Authorizing `identity:get_user(user_id=0ae8900034164ba19f88e94f1401cb7a)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:17.156342 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93fa18c-7f1f-43d3-ae49-a1a83d0b0d5b None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:17.157800 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2282ad08-e7b8-432b-ad9c-352a7ee4461c None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:17.158297 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 62/126] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Jul 18 16:27:16 2022] GET /identity/v3/projects/edc913ab51354b1da43bd3c47b3b2c51 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:17.158997 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93fa18c-7f1f-43d3-ae49-a1a83d0b0d5b None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:17.165157 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 65/127] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Jul 18 16:27:16 2022] GET /identity/v3/users/0ae8900034164ba19f88e94f1401cb7a => generated 289 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:17.166141 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2282ad08-e7b8-432b-ad9c-352a7ee4461c None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:17.217989 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:17.270700 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:17.275632 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93fa18c-7f1f-43d3-ae49-a1a83d0b0d5b None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:17.284894 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2282ad08-e7b8-432b-ad9c-352a7ee4461c None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:17.313559 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae955ce-81e0-4ab3-8878-733c16c9181e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:17.314518 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae955ce-81e0-4ab3-8878-733c16c9181e None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:17.314947 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae955ce-81e0-4ab3-8878-733c16c9181e None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:17.315367 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae955ce-81e0-4ab3-8878-733c16c9181e None admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:17.316411 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae955ce-81e0-4ab3-8878-733c16c9181e None admin] RBAC: Adding query filter params (name=member) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:17.316912 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae955ce-81e0-4ab3-8878-733c16c9181e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:17.318456 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae955ce-81e0-4ab3-8878-733c16c9181e None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:17.325149 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0695997-da94-4ce6-9fac-fecd169951d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:17.326222 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0695997-da94-4ce6-9fac-fecd169951d9 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:17.326599 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0695997-da94-4ce6-9fac-fecd169951d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:17.326970 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0695997-da94-4ce6-9fac-fecd169951d9 None admin] PATH_INFO: `/v3/projects/edc913ab51354b1da43bd3c47b3b2c51` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:17.328405 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 63/128] 10.222.0.81 () {56 vars in 1101 bytes} [Mon Jul 18 16:27:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:17.328664 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0695997-da94-4ce6-9fac-fecd169951d9 None admin] RBAC: Authorizing `identity:get_project(project_id=edc913ab51354b1da43bd3c47b3b2c51)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:17.329651 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae955ce-81e0-4ab3-8878-733c16c9181e None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:17.330423 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0695997-da94-4ce6-9fac-fecd169951d9 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:17.332321 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 66/129] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Jul 18 16:27:17 2022] GET /identity/v3/projects/edc913ab51354b1da43bd3c47b3b2c51 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:17.337866 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0695997-da94-4ce6-9fac-fecd169951d9 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:17.441329 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae955ce-81e0-4ab3-8878-733c16c9181e None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:17.453808 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0695997-da94-4ce6-9fac-fecd169951d9 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:17.454994 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:17.482408 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f815680d-f661-44b2-be77-ad3702484b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:17.483610 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815680d-f661-44b2-be77-ad3702484b82 None admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:17.483860 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815680d-f661-44b2-be77-ad3702484b82 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:17.484141 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815680d-f661-44b2-be77-ad3702484b82 None admin] PATH_INFO: `/v3/projects/edc913ab51354b1da43bd3c47b3b2c51/users/c43109bed5da4b9d873232adae450346/roles/ad3a2bc7b2094a4da1a95a143c8d9436` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:17.486341 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f815680d-f661-44b2-be77-ad3702484b82 None admin] RBAC: Authorizing `identity:create_grant(project_id=edc913ab51354b1da43bd3c47b3b2c51, user_id=c43109bed5da4b9d873232adae450346, role_id=ad3a2bc7b2094a4da1a95a143c8d9436)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:17.487984 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f815680d-f661-44b2-be77-ad3702484b82 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:17.502383 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad49426-512a-4a29-855d-15cca17a1e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:17.503473 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad49426-512a-4a29-855d-15cca17a1e5b None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:17.504002 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad49426-512a-4a29-855d-15cca17a1e5b None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:17.504529 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad49426-512a-4a29-855d-15cca17a1e5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:17.533716 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:17.577699 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad49426-512a-4a29-855d-15cca17a1e5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:17.579743 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad49426-512a-4a29-855d-15cca17a1e5b None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:17.598651 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 64/130] 10.222.0.81 () {58 vars in 1439 bytes} [Mon Jul 18 16:27:17 2022] PUT /identity/v3/projects/edc913ab51354b1da43bd3c47b3b2c51/users/c43109bed5da4b9d873232adae450346/roles/ad3a2bc7b2094a4da1a95a143c8d9436 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:27:17.599928 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f815680d-f661-44b2-be77-ad3702484b82 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:17.755106 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 67/131] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Jul 18 16:27:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:27:17.755987 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad49426-512a-4a29-855d-15cca17a1e5b None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:17.795070 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f815680d-f661-44b2-be77-ad3702484b82 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:17.833359 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:17.856618 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a7cc70-3d04-4895-9117-bf3b165abfdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:17.857507 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a7cc70-3d04-4895-9117-bf3b165abfdf None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:17.857790 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a7cc70-3d04-4895-9117-bf3b165abfdf None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:17.858059 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a7cc70-3d04-4895-9117-bf3b165abfdf None admin] PATH_INFO: `/v3/users/c43109bed5da4b9d873232adae450346` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:17.859296 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a7cc70-3d04-4895-9117-bf3b165abfdf None admin] RBAC: Authorizing `identity:get_user(user_id=c43109bed5da4b9d873232adae450346)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:17.861588 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a7cc70-3d04-4895-9117-bf3b165abfdf None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:17.863377 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 65/132] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Jul 18 16:27:17 2022] GET /identity/v3/users/c43109bed5da4b9d873232adae450346 => generated 275 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:17.864662 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc57361-5a74-4b42-ba00-51150e1e1958 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:17.864949 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc57361-5a74-4b42-ba00-51150e1e1958 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:17.865223 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc57361-5a74-4b42-ba00-51150e1e1958 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:17.866630 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 66/133] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:27:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:27:17.867235 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc57361-5a74-4b42-ba00-51150e1e1958 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:17.890499 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad49426-512a-4a29-855d-15cca17a1e5b None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:17.917823 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:17.940205 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216cb853-8a86-4eda-9c83-24ce5681b296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:17.941692 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216cb853-8a86-4eda-9c83-24ce5681b296 None admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:17.942207 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216cb853-8a86-4eda-9c83-24ce5681b296 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:17.942777 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216cb853-8a86-4eda-9c83-24ce5681b296 None admin] PATH_INFO: `/v3/projects/edc913ab51354b1da43bd3c47b3b2c51/users/c43109bed5da4b9d873232adae450346/roles/6bfa001ddac347da894c7231f853c3df` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:17.946021 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216cb853-8a86-4eda-9c83-24ce5681b296 None admin] RBAC: Authorizing `identity:create_grant(project_id=edc913ab51354b1da43bd3c47b3b2c51, user_id=c43109bed5da4b9d873232adae450346, role_id=6bfa001ddac347da894c7231f853c3df)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:17.948437 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216cb853-8a86-4eda-9c83-24ce5681b296 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:17.989162 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc57361-5a74-4b42-ba00-51150e1e1958 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:18.029932 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ced644-7128-4a41-a2d0-e27abe7ec88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:18.031192 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ced644-7128-4a41-a2d0-e27abe7ec88a None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:18.032114 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ced644-7128-4a41-a2d0-e27abe7ec88a None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:18.032591 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ced644-7128-4a41-a2d0-e27abe7ec88a None admin] PATH_INFO: `/v3/projects/edc913ab51354b1da43bd3c47b3b2c51` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:18.034635 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ced644-7128-4a41-a2d0-e27abe7ec88a None admin] RBAC: Authorizing `identity:get_project(project_id=edc913ab51354b1da43bd3c47b3b2c51)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:18.037273 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ced644-7128-4a41-a2d0-e27abe7ec88a None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:18.046138 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 67/134] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Jul 18 16:27:17 2022] GET /identity/v3/projects/edc913ab51354b1da43bd3c47b3b2c51 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:18.046138 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ced644-7128-4a41-a2d0-e27abe7ec88a None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:18.049195 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 68/135] 10.222.0.81 () {58 vars in 1439 bytes} [Mon Jul 18 16:27:17 2022] PUT /identity/v3/projects/edc913ab51354b1da43bd3c47b3b2c51/users/c43109bed5da4b9d873232adae450346/roles/6bfa001ddac347da894c7231f853c3df => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:27:18.052891 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f522e2e-bad0-4871-a89f-332ebea4f611 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:18.053445 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f522e2e-bad0-4871-a89f-332ebea4f611 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:18.053944 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f522e2e-bad0-4871-a89f-332ebea4f611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:18.076617 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-0f522e2e-bad0-4871-a89f-332ebea4f611 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:27:18.078875 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-0f522e2e-bad0-4871-a89f-332ebea4f611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:27:18.178196 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 69/136] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:27:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:27:18.178963 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f522e2e-bad0-4871-a89f-332ebea4f611 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:18.190417 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ced644-7128-4a41-a2d0-e27abe7ec88a None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:18.204733 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:18.262855 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c4fad0-52fc-44e4-bc14-f99b342022bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:18.263755 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4fad0-52fc-44e4-bc14-f99b342022bb None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:18.264062 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4fad0-52fc-44e4-bc14-f99b342022bb None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:18.264341 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4fad0-52fc-44e4-bc14-f99b342022bb None admin] PATH_INFO: `/v3/projects/4e9d997e3210479cb2de18f16738b320` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:18.267686 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c4fad0-52fc-44e4-bc14-f99b342022bb None admin] RBAC: Authorizing `identity:get_project(project_id=4e9d997e3210479cb2de18f16738b320)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:18.267686 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c4fad0-52fc-44e4-bc14-f99b342022bb None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:18.269127 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 68/137] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Jul 18 16:27:18 2022] GET /identity/v3/projects/4e9d997e3210479cb2de18f16738b320 => generated 312 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:18.269556 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:18.270410 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2620980e-1d3f-4ce0-84a7-553974dc6ba9 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:18.270541 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2620980e-1d3f-4ce0-84a7-553974dc6ba9 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:18.271803 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2620980e-1d3f-4ce0-84a7-553974dc6ba9 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:18.273231 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 69/138] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:27:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:27:18.273231 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2620980e-1d3f-4ce0-84a7-553974dc6ba9 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:18.339081 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f522e2e-bad0-4871-a89f-332ebea4f611 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:18.382776 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4965c18d-17ea-4166-a57b-c99903e872ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:18.384352 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965c18d-17ea-4166-a57b-c99903e872ce None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:18.384838 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965c18d-17ea-4166-a57b-c99903e872ce None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:18.385508 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965c18d-17ea-4166-a57b-c99903e872ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:18.387237 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4965c18d-17ea-4166-a57b-c99903e872ce None admin] RBAC: Adding query filter params (role.id=2d721f61e3334102a57d236346c17850, scope.project.id=edc913ab51354b1da43bd3c47b3b2c51, user.id=0ae8900034164ba19f88e94f1401cb7a) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:18.387823 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4965c18d-17ea-4166-a57b-c99903e872ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:18.391127 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4965c18d-17ea-4166-a57b-c99903e872ce None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:18.397790 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2620980e-1d3f-4ce0-84a7-553974dc6ba9 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:18.399562 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 70/139] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Jul 18 16:27:18 2022] GET /identity/v3/role_assignments?user.id=0ae8900034164ba19f88e94f1401cb7a&scope.project.id=edc913ab51354b1da43bd3c47b3b2c51&role.id=2d721f61e3334102a57d236346c17850 => generated 259 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:18.402027 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d9f49-2059-446e-8bbe-e0e6dfe4d54d None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:18.402618 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d9f49-2059-446e-8bbe-e0e6dfe4d54d None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:18.403137 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d9f49-2059-446e-8bbe-e0e6dfe4d54d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:18.427812 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-1f4d9f49-2059-446e-8bbe-e0e6dfe4d54d None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:27:18.429911 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-1f4d9f49-2059-446e-8bbe-e0e6dfe4d54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:27:18.451451 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c5ba77-b2fc-4542-bb23-9f900e200fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:18.453790 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c5ba77-b2fc-4542-bb23-9f900e200fc3 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:18.454481 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c5ba77-b2fc-4542-bb23-9f900e200fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:18.456663 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c5ba77-b2fc-4542-bb23-9f900e200fc3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:18.477189 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c5ba77-b2fc-4542-bb23-9f900e200fc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:27:18.485968 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-45c5ba77-b2fc-4542-bb23-9f900e200fc3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:27:18.485968 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:27:18.485968 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:27:18.485968 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:27:18.485968 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:27:18.485968 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:27:18.485968 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:27:18.485968 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:27:18.485968 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:27:18.485968 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:27:18.485968 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:27:18.485968 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:27:18.485968 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:27:18.485968 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:27:18.485968 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:27:18.485968 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:27:18.486923 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:27:18.486923 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:27:18.486923 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:27:18.486923 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:27:18.486923 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:27:18.486923 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:27:18.486923 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:27:18.486923 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:27:18.486923 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:27:18.486923 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:27:18.486923 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:27:18.486923 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:27:18.486923 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:27:18.486923 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:27:18.486923 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:27:18.486923 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:27:18.487833 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:27:18.487833 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:27:18.487833 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:27:18.487833 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:27:18.487833 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:27:18.487833 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:27:18.487833 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:27:18.487833 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:27:18.487833 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:27:18.487833 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:27:18.487833 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:27:18.487833 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:27:18.495272 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 70/140] 10.222.0.81 () {56 vars in 1096 bytes} [Mon Jul 18 16:27:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:27:18.496255 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c5ba77-b2fc-4542-bb23-9f900e200fc3 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:18.542699 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 71/141] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:27:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:27:18.548703 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4d9f49-2059-446e-8bbe-e0e6dfe4d54d None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:18.606685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:18.622336 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:18.681114 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4d9f49-2059-446e-8bbe-e0e6dfe4d54d None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:18.743033 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c5ba77-b2fc-4542-bb23-9f900e200fc3 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:18.786259 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d266f-7728-4cdc-9dcf-119919aeef70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:18.787182 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d266f-7728-4cdc-9dcf-119919aeef70 None admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:18.787497 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d266f-7728-4cdc-9dcf-119919aeef70 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:18.788327 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d266f-7728-4cdc-9dcf-119919aeef70 None admin] PATH_INFO: `/v3/projects/4e9d997e3210479cb2de18f16738b320/users/c43109bed5da4b9d873232adae450346/roles/ad3a2bc7b2094a4da1a95a143c8d9436` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:18.790614 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6d266f-7728-4cdc-9dcf-119919aeef70 None admin] RBAC: Authorizing `identity:create_grant(project_id=4e9d997e3210479cb2de18f16738b320, user_id=c43109bed5da4b9d873232adae450346, role_id=ad3a2bc7b2094a4da1a95a143c8d9436)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:18.792290 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6d266f-7728-4cdc-9dcf-119919aeef70 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:18.801175 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52133aea-cfe2-4285-b30b-2987eb31f49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:18.801814 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52133aea-cfe2-4285-b30b-2987eb31f49f None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:18.802100 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52133aea-cfe2-4285-b30b-2987eb31f49f None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:18.802377 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52133aea-cfe2-4285-b30b-2987eb31f49f None admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:18.803138 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52133aea-cfe2-4285-b30b-2987eb31f49f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:18.803449 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52133aea-cfe2-4285-b30b-2987eb31f49f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:18.808008 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52133aea-cfe2-4285-b30b-2987eb31f49f None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:18.816434 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 72/142] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Jul 18 16:27:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:18.817566 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52133aea-cfe2-4285-b30b-2987eb31f49f None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:18.926783 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 71/143] 10.222.0.81 () {58 vars in 1439 bytes} [Mon Jul 18 16:27:18 2022] PUT /identity/v3/projects/4e9d997e3210479cb2de18f16738b320/users/c43109bed5da4b9d873232adae450346/roles/ad3a2bc7b2094a4da1a95a143c8d9436 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:27:18.927821 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d266f-7728-4cdc-9dcf-119919aeef70 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:18.929291 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52133aea-cfe2-4285-b30b-2987eb31f49f None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:18.931386 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:18.975265 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8655d4e8-5f4e-4517-94ee-0eb9f2e09d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:18.976381 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655d4e8-5f4e-4517-94ee-0eb9f2e09d6f None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:18.977458 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655d4e8-5f4e-4517-94ee-0eb9f2e09d6f None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:18.978036 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655d4e8-5f4e-4517-94ee-0eb9f2e09d6f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:18.984138 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8655d4e8-5f4e-4517-94ee-0eb9f2e09d6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:18.985894 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8655d4e8-5f4e-4517-94ee-0eb9f2e09d6f None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:18.989536 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 73/144] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:27:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:18.997001 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8655d4e8-5f4e-4517-94ee-0eb9f2e09d6f None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:19.144273 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:19.158068 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d266f-7728-4cdc-9dcf-119919aeef70 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:19.175588 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8655d4e8-5f4e-4517-94ee-0eb9f2e09d6f None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:19.220653 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c55f47-daa3-495d-8e42-d4d8c645d353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:19.221495 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c55f47-daa3-495d-8e42-d4d8c645d353 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:19.221785 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c55f47-daa3-495d-8e42-d4d8c645d353 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:19.222065 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c55f47-daa3-495d-8e42-d4d8c645d353 None admin] PATH_INFO: `/v3/users/3dccf69cde3442c68200f8a9b9ed4ebb` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:19.223423 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c55f47-daa3-495d-8e42-d4d8c645d353 None admin] RBAC: Authorizing `identity:get_user(user_id=3dccf69cde3442c68200f8a9b9ed4ebb)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:19.224934 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c55f47-daa3-495d-8e42-d4d8c645d353 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:19.225957 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbac560-0e6e-4c7c-ac76-24e040a83c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:19.226756 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 72/145] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Jul 18 16:27:18 2022] GET /identity/v3/users/3dccf69cde3442c68200f8a9b9ed4ebb => generated 247 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:19.227411 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbac560-0e6e-4c7c-ac76-24e040a83c96 None admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:19.227958 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbac560-0e6e-4c7c-ac76-24e040a83c96 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:19.228442 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbac560-0e6e-4c7c-ac76-24e040a83c96 None admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:19.229362 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbac560-0e6e-4c7c-ac76-24e040a83c96 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:19.231004 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbac560-0e6e-4c7c-ac76-24e040a83c96 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:19.232436 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c55f47-daa3-495d-8e42-d4d8c645d353 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:19.349019 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c55f47-daa3-495d-8e42-d4d8c645d353 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:19.390457 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9812f7cb-3cd1-4f1d-b1bb-370147a35c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:19.391157 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812f7cb-3cd1-4f1d-b1bb-370147a35c13 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:19.391436 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812f7cb-3cd1-4f1d-b1bb-370147a35c13 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:19.392283 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 74/146] 10.222.0.81 () {60 vars in 1132 bytes} [Mon Jul 18 16:27:18 2022] POST /identity/v3/users => generated 283 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:27:19.392539 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812f7cb-3cd1-4f1d-b1bb-370147a35c13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:19.427751 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:19.489042 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9812f7cb-3cd1-4f1d-b1bb-370147a35c13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:19.490512 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9812f7cb-3cd1-4f1d-b1bb-370147a35c13 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:19.620888 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 73/147] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Jul 18 16:27:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:27:19.627795 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbac560-0e6e-4c7c-ac76-24e040a83c96 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:19.660117 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:19.748576 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbac560-0e6e-4c7c-ac76-24e040a83c96 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:19.794524 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a24c6ea-b3ea-44bb-bacb-3c886b2b2351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:19.795321 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24c6ea-b3ea-44bb-bacb-3c886b2b2351 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:19.795835 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24c6ea-b3ea-44bb-bacb-3c886b2b2351 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:19.796311 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24c6ea-b3ea-44bb-bacb-3c886b2b2351 None admin] PATH_INFO: `/v3/projects/edc913ab51354b1da43bd3c47b3b2c51` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:19.804751 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a24c6ea-b3ea-44bb-bacb-3c886b2b2351 None admin] RBAC: Authorizing `identity:get_project(project_id=edc913ab51354b1da43bd3c47b3b2c51)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:19.806951 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a24c6ea-b3ea-44bb-bacb-3c886b2b2351 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:19.809957 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 75/148] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Jul 18 16:27:19 2022] GET /identity/v3/projects/edc913ab51354b1da43bd3c47b3b2c51 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:19.816478 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9812f7cb-3cd1-4f1d-b1bb-370147a35c13 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:19.919499 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:19.962499 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9812f7cb-3cd1-4f1d-b1bb-370147a35c13 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:20.013583 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe2d84c-56eb-41ef-8092-49fdb6883385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:20.014607 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2d84c-56eb-41ef-8092-49fdb6883385 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:20.015082 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2d84c-56eb-41ef-8092-49fdb6883385 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:20.015534 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2d84c-56eb-41ef-8092-49fdb6883385 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:20.017460 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe2d84c-56eb-41ef-8092-49fdb6883385 None admin] RBAC: Adding query filter params (role.id=fd83eab44cb343a2b532ce32a2ac31d8, scope.project.id=edc913ab51354b1da43bd3c47b3b2c51, user.id=3dccf69cde3442c68200f8a9b9ed4ebb) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:20.017979 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe2d84c-56eb-41ef-8092-49fdb6883385 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:20.020649 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe2d84c-56eb-41ef-8092-49fdb6883385 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:20.033118 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 74/149] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Jul 18 16:27:19 2022] GET /identity/v3/role_assignments?user.id=3dccf69cde3442c68200f8a9b9ed4ebb&scope.project.id=edc913ab51354b1da43bd3c47b3b2c51&role.id=fd83eab44cb343a2b532ce32a2ac31d8 => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:20.664702 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e9709-7c09-48cc-b7f8-0e64961746e0 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:20.665719 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e9709-7c09-48cc-b7f8-0e64961746e0 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:20.666207 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e9709-7c09-48cc-b7f8-0e64961746e0 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:20.667864 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 76/150] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:27:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:27:20.674525 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226736f-a234-4f1f-8848-d75262db3d85 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:20.674999 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226736f-a234-4f1f-8848-d75262db3d85 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:20.675451 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226736f-a234-4f1f-8848-d75262db3d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:20.711221 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-c226736f-a234-4f1f-8848-d75262db3d85 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:27:20.713195 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-c226736f-a234-4f1f-8848-d75262db3d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:27:20.724338 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b103ccb-06a9-4a1c-b644-07c2d789da6e None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:20.724917 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b103ccb-06a9-4a1c-b644-07c2d789da6e None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:20.725409 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b103ccb-06a9-4a1c-b644-07c2d789da6e None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:20.727209 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 77/151] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:27:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:27:20.732784 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb98d0-e5f6-4687-926d-069968c86c71 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:20.733374 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb98d0-e5f6-4687-926d-069968c86c71 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:20.733850 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb98d0-e5f6-4687-926d-069968c86c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:20.753039 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-e7fb98d0-e5f6-4687-926d-069968c86c71 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:27:20.754783 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-e7fb98d0-e5f6-4687-926d-069968c86c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:27:20.840225 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 78/152] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:27:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:27:20.869645 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb98d0-e5f6-4687-926d-069968c86c71 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:20.872863 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 75/153] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:27:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:27:20.905842 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:20.906403 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226736f-a234-4f1f-8848-d75262db3d85 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:21.002537 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb98d0-e5f6-4687-926d-069968c86c71 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:21.013131 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:21.042755 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06724a1-0146-4936-9af6-508e9782f11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:21.043551 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06724a1-0146-4936-9af6-508e9782f11c None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:21.043875 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06724a1-0146-4936-9af6-508e9782f11c None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:21.044144 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06724a1-0146-4936-9af6-508e9782f11c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:21.056832 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06724a1-0146-4936-9af6-508e9782f11c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:27:21.066734 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-e06724a1-0146-4936-9af6-508e9782f11c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 16:27:21.066734 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:27:21.066734 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:27:21.066734 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:27:21.066734 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:27:21.066734 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:27:21.066734 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:27:21.066734 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:27:21.066734 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:27:21.066734 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:27:21.066734 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:27:21.066734 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:27:21.066734 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:27:21.066734 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:27:21.066734 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:27:21.066734 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:27:21.068385 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:27:21.068385 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:27:21.068385 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:27:21.068385 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:27:21.068385 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:27:21.068385 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:27:21.068385 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:27:21.068385 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:27:21.068385 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:27:21.068385 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:27:21.068385 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:27:21.068385 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:27:21.068385 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:27:21.068385 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:27:21.068385 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:27:21.068385 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:27:21.069678 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:27:21.069678 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:27:21.069678 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:27:21.069678 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:27:21.069678 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:27:21.069678 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:27:21.069678 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:27:21.069678 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:27:21.069678 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:27:21.069678 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:27:21.069678 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 16:27:21.069678 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:27:21.069678 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 79/154] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Jul 18 16:27:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:27:21.069678 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9bd11-2d8a-4d9f-a767-03ce139dbf91 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:21.071143 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9bd11-2d8a-4d9f-a767-03ce139dbf91 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:21.071143 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9bd11-2d8a-4d9f-a767-03ce139dbf91 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:21.072241 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 80/155] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:27:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:27:21.077313 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28431bb-973c-49b0-a8d0-415eafd6cd37 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:21.077643 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28431bb-973c-49b0-a8d0-415eafd6cd37 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:21.077910 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28431bb-973c-49b0-a8d0-415eafd6cd37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:21.106384 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226736f-a234-4f1f-8848-d75262db3d85 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:21.109327 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-d28431bb-973c-49b0-a8d0-415eafd6cd37 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:27:21.112397 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-d28431bb-973c-49b0-a8d0-415eafd6cd37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:27:21.145600 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc040407-755e-4606-8cec-60690e5c3248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:21.146724 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc040407-755e-4606-8cec-60690e5c3248 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:21.146724 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc040407-755e-4606-8cec-60690e5c3248 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:21.146993 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc040407-755e-4606-8cec-60690e5c3248 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:21.158731 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc040407-755e-4606-8cec-60690e5c3248 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:27:21.167829 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-cc040407-755e-4606-8cec-60690e5c3248 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 16:27:21.167829 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:27:21.167829 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:27:21.167829 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:27:21.167829 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:27:21.167829 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:27:21.167829 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:27:21.167829 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:27:21.167829 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:27:21.167829 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:27:21.167829 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:27:21.167829 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:27:21.167829 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:27:21.167829 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:27:21.167829 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:27:21.167829 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:27:21.169499 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:27:21.169499 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:27:21.169499 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:27:21.169499 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:27:21.169499 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:27:21.169499 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:27:21.169499 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:27:21.169499 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:27:21.169499 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:27:21.169499 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:27:21.169499 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:27:21.169499 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:27:21.169499 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:27:21.169499 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:27:21.169499 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:27:21.169499 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:27:21.170943 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:27:21.170943 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:27:21.170943 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:27:21.170943 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:27:21.170943 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:27:21.170943 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:27:21.170943 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:27:21.170943 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:27:21.170943 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:27:21.170943 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:27:21.170943 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 16:27:21.170943 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:27:21.170943 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 76/156] 10.222.0.81 () {56 vars in 1114 bytes} [Mon Jul 18 16:27:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:27:21.170943 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc040407-755e-4606-8cec-60690e5c3248 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:21.285924 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 81/157] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:27:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:27:21.288051 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28431bb-973c-49b0-a8d0-415eafd6cd37 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:21.291423 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc040407-755e-4606-8cec-60690e5c3248 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:21.310042 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:21.320147 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:21.328439 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d808d-24de-4ec2-b74d-365fe63780e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:21.329120 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d808d-24de-4ec2-b74d-365fe63780e3 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:21.329397 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d808d-24de-4ec2-b74d-365fe63780e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:21.329665 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d808d-24de-4ec2-b74d-365fe63780e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:21.330415 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8d808d-24de-4ec2-b74d-365fe63780e3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:21.330717 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8d808d-24de-4ec2-b74d-365fe63780e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:21.332119 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8d808d-24de-4ec2-b74d-365fe63780e3 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:21.341717 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 77/158] 10.222.0.81 () {56 vars in 1101 bytes} [Mon Jul 18 16:27:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:21.342629 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d808d-24de-4ec2-b74d-365fe63780e3 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:21.452463 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d808d-24de-4ec2-b74d-365fe63780e3 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:21.532395 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28431bb-973c-49b0-a8d0-415eafd6cd37 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:21.553964 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f768f3de-e6dd-4435-9c69-a2ad65fe148f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:21.555609 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768f3de-e6dd-4435-9c69-a2ad65fe148f None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:21.556397 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768f3de-e6dd-4435-9c69-a2ad65fe148f None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:21.557110 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768f3de-e6dd-4435-9c69-a2ad65fe148f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:21.591299 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f768f3de-e6dd-4435-9c69-a2ad65fe148f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:27:21.604006 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-f768f3de-e6dd-4435-9c69-a2ad65fe148f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 16:27:21.604006 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:27:21.604006 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:27:21.604006 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:27:21.604006 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:27:21.604006 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:27:21.604006 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:27:21.604006 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:27:21.604006 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:27:21.604006 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:27:21.604006 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:27:21.604006 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:27:21.604006 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:27:21.604006 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:27:21.604006 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:27:21.604006 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:27:21.605681 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:27:21.605681 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:27:21.605681 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:27:21.605681 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:27:21.605681 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:27:21.605681 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:27:21.605681 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:27:21.605681 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:27:21.605681 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:27:21.605681 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:27:21.605681 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:27:21.605681 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:27:21.605681 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:27:21.605681 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:27:21.605681 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:27:21.605681 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:27:21.607216 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:27:21.607216 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:27:21.607216 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:27:21.607216 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:27:21.607216 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:27:21.607216 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:27:21.607216 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:27:21.607216 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:27:21.607216 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:27:21.607216 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:27:21.607216 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 16:27:21.607216 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:27:21.607216 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 78/159] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Jul 18 16:27:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:27:21.607216 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f768f3de-e6dd-4435-9c69-a2ad65fe148f None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:21.626218 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa61505-f60b-4a4f-9098-985f88ec17a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:21.628060 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa61505-f60b-4a4f-9098-985f88ec17a5 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:21.628815 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa61505-f60b-4a4f-9098-985f88ec17a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:21.629582 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa61505-f60b-4a4f-9098-985f88ec17a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:21.631212 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa61505-f60b-4a4f-9098-985f88ec17a5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:21.632069 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa61505-f60b-4a4f-9098-985f88ec17a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:21.635137 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa61505-f60b-4a4f-9098-985f88ec17a5 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:21.651738 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 82/160] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Jul 18 16:27:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:21.653592 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa61505-f60b-4a4f-9098-985f88ec17a5 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:21.670432 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:21.764701 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f768f3de-e6dd-4435-9c69-a2ad65fe148f None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:21.771280 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:21.798484 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa61505-f60b-4a4f-9098-985f88ec17a5 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:21.821577 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec4079b-156e-46dc-95a9-6ea5003d6447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:21.822397 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4079b-156e-46dc-95a9-6ea5003d6447 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:21.822674 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4079b-156e-46dc-95a9-6ea5003d6447 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:21.822946 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4079b-156e-46dc-95a9-6ea5003d6447 None admin] PATH_INFO: `/v3/users/c43109bed5da4b9d873232adae450346` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:21.824558 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec4079b-156e-46dc-95a9-6ea5003d6447 None admin] RBAC: Authorizing `identity:get_user(user_id=c43109bed5da4b9d873232adae450346)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:21.825715 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec4079b-156e-46dc-95a9-6ea5003d6447 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:21.827417 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 79/161] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Jul 18 16:27:21 2022] GET /identity/v3/users/c43109bed5da4b9d873232adae450346 => generated 275 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:21.828268 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec4079b-156e-46dc-95a9-6ea5003d6447 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:21.840795 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad38863c-5d11-43ab-87f7-cf05a5179359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:21.841919 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38863c-5d11-43ab-87f7-cf05a5179359 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:21.842470 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38863c-5d11-43ab-87f7-cf05a5179359 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:21.842952 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38863c-5d11-43ab-87f7-cf05a5179359 None admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:21.844028 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad38863c-5d11-43ab-87f7-cf05a5179359 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:21.844707 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad38863c-5d11-43ab-87f7-cf05a5179359 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:21.846392 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad38863c-5d11-43ab-87f7-cf05a5179359 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:21.857977 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 83/162] 10.222.0.81 () {56 vars in 1101 bytes} [Mon Jul 18 16:27:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:21.859199 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad38863c-5d11-43ab-87f7-cf05a5179359 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:21.973043 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad38863c-5d11-43ab-87f7-cf05a5179359 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:21.982368 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec4079b-156e-46dc-95a9-6ea5003d6447 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:21.990815 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:22.013276 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f8feab-d349-4296-ba17-9c2a0a060c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:22.014386 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8feab-d349-4296-ba17-9c2a0a060c78 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:22.014875 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8feab-d349-4296-ba17-9c2a0a060c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:22.015375 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8feab-d349-4296-ba17-9c2a0a060c78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:22.020738 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d97e0d-033b-4ea0-9616-f24249f1b67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:22.021773 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d97e0d-033b-4ea0-9616-f24249f1b67e None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:22.022149 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d97e0d-033b-4ea0-9616-f24249f1b67e None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:22.022522 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d97e0d-033b-4ea0-9616-f24249f1b67e None admin] PATH_INFO: `/v3/users/c43109bed5da4b9d873232adae450346` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:22.023845 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d97e0d-033b-4ea0-9616-f24249f1b67e None admin] RBAC: Authorizing `identity:get_user(user_id=c43109bed5da4b9d873232adae450346)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:22.025387 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d97e0d-033b-4ea0-9616-f24249f1b67e None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:22.027326 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:22.028108 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 80/163] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Jul 18 16:27:21 2022] GET /identity/v3/users/c43109bed5da4b9d873232adae450346 => generated 275 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:22.028983 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d97e0d-033b-4ea0-9616-f24249f1b67e None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:22.100317 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f8feab-d349-4296-ba17-9c2a0a060c78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:22.102142 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f8feab-d349-4296-ba17-9c2a0a060c78 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:22.142140 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d97e0d-033b-4ea0-9616-f24249f1b67e None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:22.181280 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a099f54-3cfa-4567-8d5b-d53a0a14ba9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:22.182407 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a099f54-3cfa-4567-8d5b-d53a0a14ba9b None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:22.182933 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a099f54-3cfa-4567-8d5b-d53a0a14ba9b None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:22.183317 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a099f54-3cfa-4567-8d5b-d53a0a14ba9b None admin] PATH_INFO: `/v3/users/0ae8900034164ba19f88e94f1401cb7a` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:22.184679 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a099f54-3cfa-4567-8d5b-d53a0a14ba9b None admin] RBAC: Authorizing `identity:get_user(user_id=0ae8900034164ba19f88e94f1401cb7a)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:22.186238 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a099f54-3cfa-4567-8d5b-d53a0a14ba9b None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:22.188231 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 81/164] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Jul 18 16:27:22 2022] GET /identity/v3/users/0ae8900034164ba19f88e94f1401cb7a => generated 289 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:22.189095 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a099f54-3cfa-4567-8d5b-d53a0a14ba9b None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:22.215040 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 84/165] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Jul 18 16:27:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:27:22.216270 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f8feab-d349-4296-ba17-9c2a0a060c78 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:22.237555 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:22.260544 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:22.298422 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a099f54-3cfa-4567-8d5b-d53a0a14ba9b None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:22.326160 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f8feab-d349-4296-ba17-9c2a0a060c78 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:22.335860 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e9fdf8-cb0d-4473-a027-3cebc28ba546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:22.336623 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e9fdf8-cb0d-4473-a027-3cebc28ba546 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:22.336971 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e9fdf8-cb0d-4473-a027-3cebc28ba546 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:22.337314 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e9fdf8-cb0d-4473-a027-3cebc28ba546 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:22.365253 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02372277-43f4-40c9-9a42-976c902d3bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:22.366409 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02372277-43f4-40c9-9a42-976c902d3bee None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:22.366871 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02372277-43f4-40c9-9a42-976c902d3bee None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:22.367320 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02372277-43f4-40c9-9a42-976c902d3bee None admin] PATH_INFO: `/v3/projects/edc913ab51354b1da43bd3c47b3b2c51` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:22.368895 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02372277-43f4-40c9-9a42-976c902d3bee None admin] RBAC: Authorizing `identity:get_project(project_id=edc913ab51354b1da43bd3c47b3b2c51)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:22.370704 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02372277-43f4-40c9-9a42-976c902d3bee None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:22.372759 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 85/166] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Jul 18 16:27:22 2022] GET /identity/v3/projects/edc913ab51354b1da43bd3c47b3b2c51 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:22.373707 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02372277-43f4-40c9-9a42-976c902d3bee None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:22.413114 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e9fdf8-cb0d-4473-a027-3cebc28ba546 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:22.414980 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e9fdf8-cb0d-4473-a027-3cebc28ba546 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:22.474429 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:22.498861 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02372277-43f4-40c9-9a42-976c902d3bee None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:22.508137 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:22.539882 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d240e584-be89-41da-9ae9-6fe37025cb4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:22.541162 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d240e584-be89-41da-9ae9-6fe37025cb4a None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:22.541629 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d240e584-be89-41da-9ae9-6fe37025cb4a None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:22.542083 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d240e584-be89-41da-9ae9-6fe37025cb4a None admin] PATH_INFO: `/v3/projects/edc913ab51354b1da43bd3c47b3b2c51` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:22.543565 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d240e584-be89-41da-9ae9-6fe37025cb4a None admin] RBAC: Authorizing `identity:get_project(project_id=edc913ab51354b1da43bd3c47b3b2c51)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:22.545466 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d240e584-be89-41da-9ae9-6fe37025cb4a None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:22.548150 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 86/167] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Jul 18 16:27:22 2022] GET /identity/v3/projects/edc913ab51354b1da43bd3c47b3b2c51 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:22.549128 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d240e584-be89-41da-9ae9-6fe37025cb4a None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:22.643215 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 82/168] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Jul 18 16:27:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:27:22.644044 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e9fdf8-cb0d-4473-a027-3cebc28ba546 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:22.664245 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d240e584-be89-41da-9ae9-6fe37025cb4a None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:22.708641 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bda06c-7a97-4bec-ad03-d1872f1038c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:22.710075 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bda06c-7a97-4bec-ad03-d1872f1038c6 None admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:22.710536 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bda06c-7a97-4bec-ad03-d1872f1038c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:22.710987 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bda06c-7a97-4bec-ad03-d1872f1038c6 None admin] PATH_INFO: `/v3/projects/edc913ab51354b1da43bd3c47b3b2c51/users/0ae8900034164ba19f88e94f1401cb7a/roles/2d721f61e3334102a57d236346c17850` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:22.713719 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bda06c-7a97-4bec-ad03-d1872f1038c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=edc913ab51354b1da43bd3c47b3b2c51, user_id=0ae8900034164ba19f88e94f1401cb7a, role_id=2d721f61e3334102a57d236346c17850)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:22.715383 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bda06c-7a97-4bec-ad03-d1872f1038c6 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:22.790927 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 87/169] 10.222.0.81 () {58 vars in 1439 bytes} [Mon Jul 18 16:27:22 2022] PUT /identity/v3/projects/edc913ab51354b1da43bd3c47b3b2c51/users/0ae8900034164ba19f88e94f1401cb7a/roles/2d721f61e3334102a57d236346c17850 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:27:22.792699 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bda06c-7a97-4bec-ad03-d1872f1038c6 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:22.852953 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e9fdf8-cb0d-4473-a027-3cebc28ba546 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:22.871921 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:22.914208 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad01be-9900-4f92-b58b-9fbd17007f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:22.915407 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad01be-9900-4f92-b58b-9fbd17007f11 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:22.915963 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad01be-9900-4f92-b58b-9fbd17007f11 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:22.916992 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad01be-9900-4f92-b58b-9fbd17007f11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:22.920720 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faad01be-9900-4f92-b58b-9fbd17007f11 None admin] RBAC: Adding query filter params (role.id=ad3a2bc7b2094a4da1a95a143c8d9436, scope.project.id=edc913ab51354b1da43bd3c47b3b2c51, user.id=c43109bed5da4b9d873232adae450346) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:22.921316 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faad01be-9900-4f92-b58b-9fbd17007f11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:22.923589 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faad01be-9900-4f92-b58b-9fbd17007f11 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:22.940932 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 83/170] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Jul 18 16:27:22 2022] GET /identity/v3/role_assignments?user.id=c43109bed5da4b9d873232adae450346&scope.project.id=edc913ab51354b1da43bd3c47b3b2c51&role.id=ad3a2bc7b2094a4da1a95a143c8d9436 => generated 608 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:22.998660 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bda06c-7a97-4bec-ad03-d1872f1038c6 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:23.030703 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5db9dd-ccff-47e0-9f78-593059a4412d None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:23.031406 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5db9dd-ccff-47e0-9f78-593059a4412d None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:23.031956 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5db9dd-ccff-47e0-9f78-593059a4412d None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:23.033602 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 84/171] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:27:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:27:23.047339 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef5423-f34a-405f-9d86-d30495b45f17 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:23.048010 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef5423-f34a-405f-9d86-d30495b45f17 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:23.048550 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef5423-f34a-405f-9d86-d30495b45f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:23.057245 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec446898-4291-4fbb-bd8b-beb65798d83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:23.058159 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec446898-4291-4fbb-bd8b-beb65798d83c None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:23.058444 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec446898-4291-4fbb-bd8b-beb65798d83c None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:23.058722 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec446898-4291-4fbb-bd8b-beb65798d83c None admin] PATH_INFO: `/v3/projects/edc913ab51354b1da43bd3c47b3b2c51` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:23.060283 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec446898-4291-4fbb-bd8b-beb65798d83c None admin] RBAC: Authorizing `identity:get_project(project_id=edc913ab51354b1da43bd3c47b3b2c51)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:23.061807 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec446898-4291-4fbb-bd8b-beb65798d83c None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:23.064443 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 88/172] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Jul 18 16:27:22 2022] GET /identity/v3/projects/edc913ab51354b1da43bd3c47b3b2c51 => generated 298 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:23.075778 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec446898-4291-4fbb-bd8b-beb65798d83c None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:23.079554 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:23.092029 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-36ef5423-f34a-405f-9d86-d30495b45f17 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:27:23.093685 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-36ef5423-f34a-405f-9d86-d30495b45f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:27:23.254519 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 85/173] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:27:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:27:23.271675 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec446898-4291-4fbb-bd8b-beb65798d83c None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:23.276129 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:23.287287 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ef5423-f34a-405f-9d86-d30495b45f17 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:23.317511 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9553738e-4a70-4d4b-bfb4-99670e82740f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:23.318200 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553738e-4a70-4d4b-bfb4-99670e82740f None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:23.318479 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553738e-4a70-4d4b-bfb4-99670e82740f None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:23.318759 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553738e-4a70-4d4b-bfb4-99670e82740f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:23.319610 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9553738e-4a70-4d4b-bfb4-99670e82740f None admin] RBAC: Adding query filter params (role.id=6bfa001ddac347da894c7231f853c3df, scope.project.id=edc913ab51354b1da43bd3c47b3b2c51, user.id=c43109bed5da4b9d873232adae450346) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:23.319956 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9553738e-4a70-4d4b-bfb4-99670e82740f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:23.323379 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9553738e-4a70-4d4b-bfb4-99670e82740f None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:23.328133 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 89/174] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Jul 18 16:27:23 2022] GET /identity/v3/role_assignments?user.id=c43109bed5da4b9d873232adae450346&scope.project.id=edc913ab51354b1da43bd3c47b3b2c51&role.id=6bfa001ddac347da894c7231f853c3df => generated 608 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:27:23.425416 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ef5423-f34a-405f-9d86-d30495b45f17 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:23.476619 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e1c39e-ba83-4977-bc58-4363268e4a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:23.477460 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1c39e-ba83-4977-bc58-4363268e4a34 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:23.477747 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1c39e-ba83-4977-bc58-4363268e4a34 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:23.478021 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1c39e-ba83-4977-bc58-4363268e4a34 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:23.481340 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:23.501026 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e1c39e-ba83-4977-bc58-4363268e4a34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:27:23.509424 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-46e1c39e-ba83-4977-bc58-4363268e4a34 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 16:27:23.509424 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:27:23.509424 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:27:23.509424 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:27:23.509424 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:27:23.509424 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:27:23.509424 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:27:23.509424 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:27:23.509424 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:27:23.509424 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:27:23.509424 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:27:23.509424 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:27:23.509424 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:27:23.509424 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:27:23.509424 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:27:23.509424 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:27:23.510412 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:27:23.510412 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:27:23.510412 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:27:23.510412 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:27:23.510412 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:27:23.510412 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:27:23.510412 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:27:23.510412 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:27:23.510412 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:27:23.510412 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:27:23.510412 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:27:23.510412 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:27:23.510412 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:27:23.510412 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:27:23.510412 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:27:23.510412 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:27:23.511224 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:27:23.511224 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:27:23.511224 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:27:23.511224 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:27:23.511224 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:27:23.511224 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:27:23.511224 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:27:23.511224 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:27:23.511224 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:27:23.511224 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:27:23.511224 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 16:27:23.511224 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:27:23.511224 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 86/175] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Jul 18 16:27:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:27:23.517464 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9553738e-4a70-4d4b-bfb4-99670e82740f None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:23.635087 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9553738e-4a70-4d4b-bfb4-99670e82740f None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:23.674947 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3116abe4-6aca-4d29-b99a-ddeabab3db6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:23.675769 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116abe4-6aca-4d29-b99a-ddeabab3db6c None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:23.676187 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116abe4-6aca-4d29-b99a-ddeabab3db6c None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:23.676497 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116abe4-6aca-4d29-b99a-ddeabab3db6c None admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:23.677373 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3116abe4-6aca-4d29-b99a-ddeabab3db6c None admin] RBAC: Adding query filter params (name=member) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:23.677627 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3116abe4-6aca-4d29-b99a-ddeabab3db6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:23.679021 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3116abe4-6aca-4d29-b99a-ddeabab3db6c None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:23.689333 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 90/176] 10.222.0.81 () {56 vars in 1101 bytes} [Mon Jul 18 16:27:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:23.695244 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e1c39e-ba83-4977-bc58-4363268e4a34 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:23.792524 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a19d42-3ed4-4397-8b5e-b8ffe2df35be None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:23.793011 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a19d42-3ed4-4397-8b5e-b8ffe2df35be None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:23.793011 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a19d42-3ed4-4397-8b5e-b8ffe2df35be None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:23.794380 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 91/177] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:27:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:27:23.802804 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42366ae6-248c-43b3-a894-9e62a4c0090b None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:23.803398 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42366ae6-248c-43b3-a894-9e62a4c0090b None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:23.803682 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42366ae6-248c-43b3-a894-9e62a4c0090b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:23.825166 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-42366ae6-248c-43b3-a894-9e62a4c0090b None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:27:23.826385 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-42366ae6-248c-43b3-a894-9e62a4c0090b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:27:23.830799 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e1c39e-ba83-4977-bc58-4363268e4a34 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:23.858227 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:23.910137 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62146aa8-c17c-43b6-8466-24448fb56bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:23.911041 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62146aa8-c17c-43b6-8466-24448fb56bf6 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:23.911317 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62146aa8-c17c-43b6-8466-24448fb56bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:23.911586 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62146aa8-c17c-43b6-8466-24448fb56bf6 None admin] PATH_INFO: `/v3/users/c43109bed5da4b9d873232adae450346` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:23.914236 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62146aa8-c17c-43b6-8466-24448fb56bf6 None admin] RBAC: Authorizing `identity:get_user(user_id=c43109bed5da4b9d873232adae450346)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:23.915733 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62146aa8-c17c-43b6-8466-24448fb56bf6 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:23.917610 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 87/178] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Jul 18 16:27:23 2022] GET /identity/v3/users/c43109bed5da4b9d873232adae450346 => generated 275 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:23.926025 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62146aa8-c17c-43b6-8466-24448fb56bf6 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:23.956387 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 92/179] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:27:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 16:27:23.984536 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42366ae6-248c-43b3-a894-9e62a4c0090b None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:24.040129 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:24.076622 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62146aa8-c17c-43b6-8466-24448fb56bf6 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:24.165014 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6cfdbe-f28a-47b3-a0cc-16343ed57753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:24.166271 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6cfdbe-f28a-47b3-a0cc-16343ed57753 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:24.170240 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6cfdbe-f28a-47b3-a0cc-16343ed57753 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:24.170758 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6cfdbe-f28a-47b3-a0cc-16343ed57753 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:24.223831 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42366ae6-248c-43b3-a894-9e62a4c0090b None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:24.299181 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e24b5ef-5e92-4f50-af2b-5a03b807961e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:24.304705 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24b5ef-5e92-4f50-af2b-5a03b807961e None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:24.305115 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24b5ef-5e92-4f50-af2b-5a03b807961e None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:24.305396 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24b5ef-5e92-4f50-af2b-5a03b807961e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:24.310131 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6cfdbe-f28a-47b3-a0cc-16343ed57753 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:24.312170 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6cfdbe-f28a-47b3-a0cc-16343ed57753 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:24.321617 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e24b5ef-5e92-4f50-af2b-5a03b807961e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:27:24.337712 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-0e24b5ef-5e92-4f50-af2b-5a03b807961e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:27:24.337712 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:27:24.337712 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:27:24.337712 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:27:24.337712 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:27:24.337712 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:27:24.337712 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:27:24.337712 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:27:24.337712 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:27:24.337712 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:27:24.337712 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:27:24.337712 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:27:24.337712 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:27:24.337712 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:27:24.337712 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:27:24.337712 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:27:24.338655 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:27:24.338655 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:27:24.338655 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:27:24.338655 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:27:24.338655 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:27:24.338655 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:27:24.338655 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:27:24.338655 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:27:24.338655 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:27:24.338655 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:27:24.338655 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:27:24.338655 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:27:24.338655 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:27:24.338655 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:27:24.338655 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:27:24.338655 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:27:24.339461 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:27:24.339461 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:27:24.339461 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:27:24.339461 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:27:24.339461 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:27:24.339461 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:27:24.339461 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:27:24.339461 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:27:24.339461 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:27:24.339461 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:27:24.339461 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:27:24.339461 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:27:24.339461 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 93/180] 10.222.0.81 () {56 vars in 1096 bytes} [Mon Jul 18 16:27:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:27:24.363274 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e24b5ef-5e92-4f50-af2b-5a03b807961e None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:24.392395 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:24.429049 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:24.439269 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 88/181] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Jul 18 16:27:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 18 16:27:24.445472 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6cfdbe-f28a-47b3-a0cc-16343ed57753 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:24.570869 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6cfdbe-f28a-47b3-a0cc-16343ed57753 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:24.609913 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e24b5ef-5e92-4f50-af2b-5a03b807961e None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:24.621179 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99707720-6f06-4e49-a88a-e923eb9ecb7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:24.622062 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99707720-6f06-4e49-a88a-e923eb9ecb7a None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:24.622348 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99707720-6f06-4e49-a88a-e923eb9ecb7a None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:24.622623 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99707720-6f06-4e49-a88a-e923eb9ecb7a None admin] PATH_INFO: `/v3/projects/4e9d997e3210479cb2de18f16738b320` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:24.623848 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99707720-6f06-4e49-a88a-e923eb9ecb7a None admin] RBAC: Authorizing `identity:get_project(project_id=4e9d997e3210479cb2de18f16738b320)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:24.625404 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99707720-6f06-4e49-a88a-e923eb9ecb7a None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:24.627259 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 89/182] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Jul 18 16:27:24 2022] GET /identity/v3/projects/4e9d997e3210479cb2de18f16738b320 => generated 312 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:24.628443 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c038e8-458d-4a92-8b0a-d98c34c0aac4 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:24.628618 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c038e8-458d-4a92-8b0a-d98c34c0aac4 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:24.628895 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c038e8-458d-4a92-8b0a-d98c34c0aac4 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:24.630159 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 90/183] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:27:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:27:24.634958 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c038e8-458d-4a92-8b0a-d98c34c0aac4 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:24.660546 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6100aebf-9099-4a3d-9713-f26f98d63f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:24.661596 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6100aebf-9099-4a3d-9713-f26f98d63f97 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:24.662079 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6100aebf-9099-4a3d-9713-f26f98d63f97 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:24.662578 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6100aebf-9099-4a3d-9713-f26f98d63f97 None admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:24.663540 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6100aebf-9099-4a3d-9713-f26f98d63f97 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:24.664094 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6100aebf-9099-4a3d-9713-f26f98d63f97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:24.665721 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6100aebf-9099-4a3d-9713-f26f98d63f97 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:24.675682 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:24.675996 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 94/184] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Jul 18 16:27:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:24.677381 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367a794-aee4-4e82-99d2-bad6eaec9de7 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:24.677746 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367a794-aee4-4e82-99d2-bad6eaec9de7 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:24.678085 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367a794-aee4-4e82-99d2-bad6eaec9de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:24.702343 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-0367a794-aee4-4e82-99d2-bad6eaec9de7 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:27:24.704289 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-0367a794-aee4-4e82-99d2-bad6eaec9de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:27:24.769852 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c038e8-458d-4a92-8b0a-d98c34c0aac4 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:24.792716 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 95/185] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:27:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:27:24.793701 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367a794-aee4-4e82-99d2-bad6eaec9de7 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:24.811109 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:24.818840 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5601ef-ca81-49e8-96de-d9cc25ad0699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:24.819522 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5601ef-ca81-49e8-96de-d9cc25ad0699 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:24.819828 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5601ef-ca81-49e8-96de-d9cc25ad0699 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:24.820108 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5601ef-ca81-49e8-96de-d9cc25ad0699 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:24.821031 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5601ef-ca81-49e8-96de-d9cc25ad0699 None admin] RBAC: Adding query filter params (role.id=ad3a2bc7b2094a4da1a95a143c8d9436, scope.project.id=4e9d997e3210479cb2de18f16738b320, user.id=c43109bed5da4b9d873232adae450346) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:24.821339 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5601ef-ca81-49e8-96de-d9cc25ad0699 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:24.822840 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5601ef-ca81-49e8-96de-d9cc25ad0699 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:24.831639 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 91/186] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Jul 18 16:27:24 2022] GET /identity/v3/role_assignments?user.id=c43109bed5da4b9d873232adae450346&scope.project.id=4e9d997e3210479cb2de18f16738b320&role.id=ad3a2bc7b2094a4da1a95a143c8d9436 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:24.832408 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680aa0c-72f2-471d-8c1e-5a61a29d641f None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:24.832408 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680aa0c-72f2-471d-8c1e-5a61a29d641f None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:24.832408 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680aa0c-72f2-471d-8c1e-5a61a29d641f None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:24.834263 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 92/187] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:27:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:27:24.838909 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d680aa0c-72f2-471d-8c1e-5a61a29d641f None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:24.933408 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367a794-aee4-4e82-99d2-bad6eaec9de7 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:24.953828 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:24.959034 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d680aa0c-72f2-471d-8c1e-5a61a29d641f None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:24.973719 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038542df-209b-4aab-9c14-19597596897a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:24.975005 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038542df-209b-4aab-9c14-19597596897a None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:24.975517 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038542df-209b-4aab-9c14-19597596897a None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:24.976044 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038542df-209b-4aab-9c14-19597596897a None admin] PATH_INFO: `/v3/users/e5306078fd4a49849363cb121dd0ee4c` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:24.992527 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038542df-209b-4aab-9c14-19597596897a None admin] RBAC: Authorizing `identity:get_user(user_id=e5306078fd4a49849363cb121dd0ee4c)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:24.994408 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038542df-209b-4aab-9c14-19597596897a None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:24.996553 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 96/188] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Jul 18 16:27:24 2022] GET /identity/v3/users/e5306078fd4a49849363cb121dd0ee4c => generated 283 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:24.998074 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede20bf6-6119-48c2-a000-057c1747c247 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:24.998185 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda9286d-8a2e-49cc-bf55-08e9b0da9cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:24.998685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede20bf6-6119-48c2-a000-057c1747c247 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:24.998923 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda9286d-8a2e-49cc-bf55-08e9b0da9cb7 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:24.999259 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda9286d-8a2e-49cc-bf55-08e9b0da9cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:24.999541 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda9286d-8a2e-49cc-bf55-08e9b0da9cb7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:25.000350 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede20bf6-6119-48c2-a000-057c1747c247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:25.001322 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda9286d-8a2e-49cc-bf55-08e9b0da9cb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:25.003227 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda9286d-8a2e-49cc-bf55-08e9b0da9cb7 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:25.006104 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 93/189] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:27:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:25.006982 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda9286d-8a2e-49cc-bf55-08e9b0da9cb7 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:25.023959 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-ede20bf6-6119-48c2-a000-057c1747c247 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:27:25.025351 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-ede20bf6-6119-48c2-a000-057c1747c247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:27:25.113353 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:25.118963 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 97/190] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:27:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:27:25.120346 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede20bf6-6119-48c2-a000-057c1747c247 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:25.135014 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda9286d-8a2e-49cc-bf55-08e9b0da9cb7 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:25.185765 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5375c3da-2b33-4420-96f1-b65588b9c101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:25.186314 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375c3da-2b33-4420-96f1-b65588b9c101 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:25.186593 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375c3da-2b33-4420-96f1-b65588b9c101 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:25.186867 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375c3da-2b33-4420-96f1-b65588b9c101 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:25.226555 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:25.235586 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede20bf6-6119-48c2-a000-057c1747c247 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:25.266806 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5375c3da-2b33-4420-96f1-b65588b9c101 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:25.268317 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5375c3da-2b33-4420-96f1-b65588b9c101 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:25.272575 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b31baf-1bf7-49a8-9430-06260456c6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:25.273237 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b31baf-1bf7-49a8-9430-06260456c6b0 None admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:25.273516 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b31baf-1bf7-49a8-9430-06260456c6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:25.273785 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b31baf-1bf7-49a8-9430-06260456c6b0 None admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:25.274492 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b31baf-1bf7-49a8-9430-06260456c6b0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:25.275962 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b31baf-1bf7-49a8-9430-06260456c6b0 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:25.370794 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 94/191] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Jul 18 16:27:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:27:25.371758 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5375c3da-2b33-4420-96f1-b65588b9c101 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:25.433602 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:25.456212 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 98/192] 10.222.0.81 () {60 vars in 1132 bytes} [Mon Jul 18 16:27:25 2022] POST /identity/v3/users => generated 297 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:27:25.456212 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b31baf-1bf7-49a8-9430-06260456c6b0 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:25.483684 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5375c3da-2b33-4420-96f1-b65588b9c101 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:25.524204 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30585542-3c66-4a5c-bac1-47c5539fe236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:25.525639 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30585542-3c66-4a5c-bac1-47c5539fe236 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:25.526000 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30585542-3c66-4a5c-bac1-47c5539fe236 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:25.526186 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30585542-3c66-4a5c-bac1-47c5539fe236 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:25.532740 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:25.539127 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30585542-3c66-4a5c-bac1-47c5539fe236 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:27:25.548362 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-30585542-3c66-4a5c-bac1-47c5539fe236 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 16:27:25.548362 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:27:25.548362 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:27:25.548362 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:27:25.548362 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:27:25.548362 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:27:25.548362 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:27:25.548362 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:27:25.548362 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:27:25.548362 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:27:25.548362 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:27:25.548362 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:27:25.548362 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:27:25.548362 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:27:25.548362 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:27:25.548362 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:27:25.549332 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:27:25.549332 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:27:25.549332 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:27:25.549332 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:27:25.549332 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:27:25.549332 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:27:25.549332 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:27:25.549332 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:27:25.549332 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:27:25.549332 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:27:25.549332 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:27:25.549332 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:27:25.549332 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:27:25.549332 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:27:25.549332 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:27:25.549332 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:27:25.550148 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:27:25.550148 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:27:25.550148 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:27:25.550148 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:27:25.550148 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:27:25.550148 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:27:25.550148 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:27:25.550148 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:27:25.550148 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:27:25.550148 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:27:25.550148 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 16:27:25.550148 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:27:25.550148 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 95/193] 10.222.0.81 () {56 vars in 1114 bytes} [Mon Jul 18 16:27:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:27:25.557001 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30585542-3c66-4a5c-bac1-47c5539fe236 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:25.588104 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b31baf-1bf7-49a8-9430-06260456c6b0 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:25.629211 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053cce16-d423-4c36-85a9-58c40c266257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:25.630260 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053cce16-d423-4c36-85a9-58c40c266257 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:25.630575 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053cce16-d423-4c36-85a9-58c40c266257 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:25.630937 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053cce16-d423-4c36-85a9-58c40c266257 None admin] PATH_INFO: `/v3/projects/7f680cc460584bf688dae550c6a46776` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:25.632346 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053cce16-d423-4c36-85a9-58c40c266257 None admin] RBAC: Authorizing `identity:get_project(project_id=7f680cc460584bf688dae550c6a46776)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:25.634110 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053cce16-d423-4c36-85a9-58c40c266257 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:25.640247 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 99/194] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Jul 18 16:27:25 2022] GET /identity/v3/projects/7f680cc460584bf688dae550c6a46776 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:25.643925 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d869c8-de47-4e9b-b2a1-93a708adf31b None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:25.644217 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d869c8-de47-4e9b-b2a1-93a708adf31b None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:25.644506 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d869c8-de47-4e9b-b2a1-93a708adf31b None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:25.645928 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 100/195] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:27:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:27:25.646743 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d869c8-de47-4e9b-b2a1-93a708adf31b None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:25.683447 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30585542-3c66-4a5c-bac1-47c5539fe236 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:25.714315 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:25.727618 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84599ba-f58a-4995-80a3-b35ebf6352e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:25.728353 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84599ba-f58a-4995-80a3-b35ebf6352e5 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:25.728652 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84599ba-f58a-4995-80a3-b35ebf6352e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:25.728928 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84599ba-f58a-4995-80a3-b35ebf6352e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:25.729675 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84599ba-f58a-4995-80a3-b35ebf6352e5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:25.729984 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84599ba-f58a-4995-80a3-b35ebf6352e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:25.731374 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84599ba-f58a-4995-80a3-b35ebf6352e5 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:25.741331 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 96/196] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Jul 18 16:27:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:27:25.742660 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eace55-3426-468c-b7dd-ade8a0ba4d8c None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:25.742946 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eace55-3426-468c-b7dd-ade8a0ba4d8c None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:25.743225 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eace55-3426-468c-b7dd-ade8a0ba4d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:25.762531 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-74eace55-3426-468c-b7dd-ade8a0ba4d8c None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:27:25.763251 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-74eace55-3426-468c-b7dd-ade8a0ba4d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:27:25.776009 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d869c8-de47-4e9b-b2a1-93a708adf31b None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:25.805316 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:25.821341 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3617d1cd-6ba0-4a68-9701-8076898ee3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:25.822016 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3617d1cd-6ba0-4a68-9701-8076898ee3b3 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:25.822296 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3617d1cd-6ba0-4a68-9701-8076898ee3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:25.822571 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3617d1cd-6ba0-4a68-9701-8076898ee3b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:25.823423 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3617d1cd-6ba0-4a68-9701-8076898ee3b3 None admin] RBAC: Adding query filter params (role.id=fd83eab44cb343a2b532ce32a2ac31d8, scope.project.id=7f680cc460584bf688dae550c6a46776, user.id=e5306078fd4a49849363cb121dd0ee4c) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:25.823751 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3617d1cd-6ba0-4a68-9701-8076898ee3b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:25.825370 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3617d1cd-6ba0-4a68-9701-8076898ee3b3 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:25.840091 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 101/197] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Jul 18 16:27:25 2022] GET /identity/v3/role_assignments?user.id=e5306078fd4a49849363cb121dd0ee4c&scope.project.id=7f680cc460584bf688dae550c6a46776&role.id=fd83eab44cb343a2b532ce32a2ac31d8 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:25.841059 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3617d1cd-6ba0-4a68-9701-8076898ee3b3 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:25.852030 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 97/198] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:27:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:27:25.878856 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eace55-3426-468c-b7dd-ade8a0ba4d8c None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:25.965268 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3617d1cd-6ba0-4a68-9701-8076898ee3b3 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:25.996858 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eace55-3426-468c-b7dd-ade8a0ba4d8c None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:26.005241 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e46152-e66b-4033-80a7-1a682e441861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:26.006159 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e46152-e66b-4033-80a7-1a682e441861 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:26.006524 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e46152-e66b-4033-80a7-1a682e441861 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:26.006806 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e46152-e66b-4033-80a7-1a682e441861 None admin] PATH_INFO: `/v3/users/e5306078fd4a49849363cb121dd0ee4c` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:26.008154 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e46152-e66b-4033-80a7-1a682e441861 None admin] RBAC: Authorizing `identity:get_user(user_id=e5306078fd4a49849363cb121dd0ee4c)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:26.010047 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e46152-e66b-4033-80a7-1a682e441861 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:26.012119 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 102/199] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Jul 18 16:27:25 2022] GET /identity/v3/users/e5306078fd4a49849363cb121dd0ee4c => generated 283 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:26.021145 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e46152-e66b-4033-80a7-1a682e441861 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:26.022717 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:26.042645 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccab8bb-f182-4580-b619-26736021f5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:26.043492 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccab8bb-f182-4580-b619-26736021f5cb None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:26.043797 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccab8bb-f182-4580-b619-26736021f5cb None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:26.044072 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccab8bb-f182-4580-b619-26736021f5cb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:26.056619 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccab8bb-f182-4580-b619-26736021f5cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:27:26.065734 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-7ccab8bb-f182-4580-b619-26736021f5cb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 16:27:26.065734 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:27:26.065734 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:27:26.065734 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:27:26.065734 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:27:26.065734 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:27:26.065734 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:27:26.065734 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:27:26.065734 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:27:26.065734 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:27:26.065734 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:27:26.065734 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:27:26.065734 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:27:26.065734 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:27:26.065734 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:27:26.065734 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:27:26.068173 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:27:26.068173 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:27:26.068173 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:27:26.068173 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:27:26.068173 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:27:26.068173 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:27:26.068173 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:27:26.068173 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:27:26.068173 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:27:26.068173 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:27:26.068173 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:27:26.068173 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:27:26.068173 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:27:26.068173 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:27:26.068173 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:27:26.068173 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:27:26.070185 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:27:26.070185 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:27:26.070185 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:27:26.070185 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:27:26.070185 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:27:26.070185 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:27:26.070185 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:27:26.070185 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:27:26.070185 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:27:26.070185 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:27:26.070185 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 16:27:26.070185 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:27:26.070185 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 98/200] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Jul 18 16:27:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:27:26.079790 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccab8bb-f182-4580-b619-26736021f5cb None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:26.090917 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:26.150049 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e46152-e66b-4033-80a7-1a682e441861 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:26.190396 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a029dbe5-0f5a-41b2-afbb-eb1357fbbd4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:26.191195 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a029dbe5-0f5a-41b2-afbb-eb1357fbbd4d None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:26.191482 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a029dbe5-0f5a-41b2-afbb-eb1357fbbd4d None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:26.191779 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a029dbe5-0f5a-41b2-afbb-eb1357fbbd4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:26.228131 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccab8bb-f182-4580-b619-26736021f5cb None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:26.284191 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a029dbe5-0f5a-41b2-afbb-eb1357fbbd4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:26.285693 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a029dbe5-0f5a-41b2-afbb-eb1357fbbd4d None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:26.304886 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51083c8-1000-4aea-9b38-b272a0f80a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:26.305577 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51083c8-1000-4aea-9b38-b272a0f80a32 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:26.305863 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51083c8-1000-4aea-9b38-b272a0f80a32 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:26.306294 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51083c8-1000-4aea-9b38-b272a0f80a32 None admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:26.307418 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51083c8-1000-4aea-9b38-b272a0f80a32 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:26.307752 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51083c8-1000-4aea-9b38-b272a0f80a32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:26.309158 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51083c8-1000-4aea-9b38-b272a0f80a32 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:26.326537 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 99/201] 10.222.0.81 () {56 vars in 1101 bytes} [Mon Jul 18 16:27:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:27:26.338255 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51083c8-1000-4aea-9b38-b272a0f80a32 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:26.402628 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:26.422491 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:26.464975 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 103/202] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Jul 18 16:27:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:27:26.480906 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a029dbe5-0f5a-41b2-afbb-eb1357fbbd4d None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:26.514461 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51083c8-1000-4aea-9b38-b272a0f80a32 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:26.551503 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407d13df-3a03-4cdb-bd28-7735c33caa1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:26.552584 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407d13df-3a03-4cdb-bd28-7735c33caa1d None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:26.552994 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407d13df-3a03-4cdb-bd28-7735c33caa1d None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:26.553372 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407d13df-3a03-4cdb-bd28-7735c33caa1d None admin] PATH_INFO: `/v3/users/0ae8900034164ba19f88e94f1401cb7a` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:26.554691 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407d13df-3a03-4cdb-bd28-7735c33caa1d None admin] RBAC: Authorizing `identity:get_user(user_id=0ae8900034164ba19f88e94f1401cb7a)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:26.556295 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407d13df-3a03-4cdb-bd28-7735c33caa1d None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:26.558439 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 100/203] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Jul 18 16:27:26 2022] GET /identity/v3/users/0ae8900034164ba19f88e94f1401cb7a => generated 289 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:26.564591 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407d13df-3a03-4cdb-bd28-7735c33caa1d None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:26.668884 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407d13df-3a03-4cdb-bd28-7735c33caa1d None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:26.705027 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a461df3-e8dd-4c66-a4cd-41b2c32e6a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:26.705884 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a461df3-e8dd-4c66-a4cd-41b2c32e6a96 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:26.706272 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a461df3-e8dd-4c66-a4cd-41b2c32e6a96 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:26.706652 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a461df3-e8dd-4c66-a4cd-41b2c32e6a96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:26.710270 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:26.779932 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a461df3-e8dd-4c66-a4cd-41b2c32e6a96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:26.782060 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a461df3-e8dd-4c66-a4cd-41b2c32e6a96 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:26.819538 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a029dbe5-0f5a-41b2-afbb-eb1357fbbd4d None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:26.930536 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c83c7b-6d7f-43a4-aff4-79b02f7a61e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:26.931408 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c83c7b-6d7f-43a4-aff4-79b02f7a61e4 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:26.931686 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c83c7b-6d7f-43a4-aff4-79b02f7a61e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:26.931982 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c83c7b-6d7f-43a4-aff4-79b02f7a61e4 None admin] PATH_INFO: `/v3/projects/7f680cc460584bf688dae550c6a46776` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:26.936045 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c83c7b-6d7f-43a4-aff4-79b02f7a61e4 None admin] RBAC: Authorizing `identity:get_project(project_id=7f680cc460584bf688dae550c6a46776)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:26.940005 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c83c7b-6d7f-43a4-aff4-79b02f7a61e4 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:26.943903 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 104/204] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Jul 18 16:27:26 2022] GET /identity/v3/projects/7f680cc460584bf688dae550c6a46776 => generated 302 bytes in 464 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:26.950085 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c83c7b-6d7f-43a4-aff4-79b02f7a61e4 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:26.979888 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 101/205] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Jul 18 16:27:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:27:26.981604 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a461df3-e8dd-4c66-a4cd-41b2c32e6a96 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:26.995343 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:27.017504 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:27.136036 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a461df3-e8dd-4c66-a4cd-41b2c32e6a96 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:27.136555 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c83c7b-6d7f-43a4-aff4-79b02f7a61e4 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:27.176312 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67486ffe-7627-4cca-9c8f-7bcbced287a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:27.177212 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67486ffe-7627-4cca-9c8f-7bcbced287a3 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:27.177632 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67486ffe-7627-4cca-9c8f-7bcbced287a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:27.178042 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67486ffe-7627-4cca-9c8f-7bcbced287a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:27.179038 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67486ffe-7627-4cca-9c8f-7bcbced287a3 None admin] RBAC: Adding query filter params (role.id=6bfa001ddac347da894c7231f853c3df, scope.project.id=7f680cc460584bf688dae550c6a46776, user.id=e5306078fd4a49849363cb121dd0ee4c) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:27.179516 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67486ffe-7627-4cca-9c8f-7bcbced287a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:27.181192 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67486ffe-7627-4cca-9c8f-7bcbced287a3 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:27.188247 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 105/206] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Jul 18 16:27:26 2022] GET /identity/v3/role_assignments?user.id=e5306078fd4a49849363cb121dd0ee4c&scope.project.id=7f680cc460584bf688dae550c6a46776&role.id=6bfa001ddac347da894c7231f853c3df => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:27.235161 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a8c814-caa9-4984-bd46-19c259624526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:27.236121 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8c814-caa9-4984-bd46-19c259624526 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:27.236401 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8c814-caa9-4984-bd46-19c259624526 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:27.236677 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8c814-caa9-4984-bd46-19c259624526 None admin] PATH_INFO: `/v3/projects/edc913ab51354b1da43bd3c47b3b2c51` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:27.240512 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a8c814-caa9-4984-bd46-19c259624526 None admin] RBAC: Authorizing `identity:get_project(project_id=edc913ab51354b1da43bd3c47b3b2c51)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:27.242005 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a8c814-caa9-4984-bd46-19c259624526 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:27.243880 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 102/207] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Jul 18 16:27:26 2022] GET /identity/v3/projects/edc913ab51354b1da43bd3c47b3b2c51 => generated 298 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:27:27.250470 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67486ffe-7627-4cca-9c8f-7bcbced287a3 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:27.385503 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:27.402585 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67486ffe-7627-4cca-9c8f-7bcbced287a3 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:27.438058 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e249b-792f-4416-8a7a-4328e8527bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:27.438974 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e249b-792f-4416-8a7a-4328e8527bbc None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:27.439394 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e249b-792f-4416-8a7a-4328e8527bbc None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:27.439854 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e249b-792f-4416-8a7a-4328e8527bbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:27.440818 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698e249b-792f-4416-8a7a-4328e8527bbc None admin] RBAC: Adding query filter params (role.id=2d721f61e3334102a57d236346c17850, scope.project.id=edc913ab51354b1da43bd3c47b3b2c51, user.id=0ae8900034164ba19f88e94f1401cb7a) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:27.441267 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698e249b-792f-4416-8a7a-4328e8527bbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:27.442847 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698e249b-792f-4416-8a7a-4328e8527bbc None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:27.449425 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 106/208] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Jul 18 16:27:27 2022] GET /identity/v3/role_assignments?user.id=0ae8900034164ba19f88e94f1401cb7a&scope.project.id=edc913ab51354b1da43bd3c47b3b2c51&role.id=2d721f61e3334102a57d236346c17850 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:27.980679 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add976a-dd61-462e-9cf7-c34b3f1a10f1 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:27.980964 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add976a-dd61-462e-9cf7-c34b3f1a10f1 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:27.981243 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add976a-dd61-462e-9cf7-c34b3f1a10f1 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:27.982646 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 103/209] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:27:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:27:27.988555 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e881d-b84f-490f-9266-98d2a537ef54 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:27.989459 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e881d-b84f-490f-9266-98d2a537ef54 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:27.989947 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e881d-b84f-490f-9266-98d2a537ef54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:28.010643 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-1d5e881d-b84f-490f-9266-98d2a537ef54 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:27:28.012327 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-1d5e881d-b84f-490f-9266-98d2a537ef54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:27:28.092575 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 107/210] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:27:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:27:28.116535 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1add976a-dd61-462e-9cf7-c34b3f1a10f1 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:28.178543 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de7257-8809-4349-b07d-3ec582f0f947 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:28.179460 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de7257-8809-4349-b07d-3ec582f0f947 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:28.180281 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de7257-8809-4349-b07d-3ec582f0f947 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:28.183343 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 108/211] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:27:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:27:28.190105 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a0702-d607-4bdb-bacb-cf29eceba8ec None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:28.190979 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a0702-d607-4bdb-bacb-cf29eceba8ec None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:28.191818 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a0702-d607-4bdb-bacb-cf29eceba8ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:28.216573 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:28.223518 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-f04a0702-d607-4bdb-bacb-cf29eceba8ec None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:27:28.225257 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-f04a0702-d607-4bdb-bacb-cf29eceba8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:27:28.248502 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1add976a-dd61-462e-9cf7-c34b3f1a10f1 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:28.290570 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae94ef4-1870-43c0-97b5-8ebe19237721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:28.291486 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae94ef4-1870-43c0-97b5-8ebe19237721 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:28.291798 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae94ef4-1870-43c0-97b5-8ebe19237721 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:28.292078 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae94ef4-1870-43c0-97b5-8ebe19237721 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:28.305497 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae94ef4-1870-43c0-97b5-8ebe19237721 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:27:28.314420 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-bae94ef4-1870-43c0-97b5-8ebe19237721 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 16:27:28.314420 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:27:28.314420 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:27:28.314420 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:27:28.314420 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:27:28.314420 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:27:28.314420 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:27:28.314420 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:27:28.314420 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:27:28.314420 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:27:28.314420 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:27:28.314420 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:27:28.314420 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:27:28.314420 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:27:28.314420 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:27:28.314420 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:27:28.316226 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:27:28.316226 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:27:28.316226 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:27:28.316226 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:27:28.316226 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:27:28.316226 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:27:28.316226 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:27:28.316226 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:27:28.316226 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:27:28.316226 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:27:28.316226 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:27:28.316226 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:27:28.316226 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:27:28.316226 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:27:28.316226 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:27:28.316226 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:27:28.317860 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:27:28.317860 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:27:28.317860 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:27:28.317860 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:27:28.317860 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:27:28.317860 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:27:28.317860 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:27:28.317860 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:27:28.317860 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:27:28.317860 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:27:28.317860 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 16:27:28.317860 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:27:28.319821 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 104/212] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Jul 18 16:27:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:27:28.322142 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae94ef4-1870-43c0-97b5-8ebe19237721 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:28.367648 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 109/213] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:27:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 16:27:28.369017 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b954e0-8fe0-4dd1-8241-f85194a8725c None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:28.369309 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b954e0-8fe0-4dd1-8241-f85194a8725c None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:28.369588 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b954e0-8fe0-4dd1-8241-f85194a8725c None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:28.370905 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 110/214] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:27:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:27:28.378039 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d461b5-53b0-4233-8493-9ef0cc9f8550 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:28.378333 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d461b5-53b0-4233-8493-9ef0cc9f8550 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:28.378615 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d461b5-53b0-4233-8493-9ef0cc9f8550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:28.398453 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-c3d461b5-53b0-4233-8493-9ef0cc9f8550 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:27:28.399654 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-c3d461b5-53b0-4233-8493-9ef0cc9f8550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:27:28.403729 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:28.444319 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae94ef4-1870-43c0-97b5-8ebe19237721 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:28.477221 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 111/215] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:27:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:27:28.485422 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d461b5-53b0-4233-8493-9ef0cc9f8550 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:28.495142 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51888704-f6c7-4ad3-918e-a06378dcc6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:28.496263 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51888704-f6c7-4ad3-918e-a06378dcc6e2 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:28.497570 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51888704-f6c7-4ad3-918e-a06378dcc6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:28.498095 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51888704-f6c7-4ad3-918e-a06378dcc6e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:28.499145 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51888704-f6c7-4ad3-918e-a06378dcc6e2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:28.500757 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51888704-f6c7-4ad3-918e-a06378dcc6e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:28.502238 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51888704-f6c7-4ad3-918e-a06378dcc6e2 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:28.504015 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:28.513371 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 105/216] 10.222.0.81 () {56 vars in 1101 bytes} [Mon Jul 18 16:27:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:28.514517 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51888704-f6c7-4ad3-918e-a06378dcc6e2 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:28.610127 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d461b5-53b0-4233-8493-9ef0cc9f8550 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:28.629262 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51888704-f6c7-4ad3-918e-a06378dcc6e2 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:28.649441 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78f8c67-1439-4bfb-bf4e-c1405b8f3f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:28.650245 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f8c67-1439-4bfb-bf4e-c1405b8f3f06 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:28.650523 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f8c67-1439-4bfb-bf4e-c1405b8f3f06 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:28.650798 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f8c67-1439-4bfb-bf4e-c1405b8f3f06 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:28.660347 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:28.664519 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78f8c67-1439-4bfb-bf4e-c1405b8f3f06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:27:28.672902 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-d78f8c67-1439-4bfb-bf4e-c1405b8f3f06 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:27:28.672902 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:27:28.672902 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:27:28.672902 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:27:28.672902 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:27:28.672902 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:27:28.672902 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:27:28.672902 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:27:28.672902 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:27:28.672902 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:27:28.672902 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:27:28.672902 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:27:28.672902 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:27:28.672902 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:27:28.672902 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:27:28.672902 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:27:28.682414 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:27:28.682414 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:27:28.682414 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:27:28.682414 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:27:28.682414 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:27:28.682414 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:27:28.682414 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:27:28.682414 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:27:28.682414 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:27:28.682414 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:27:28.682414 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:27:28.682414 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:27:28.682414 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:27:28.682414 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:27:28.682414 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:27:28.682414 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:27:28.683774 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:27:28.683774 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:27:28.683774 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:27:28.683774 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:27:28.683774 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:27:28.683774 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:27:28.683774 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:27:28.683774 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:27:28.683774 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:27:28.683774 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:27:28.683774 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:27:28.683774 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:27:28.683774 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 112/217] 10.222.0.81 () {56 vars in 1096 bytes} [Mon Jul 18 16:27:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:27:28.683774 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78f8c67-1439-4bfb-bf4e-c1405b8f3f06 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:28.687762 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d100f7-70b3-4c8f-bc0f-7aa4b8b06294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:28.688587 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d100f7-70b3-4c8f-bc0f-7aa4b8b06294 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:28.688869 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d100f7-70b3-4c8f-bc0f-7aa4b8b06294 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:28.689152 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d100f7-70b3-4c8f-bc0f-7aa4b8b06294 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:28.690896 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d100f7-70b3-4c8f-bc0f-7aa4b8b06294 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:28.692489 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d100f7-70b3-4c8f-bc0f-7aa4b8b06294 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:28.699991 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 106/218] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:27:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:28.699991 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d100f7-70b3-4c8f-bc0f-7aa4b8b06294 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:28.766776 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:28.804251 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78f8c67-1439-4bfb-bf4e-c1405b8f3f06 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:28.805469 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d100f7-70b3-4c8f-bc0f-7aa4b8b06294 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:28.843117 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7673bede-79ad-470c-a36b-c96422a58bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:28.843394 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c278be-0cbe-4af3-b80c-f53068323ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:28.843843 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7673bede-79ad-470c-a36b-c96422a58bab None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:28.844114 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c278be-0cbe-4af3-b80c-f53068323ba1 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:28.844214 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7673bede-79ad-470c-a36b-c96422a58bab None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:28.844520 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7673bede-79ad-470c-a36b-c96422a58bab None admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:28.844634 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c278be-0cbe-4af3-b80c-f53068323ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:28.844634 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c278be-0cbe-4af3-b80c-f53068323ba1 None admin] PATH_INFO: `/v3/users/c18a5449ca67465c93c7fb0e2efd1389` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:28.845136 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7673bede-79ad-470c-a36b-c96422a58bab None admin] RBAC: Adding query filter params (name=admin) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:28.845436 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7673bede-79ad-470c-a36b-c96422a58bab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:28.847004 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7673bede-79ad-470c-a36b-c96422a58bab None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:28.856682 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 107/219] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Jul 18 16:27:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:28.860918 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7673bede-79ad-470c-a36b-c96422a58bab None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:28.861489 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c278be-0cbe-4af3-b80c-f53068323ba1 None admin] RBAC: Authorizing `identity:get_user(user_id=c18a5449ca67465c93c7fb0e2efd1389)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:28.864204 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c278be-0cbe-4af3-b80c-f53068323ba1 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:28.866349 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 113/220] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Jul 18 16:27:28 2022] GET /identity/v3/users/c18a5449ca67465c93c7fb0e2efd1389 => generated 297 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:28.871358 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c278be-0cbe-4af3-b80c-f53068323ba1 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:28.952296 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:29.003233 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7673bede-79ad-470c-a36b-c96422a58bab None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:29.010072 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c278be-0cbe-4af3-b80c-f53068323ba1 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:29.038117 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:29.049104 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8092b19-08f1-4cec-8ccc-49e671028b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:29.055988 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8092b19-08f1-4cec-8ccc-49e671028b9c None admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:29.055988 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8092b19-08f1-4cec-8ccc-49e671028b9c None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:29.055988 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8092b19-08f1-4cec-8ccc-49e671028b9c None admin] PATH_INFO: `/v3/users` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:29.055988 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8092b19-08f1-4cec-8ccc-49e671028b9c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:29.055988 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8092b19-08f1-4cec-8ccc-49e671028b9c None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:29.057643 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de1674-2aff-400f-9bb4-236819c796b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:29.059310 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de1674-2aff-400f-9bb4-236819c796b7 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:29.059740 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de1674-2aff-400f-9bb4-236819c796b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:29.060244 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de1674-2aff-400f-9bb4-236819c796b7 None admin] PATH_INFO: `/v3/users/e5306078fd4a49849363cb121dd0ee4c` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:29.063222 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2de1674-2aff-400f-9bb4-236819c796b7 None admin] RBAC: Authorizing `identity:get_user(user_id=e5306078fd4a49849363cb121dd0ee4c)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:29.066217 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2de1674-2aff-400f-9bb4-236819c796b7 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:29.074593 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 114/221] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Jul 18 16:27:28 2022] GET /identity/v3/users/e5306078fd4a49849363cb121dd0ee4c => generated 283 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:29.074593 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de1674-2aff-400f-9bb4-236819c796b7 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:29.196752 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de1674-2aff-400f-9bb4-236819c796b7 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:29.225250 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 108/222] 10.222.0.81 () {60 vars in 1132 bytes} [Mon Jul 18 16:27:28 2022] POST /identity/v3/users => generated 297 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:27:29.225807 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:29.226873 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8092b19-08f1-4cec-8ccc-49e671028b9c None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:29.245585 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1dff7e-b586-4433-ad63-cd6ef60214ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:29.247521 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1dff7e-b586-4433-ad63-cd6ef60214ac None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:29.248847 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1dff7e-b586-4433-ad63-cd6ef60214ac None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:29.249349 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1dff7e-b586-4433-ad63-cd6ef60214ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:29.365929 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8092b19-08f1-4cec-8ccc-49e671028b9c None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:29.372981 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1dff7e-b586-4433-ad63-cd6ef60214ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:29.374602 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1dff7e-b586-4433-ad63-cd6ef60214ac None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:29.414735 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2832190-faf5-4df2-ab75-c866f19e7d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:29.415686 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2832190-faf5-4df2-ab75-c866f19e7d38 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:29.416062 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2832190-faf5-4df2-ab75-c866f19e7d38 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:29.416242 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2832190-faf5-4df2-ab75-c866f19e7d38 None admin] PATH_INFO: `/v3/projects/7f680cc460584bf688dae550c6a46776` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:29.418787 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2832190-faf5-4df2-ab75-c866f19e7d38 None admin] RBAC: Authorizing `identity:get_project(project_id=7f680cc460584bf688dae550c6a46776)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:29.419006 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2832190-faf5-4df2-ab75-c866f19e7d38 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:29.420877 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 109/223] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Jul 18 16:27:29 2022] GET /identity/v3/projects/7f680cc460584bf688dae550c6a46776 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:29.428406 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2832190-faf5-4df2-ab75-c866f19e7d38 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:29.496483 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:29.528511 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 115/224] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Jul 18 16:27:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:27:29.528511 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043a77e-09e6-4135-92f0-734425af2c89 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:29.528511 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043a77e-09e6-4135-92f0-734425af2c89 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:29.528511 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043a77e-09e6-4135-92f0-734425af2c89 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:29.530920 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 116/225] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:27:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:27:29.537296 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44a4d0-86f4-4b24-801b-4d08f75e0ae0 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:29.537582 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44a4d0-86f4-4b24-801b-4d08f75e0ae0 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:29.537976 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44a4d0-86f4-4b24-801b-4d08f75e0ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:29.557889 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-af44a4d0-86f4-4b24-801b-4d08f75e0ae0 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:27:29.559476 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-af44a4d0-86f4-4b24-801b-4d08f75e0ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:27:29.571980 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2832190-faf5-4df2-ab75-c866f19e7d38 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:29.587044 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:29.612891 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6277172-0647-4d0a-baaa-a728be7bece4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:29.613838 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6277172-0647-4d0a-baaa-a728be7bece4 None admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:29.614514 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6277172-0647-4d0a-baaa-a728be7bece4 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:29.614514 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6277172-0647-4d0a-baaa-a728be7bece4 None admin] PATH_INFO: `/v3/projects/7f680cc460584bf688dae550c6a46776/users/e5306078fd4a49849363cb121dd0ee4c/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:29.616467 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6277172-0647-4d0a-baaa-a728be7bece4 None admin] RBAC: Authorizing `identity:create_grant(project_id=7f680cc460584bf688dae550c6a46776, user_id=e5306078fd4a49849363cb121dd0ee4c, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:29.617874 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6277172-0647-4d0a-baaa-a728be7bece4 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:29.649640 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 117/226] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:27:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:27:29.650513 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af44a4d0-86f4-4b24-801b-4d08f75e0ae0 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:29.731608 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 110/227] 10.222.0.81 () {58 vars in 1439 bytes} [Mon Jul 18 16:27:29 2022] PUT /identity/v3/projects/7f680cc460584bf688dae550c6a46776/users/e5306078fd4a49849363cb121dd0ee4c/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:27:29.732588 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6277172-0647-4d0a-baaa-a728be7bece4 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:29.781220 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af44a4d0-86f4-4b24-801b-4d08f75e0ae0 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:29.874179 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaaaa7a-5791-4e41-8a8b-5b763b8a7e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:29.875661 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaaaa7a-5791-4e41-8a8b-5b763b8a7e74 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:29.875994 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaaaa7a-5791-4e41-8a8b-5b763b8a7e74 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:29.876265 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaaaa7a-5791-4e41-8a8b-5b763b8a7e74 None admin] PATH_INFO: `/v3/projects/7f680cc460584bf688dae550c6a46776` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:29.877598 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaaaa7a-5791-4e41-8a8b-5b763b8a7e74 None admin] RBAC: Authorizing `identity:get_project(project_id=7f680cc460584bf688dae550c6a46776)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:29.879198 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaaaa7a-5791-4e41-8a8b-5b763b8a7e74 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:29.881391 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 118/228] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Jul 18 16:27:29 2022] GET /identity/v3/projects/7f680cc460584bf688dae550c6a46776 => generated 302 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:29.894314 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaaaa7a-5791-4e41-8a8b-5b763b8a7e74 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:29.989355 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:29.997595 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6277172-0647-4d0a-baaa-a728be7bece4 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:30.010597 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:30.041019 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559f2d38-2eab-42fa-ac4e-df0b20e224f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:30.042307 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f2d38-2eab-42fa-ac4e-df0b20e224f3 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:30.042307 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f2d38-2eab-42fa-ac4e-df0b20e224f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:30.042550 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f2d38-2eab-42fa-ac4e-df0b20e224f3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:30.067941 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559f2d38-2eab-42fa-ac4e-df0b20e224f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:27:30.077353 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-559f2d38-2eab-42fa-ac4e-df0b20e224f3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 16:27:30.077353 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:27:30.077353 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:27:30.077353 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:27:30.077353 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:27:30.077353 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:27:30.077353 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:27:30.077353 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:27:30.077353 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:27:30.077353 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:27:30.077353 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:27:30.077353 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:27:30.077353 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:27:30.077353 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:27:30.077353 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:27:30.077353 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:27:30.078848 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:27:30.078848 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:27:30.078848 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:27:30.078848 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:27:30.078848 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:27:30.078848 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:27:30.078848 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:27:30.078848 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:27:30.078848 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:27:30.078848 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:27:30.078848 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:27:30.078848 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:27:30.078848 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:27:30.078848 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:27:30.078848 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:27:30.078848 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:27:30.079668 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:27:30.079668 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:27:30.079668 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:27:30.079668 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:27:30.079668 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:27:30.079668 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:27:30.079668 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:27:30.079668 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:27:30.079668 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:27:30.079668 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:27:30.079668 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 16:27:30.079668 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:27:30.079668 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 111/229] 10.222.0.81 () {56 vars in 1114 bytes} [Mon Jul 18 16:27:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:27:30.088776 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559f2d38-2eab-42fa-ac4e-df0b20e224f3 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:30.146834 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaaaa7a-5791-4e41-8a8b-5b763b8a7e74 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:30.221007 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559f2d38-2eab-42fa-ac4e-df0b20e224f3 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:30.234599 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c84dad-3b5d-446c-880c-c278da3fa4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:30.235665 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c84dad-3b5d-446c-880c-c278da3fa4f7 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:30.236178 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c84dad-3b5d-446c-880c-c278da3fa4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:30.236792 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c84dad-3b5d-446c-880c-c278da3fa4f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:30.239654 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c84dad-3b5d-446c-880c-c278da3fa4f7 None admin] RBAC: Adding query filter params (role.id=ad3a2bc7b2094a4da1a95a143c8d9436, scope.project.id=7f680cc460584bf688dae550c6a46776, user.id=c18a5449ca67465c93c7fb0e2efd1389) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:30.240254 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c84dad-3b5d-446c-880c-c278da3fa4f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:30.241953 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c84dad-3b5d-446c-880c-c278da3fa4f7 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:30.257813 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 119/230] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Jul 18 16:27:29 2022] GET /identity/v3/role_assignments?user.id=c18a5449ca67465c93c7fb0e2efd1389&scope.project.id=7f680cc460584bf688dae550c6a46776&role.id=ad3a2bc7b2094a4da1a95a143c8d9436 => generated 259 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:30.294355 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97000e62-b9b4-463e-9011-7df155df0795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:30.296137 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97000e62-b9b4-463e-9011-7df155df0795 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:30.296670 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97000e62-b9b4-463e-9011-7df155df0795 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:30.297148 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97000e62-b9b4-463e-9011-7df155df0795 None admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:30.298152 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97000e62-b9b4-463e-9011-7df155df0795 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:30.298684 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97000e62-b9b4-463e-9011-7df155df0795 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:30.300370 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97000e62-b9b4-463e-9011-7df155df0795 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:30.317105 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 112/231] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Jul 18 16:27:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:30.323248 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c84dad-3b5d-446c-880c-c278da3fa4f7 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:30.448410 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:30.461313 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c84dad-3b5d-446c-880c-c278da3fa4f7 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:30.500660 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e69be8-7082-46fd-9856-fc3d45e29de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:30.501556 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e69be8-7082-46fd-9856-fc3d45e29de2 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:30.505297 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e69be8-7082-46fd-9856-fc3d45e29de2 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:30.505572 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e69be8-7082-46fd-9856-fc3d45e29de2 None admin] PATH_INFO: `/v3/users/e5306078fd4a49849363cb121dd0ee4c` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:30.506897 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e69be8-7082-46fd-9856-fc3d45e29de2 None admin] RBAC: Authorizing `identity:get_user(user_id=e5306078fd4a49849363cb121dd0ee4c)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:30.508681 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e69be8-7082-46fd-9856-fc3d45e29de2 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:30.510693 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 120/232] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Jul 18 16:27:30 2022] GET /identity/v3/users/e5306078fd4a49849363cb121dd0ee4c => generated 283 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:30.516892 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97000e62-b9b4-463e-9011-7df155df0795 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:30.572759 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:30.675207 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97000e62-b9b4-463e-9011-7df155df0795 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:30.724571 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e4d1e-d39d-4aa1-abbd-58d1babc3c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:30.725810 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e4d1e-d39d-4aa1-abbd-58d1babc3c7d None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:30.726312 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e4d1e-d39d-4aa1-abbd-58d1babc3c7d None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:30.726803 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e4d1e-d39d-4aa1-abbd-58d1babc3c7d None admin] PATH_INFO: `/v3/projects/7f680cc460584bf688dae550c6a46776` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:30.728266 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912e4d1e-d39d-4aa1-abbd-58d1babc3c7d None admin] RBAC: Authorizing `identity:get_project(project_id=7f680cc460584bf688dae550c6a46776)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:30.730011 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912e4d1e-d39d-4aa1-abbd-58d1babc3c7d None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:30.732067 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 113/233] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Jul 18 16:27:30 2022] GET /identity/v3/projects/7f680cc460584bf688dae550c6a46776 => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:30.738353 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e69be8-7082-46fd-9856-fc3d45e29de2 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:30.873097 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e69be8-7082-46fd-9856-fc3d45e29de2 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:30.916396 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cf5dcd-5705-4d53-96a6-307f9c34aea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:30.917306 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf5dcd-5705-4d53-96a6-307f9c34aea0 None admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:30.917588 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf5dcd-5705-4d53-96a6-307f9c34aea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:30.917863 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf5dcd-5705-4d53-96a6-307f9c34aea0 None admin] PATH_INFO: `/v3/projects/7f680cc460584bf688dae550c6a46776/users/e5306078fd4a49849363cb121dd0ee4c/roles/6bfa001ddac347da894c7231f853c3df` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:30.920337 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cf5dcd-5705-4d53-96a6-307f9c34aea0 None admin] RBAC: Authorizing `identity:create_grant(project_id=7f680cc460584bf688dae550c6a46776, user_id=e5306078fd4a49849363cb121dd0ee4c, role_id=6bfa001ddac347da894c7231f853c3df)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:30.921889 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cf5dcd-5705-4d53-96a6-307f9c34aea0 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:31.060990 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 121/234] 10.222.0.81 () {58 vars in 1439 bytes} [Mon Jul 18 16:27:30 2022] PUT /identity/v3/projects/7f680cc460584bf688dae550c6a46776/users/e5306078fd4a49849363cb121dd0ee4c/roles/6bfa001ddac347da894c7231f853c3df => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:27:31.865881 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a020383e-0730-42d3-97f4-aa4b9a6f8e21 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:31.868222 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a020383e-0730-42d3-97f4-aa4b9a6f8e21 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:31.868729 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a020383e-0730-42d3-97f4-aa4b9a6f8e21 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:31.870418 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 114/235] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:27:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:27:31.876851 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196da57-8f3d-45d5-8b92-6cd0f85a7c10 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:31.877807 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196da57-8f3d-45d5-8b92-6cd0f85a7c10 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:31.878289 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196da57-8f3d-45d5-8b92-6cd0f85a7c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:31.904898 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-a196da57-8f3d-45d5-8b92-6cd0f85a7c10 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:27:31.906623 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-a196da57-8f3d-45d5-8b92-6cd0f85a7c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:27:31.919484 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:32.002783 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 122/236] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:27:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:27:32.021943 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06660d-e6c3-4ddd-8d96-5d1105e7cb97 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:32.022254 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06660d-e6c3-4ddd-8d96-5d1105e7cb97 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:32.022512 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06660d-e6c3-4ddd-8d96-5d1105e7cb97 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:32.024113 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 115/237] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:27:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:27:32.029529 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69debcd-c3bc-4c6a-971b-f8afb8a626be None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:32.029811 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69debcd-c3bc-4c6a-971b-f8afb8a626be None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:32.030089 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69debcd-c3bc-4c6a-971b-f8afb8a626be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:32.033506 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b06660d-e6c3-4ddd-8d96-5d1105e7cb97 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:32.059467 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-a69debcd-c3bc-4c6a-971b-f8afb8a626be None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:27:32.061763 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-a69debcd-c3bc-4c6a-971b-f8afb8a626be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:27:32.162138 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 123/238] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:27:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:27:32.187166 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69debcd-c3bc-4c6a-971b-f8afb8a626be None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:32.244210 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:32.253489 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b06660d-e6c3-4ddd-8d96-5d1105e7cb97 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:32.275327 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:32.301485 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69debcd-c3bc-4c6a-971b-f8afb8a626be None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:32.337885 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b39c1f-6427-4f87-8d6c-0334184a9f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:32.338709 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b39c1f-6427-4f87-8d6c-0334184a9f46 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:32.338990 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b39c1f-6427-4f87-8d6c-0334184a9f46 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:32.339262 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b39c1f-6427-4f87-8d6c-0334184a9f46 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:32.340696 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b39c1f-6427-4f87-8d6c-0334184a9f46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:32.342406 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b39c1f-6427-4f87-8d6c-0334184a9f46 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:32.350140 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 124/239] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:27:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:32.351265 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b39c1f-6427-4f87-8d6c-0334184a9f46 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:32.357025 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f0e0b-8b5d-495d-b731-05bb62f1fc59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:32.358443 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f0e0b-8b5d-495d-b731-05bb62f1fc59 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:32.359565 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f0e0b-8b5d-495d-b731-05bb62f1fc59 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:32.360250 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f0e0b-8b5d-495d-b731-05bb62f1fc59 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:32.375424 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8f0e0b-8b5d-495d-b731-05bb62f1fc59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:27:32.385300 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-df8f0e0b-8b5d-495d-b731-05bb62f1fc59 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 16:27:32.385300 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:27:32.385300 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:27:32.385300 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:27:32.385300 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:27:32.385300 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:27:32.385300 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:27:32.385300 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:27:32.385300 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:27:32.385300 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:27:32.385300 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:27:32.385300 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:27:32.385300 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:27:32.385300 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:27:32.385300 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:27:32.385300 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:27:32.386274 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:27:32.386274 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:27:32.386274 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:27:32.386274 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:27:32.386274 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:27:32.386274 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:27:32.386274 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:27:32.386274 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:27:32.386274 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:27:32.386274 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:27:32.386274 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:27:32.386274 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:27:32.386274 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:27:32.386274 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:27:32.386274 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:27:32.386274 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:27:32.387088 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:27:32.387088 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:27:32.387088 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:27:32.387088 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:27:32.387088 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:27:32.387088 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:27:32.387088 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:27:32.387088 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:27:32.387088 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:27:32.387088 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:27:32.387088 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 16:27:32.387088 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:27:32.389805 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 116/240] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Jul 18 16:27:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:27:32.397464 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f0e0b-8b5d-495d-b731-05bb62f1fc59 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:32.543109 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f0e0b-8b5d-495d-b731-05bb62f1fc59 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:32.602781 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b39c1f-6427-4f87-8d6c-0334184a9f46 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:32.608482 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f85e9a-9a6a-45d4-8314-9c931b6b7d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:32.609707 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f85e9a-9a6a-45d4-8314-9c931b6b7d26 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:32.609990 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f85e9a-9a6a-45d4-8314-9c931b6b7d26 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:32.610266 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f85e9a-9a6a-45d4-8314-9c931b6b7d26 None admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:32.611027 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f85e9a-9a6a-45d4-8314-9c931b6b7d26 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:32.611405 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f85e9a-9a6a-45d4-8314-9c931b6b7d26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:32.612902 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f85e9a-9a6a-45d4-8314-9c931b6b7d26 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:32.623028 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 117/241] 10.222.0.81 () {56 vars in 1101 bytes} [Mon Jul 18 16:27:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:32.624270 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf20e6-fb3d-4785-ad10-70c029a0bdb4 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:32.625168 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf20e6-fb3d-4785-ad10-70c029a0bdb4 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:32.625466 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf20e6-fb3d-4785-ad10-70c029a0bdb4 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:32.627120 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 118/242] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:27:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:27:32.632800 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf20e6-fb3d-4785-ad10-70c029a0bdb4 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:32.660297 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5ef58e-6215-4f6c-866e-1f5c3aadf50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:32.660985 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ef58e-6215-4f6c-866e-1f5c3aadf50d None admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:32.661268 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ef58e-6215-4f6c-866e-1f5c3aadf50d None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:32.661544 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ef58e-6215-4f6c-866e-1f5c3aadf50d None admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:32.662282 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5ef58e-6215-4f6c-866e-1f5c3aadf50d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:32.663777 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5ef58e-6215-4f6c-866e-1f5c3aadf50d None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:32.684531 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:32.763746 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:32.764386 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 125/243] 10.222.0.81 () {60 vars in 1132 bytes} [Mon Jul 18 16:27:32 2022] POST /identity/v3/users => generated 293 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:27:32.766162 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf855c7-ed8b-48cc-89a0-bd5845ae9b07 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:32.766773 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf855c7-ed8b-48cc-89a0-bd5845ae9b07 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:32.767193 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf855c7-ed8b-48cc-89a0-bd5845ae9b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:32.803590 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-5cf855c7-ed8b-48cc-89a0-bd5845ae9b07 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:27:32.805416 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf20e6-fb3d-4785-ad10-70c029a0bdb4 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:32.806552 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-5cf855c7-ed8b-48cc-89a0-bd5845ae9b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:27:32.862700 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e627d3-08bf-4d75-8af0-7728c38c0d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:32.863647 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e627d3-08bf-4d75-8af0-7728c38c0d91 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:32.863955 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e627d3-08bf-4d75-8af0-7728c38c0d91 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:32.864232 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e627d3-08bf-4d75-8af0-7728c38c0d91 None admin] PATH_INFO: `/v3/users/8a9e9f8ad8c148fbb1fb1772330616e4` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:32.914587 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e627d3-08bf-4d75-8af0-7728c38c0d91 None admin] RBAC: Authorizing `identity:get_user(user_id=8a9e9f8ad8c148fbb1fb1772330616e4)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:32.917004 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e627d3-08bf-4d75-8af0-7728c38c0d91 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:32.919854 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 119/244] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Jul 18 16:27:32 2022] GET /identity/v3/users/8a9e9f8ad8c148fbb1fb1772330616e4 => generated 297 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:32.921286 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880922d6-34dc-4197-91ca-828a1de17adf None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:32.922216 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880922d6-34dc-4197-91ca-828a1de17adf None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:32.922498 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880922d6-34dc-4197-91ca-828a1de17adf None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:32.924661 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 120/245] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:27:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:27:32.925456 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880922d6-34dc-4197-91ca-828a1de17adf None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:32.960903 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 126/246] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:27:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:27:32.963425 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2181ee2-48e4-4fe0-a89a-7ca0110d8f70 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:32.963828 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2181ee2-48e4-4fe0-a89a-7ca0110d8f70 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:32.964025 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2181ee2-48e4-4fe0-a89a-7ca0110d8f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:32.991272 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-d2181ee2-48e4-4fe0-a89a-7ca0110d8f70 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:27:32.993074 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-d2181ee2-48e4-4fe0-a89a-7ca0110d8f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:27:33.053964 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:33.080305 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880922d6-34dc-4197-91ca-828a1de17adf None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:33.095343 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 127/247] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:27:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:27:33.096637 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2181ee2-48e4-4fe0-a89a-7ca0110d8f70 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:33.135583 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d3356-d06b-40fc-9c63-0c764395c68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:33.136318 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d3356-d06b-40fc-9c63-0c764395c68a None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:33.136600 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d3356-d06b-40fc-9c63-0c764395c68a None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:33.136871 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d3356-d06b-40fc-9c63-0c764395c68a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:33.178233 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:33.230310 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504d3356-d06b-40fc-9c63-0c764395c68a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:33.232171 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504d3356-d06b-40fc-9c63-0c764395c68a None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:33.237561 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2181ee2-48e4-4fe0-a89a-7ca0110d8f70 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:33.300474 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ebe8a-885f-4ddb-a6d6-316157717756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:33.301286 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ebe8a-885f-4ddb-a6d6-316157717756 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:33.301565 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ebe8a-885f-4ddb-a6d6-316157717756 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:33.301838 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ebe8a-885f-4ddb-a6d6-316157717756 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:33.330344 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944ebe8a-885f-4ddb-a6d6-316157717756 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:27:33.341625 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:33.348250 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-944ebe8a-885f-4ddb-a6d6-316157717756 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:27:33.348250 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:27:33.348250 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:27:33.348250 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:27:33.348250 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:27:33.348250 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:27:33.348250 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:27:33.348250 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:27:33.348250 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:27:33.348250 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:27:33.348250 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:27:33.348250 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:27:33.348250 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:27:33.348250 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:27:33.348250 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:27:33.348250 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:27:33.349681 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:27:33.349681 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:27:33.349681 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:27:33.349681 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:27:33.349681 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:27:33.349681 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:27:33.349681 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:27:33.349681 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:27:33.349681 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:27:33.349681 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:27:33.349681 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:27:33.349681 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:27:33.349681 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:27:33.349681 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:27:33.349681 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:27:33.349681 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:27:33.356467 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:27:33.356467 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:27:33.356467 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:27:33.356467 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:27:33.356467 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:27:33.356467 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:27:33.356467 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:27:33.356467 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:27:33.356467 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:27:33.356467 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:27:33.356467 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:27:33.356467 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:27:33.356467 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 128/248] 10.222.0.81 () {56 vars in 1096 bytes} [Mon Jul 18 16:27:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:27:33.356467 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ebe8a-885f-4ddb-a6d6-316157717756 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:33.378684 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 121/249] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Jul 18 16:27:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:27:33.380092 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d3356-d06b-40fc-9c63-0c764395c68a None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:33.480419 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ebe8a-885f-4ddb-a6d6-316157717756 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:33.511652 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:33.519987 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e6efcb-942c-4cb9-b1a6-64978e08b308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:33.521123 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e6efcb-942c-4cb9-b1a6-64978e08b308 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:33.521592 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e6efcb-942c-4cb9-b1a6-64978e08b308 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:33.522044 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e6efcb-942c-4cb9-b1a6-64978e08b308 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:33.541905 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e6efcb-942c-4cb9-b1a6-64978e08b308 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:27:33.550808 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-03e6efcb-942c-4cb9-b1a6-64978e08b308 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 16:27:33.550808 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:27:33.550808 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:27:33.550808 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:27:33.550808 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:27:33.550808 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:27:33.550808 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:27:33.550808 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:27:33.550808 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:27:33.550808 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:27:33.550808 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:27:33.550808 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:27:33.550808 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:27:33.550808 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:27:33.550808 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:27:33.550808 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:27:33.551805 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:27:33.551805 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:27:33.551805 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:27:33.551805 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:27:33.551805 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:27:33.551805 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:27:33.551805 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:27:33.551805 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:27:33.551805 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:27:33.551805 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:27:33.551805 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:27:33.551805 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:27:33.551805 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:27:33.551805 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:27:33.551805 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:27:33.551805 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:27:33.552651 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:27:33.552651 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:27:33.552651 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:27:33.552651 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:27:33.552651 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:27:33.552651 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:27:33.552651 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:27:33.552651 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:27:33.552651 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:27:33.552651 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:27:33.552651 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 16:27:33.552651 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:27:33.556795 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d3356-d06b-40fc-9c63-0c764395c68a None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:33.567217 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 129/250] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Jul 18 16:27:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:27:33.568397 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e6efcb-942c-4cb9-b1a6-64978e08b308 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:33.612328 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bd741f-7e68-4da7-bbd0-2f4aefe7f3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:33.613864 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd741f-7e68-4da7-bbd0-2f4aefe7f3d2 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:33.613864 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd741f-7e68-4da7-bbd0-2f4aefe7f3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:33.613864 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd741f-7e68-4da7-bbd0-2f4aefe7f3d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:33.614509 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bd741f-7e68-4da7-bbd0-2f4aefe7f3d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:33.614877 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bd741f-7e68-4da7-bbd0-2f4aefe7f3d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:33.616370 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bd741f-7e68-4da7-bbd0-2f4aefe7f3d2 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:33.639446 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 122/251] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Jul 18 16:27:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:33.641078 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bd741f-7e68-4da7-bbd0-2f4aefe7f3d2 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:33.685500 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e6efcb-942c-4cb9-b1a6-64978e08b308 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:33.730053 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc15f9e-05c8-4f0e-a896-3849376fbf17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:33.731389 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc15f9e-05c8-4f0e-a896-3849376fbf17 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:33.731944 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc15f9e-05c8-4f0e-a896-3849376fbf17 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:33.732406 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc15f9e-05c8-4f0e-a896-3849376fbf17 None admin] PATH_INFO: `/v3/projects/7f680cc460584bf688dae550c6a46776` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:33.734097 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc15f9e-05c8-4f0e-a896-3849376fbf17 None admin] RBAC: Authorizing `identity:get_project(project_id=7f680cc460584bf688dae550c6a46776)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:33.735896 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:33.736128 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc15f9e-05c8-4f0e-a896-3849376fbf17 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:33.738224 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 130/252] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Jul 18 16:27:33 2022] GET /identity/v3/projects/7f680cc460584bf688dae550c6a46776 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:33.739353 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc15f9e-05c8-4f0e-a896-3849376fbf17 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:33.811809 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:33.835877 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bd741f-7e68-4da7-bbd0-2f4aefe7f3d2 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:33.856969 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc15f9e-05c8-4f0e-a896-3849376fbf17 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:33.886957 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f07ae1c-3004-492b-ad44-34d93baea55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:33.888118 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07ae1c-3004-492b-ad44-34d93baea55b None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:33.888616 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07ae1c-3004-492b-ad44-34d93baea55b None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:33.889095 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07ae1c-3004-492b-ad44-34d93baea55b None admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:33.890745 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f07ae1c-3004-492b-ad44-34d93baea55b None admin] RBAC: Adding query filter params (name=member) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:33.891303 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f07ae1c-3004-492b-ad44-34d93baea55b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:33.893083 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f07ae1c-3004-492b-ad44-34d93baea55b None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:33.900883 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3f00b7-0052-4f47-9513-e4a01e5d3add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:33.902181 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f00b7-0052-4f47-9513-e4a01e5d3add None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:33.902704 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f00b7-0052-4f47-9513-e4a01e5d3add None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:33.903198 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f00b7-0052-4f47-9513-e4a01e5d3add None admin] PATH_INFO: `/v3/users/e5306078fd4a49849363cb121dd0ee4c` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:33.904910 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3f00b7-0052-4f47-9513-e4a01e5d3add None admin] RBAC: Authorizing `identity:get_user(user_id=e5306078fd4a49849363cb121dd0ee4c)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:33.905508 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 123/253] 10.222.0.81 () {56 vars in 1101 bytes} [Mon Jul 18 16:27:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:33.907124 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f07ae1c-3004-492b-ad44-34d93baea55b None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:33.916982 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3f00b7-0052-4f47-9513-e4a01e5d3add None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:33.916982 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 131/254] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Jul 18 16:27:33 2022] GET /identity/v3/users/e5306078fd4a49849363cb121dd0ee4c => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:33.916982 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30296b0-b380-43df-9f33-fb4f9b864643 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:33.916982 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30296b0-b380-43df-9f33-fb4f9b864643 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:33.916982 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30296b0-b380-43df-9f33-fb4f9b864643 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:33.916982 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 132/255] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:27:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:27:33.917484 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30296b0-b380-43df-9f33-fb4f9b864643 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:34.029502 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f07ae1c-3004-492b-ad44-34d93baea55b None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:34.032156 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:34.042600 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30296b0-b380-43df-9f33-fb4f9b864643 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:34.072314 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:34.084096 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce36678-8aa8-4f5c-8f15-e7a9e66a8076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:34.084505 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b901a28-ccb2-4c3e-a870-36e6ab95fbf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:34.085074 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b901a28-ccb2-4c3e-a870-36e6ab95fbf0 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:34.085353 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b901a28-ccb2-4c3e-a870-36e6ab95fbf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:34.085627 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b901a28-ccb2-4c3e-a870-36e6ab95fbf0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:34.086004 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce36678-8aa8-4f5c-8f15-e7a9e66a8076 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:34.086457 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b901a28-ccb2-4c3e-a870-36e6ab95fbf0 None admin] RBAC: Adding query filter params (role.id=2d721f61e3334102a57d236346c17850, scope.project.id=7f680cc460584bf688dae550c6a46776, user.id=8a9e9f8ad8c148fbb1fb1772330616e4) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:34.086705 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce36678-8aa8-4f5c-8f15-e7a9e66a8076 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:34.086806 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b901a28-ccb2-4c3e-a870-36e6ab95fbf0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:34.087312 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce36678-8aa8-4f5c-8f15-e7a9e66a8076 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:34.088392 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b901a28-ccb2-4c3e-a870-36e6ab95fbf0 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:34.095057 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 124/256] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Jul 18 16:27:33 2022] GET /identity/v3/role_assignments?user.id=8a9e9f8ad8c148fbb1fb1772330616e4&scope.project.id=7f680cc460584bf688dae550c6a46776&role.id=2d721f61e3334102a57d236346c17850 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:34.097081 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b901a28-ccb2-4c3e-a870-36e6ab95fbf0 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:34.182086 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce36678-8aa8-4f5c-8f15-e7a9e66a8076 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:34.184268 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce36678-8aa8-4f5c-8f15-e7a9e66a8076 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:34.228345 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b901a28-ccb2-4c3e-a870-36e6ab95fbf0 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:34.275323 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603eaf32-6394-45c2-8874-3861c9c58d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:34.276260 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603eaf32-6394-45c2-8874-3861c9c58d26 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:34.276545 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603eaf32-6394-45c2-8874-3861c9c58d26 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:34.276816 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603eaf32-6394-45c2-8874-3861c9c58d26 None admin] PATH_INFO: `/v3/users/c18a5449ca67465c93c7fb0e2efd1389` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:34.278176 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603eaf32-6394-45c2-8874-3861c9c58d26 None admin] RBAC: Authorizing `identity:get_user(user_id=c18a5449ca67465c93c7fb0e2efd1389)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:34.279690 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603eaf32-6394-45c2-8874-3861c9c58d26 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:34.281515 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 125/257] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Jul 18 16:27:34 2022] GET /identity/v3/users/c18a5449ca67465c93c7fb0e2efd1389 => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:34.287464 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f660910-469b-4fe8-8896-8b3100a2a193 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:34.287843 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f660910-469b-4fe8-8896-8b3100a2a193 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:34.288126 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f660910-469b-4fe8-8896-8b3100a2a193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:34.322193 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-4f660910-469b-4fe8-8896-8b3100a2a193 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:27:34.323533 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-4f660910-469b-4fe8-8896-8b3100a2a193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:27:34.325869 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 133/258] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Jul 18 16:27:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:27:34.327122 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce36678-8aa8-4f5c-8f15-e7a9e66a8076 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:34.360376 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:34.370673 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:34.415422 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 126/259] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:27:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:27:34.420883 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f660910-469b-4fe8-8896-8b3100a2a193 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:34.477704 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce36678-8aa8-4f5c-8f15-e7a9e66a8076 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:34.581009 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2601c2-0be4-45fd-b893-681807afdd07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:34.582489 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2601c2-0be4-45fd-b893-681807afdd07 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:34.582964 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2601c2-0be4-45fd-b893-681807afdd07 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:34.583311 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2601c2-0be4-45fd-b893-681807afdd07 None admin] PATH_INFO: `/v3/projects/7f680cc460584bf688dae550c6a46776` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:34.588792 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2601c2-0be4-45fd-b893-681807afdd07 None admin] RBAC: Authorizing `identity:get_project(project_id=7f680cc460584bf688dae550c6a46776)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:34.590469 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2601c2-0be4-45fd-b893-681807afdd07 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:34.592779 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 134/260] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Jul 18 16:27:34 2022] GET /identity/v3/projects/7f680cc460584bf688dae550c6a46776 => generated 302 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:34.594277 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2601c2-0be4-45fd-b893-681807afdd07 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:34.598296 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f660910-469b-4fe8-8896-8b3100a2a193 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:34.716336 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:34.720802 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1875ce5b-fa57-4ccd-b109-f2238e4046ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:34.721986 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1875ce5b-fa57-4ccd-b109-f2238e4046ec None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:34.722424 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1875ce5b-fa57-4ccd-b109-f2238e4046ec None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:34.722732 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1875ce5b-fa57-4ccd-b109-f2238e4046ec None admin] PATH_INFO: `/v3/projects/7f680cc460584bf688dae550c6a46776` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:34.723386 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2601c2-0be4-45fd-b893-681807afdd07 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:34.728856 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1875ce5b-fa57-4ccd-b109-f2238e4046ec None admin] RBAC: Authorizing `identity:get_project(project_id=7f680cc460584bf688dae550c6a46776)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:34.737262 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1875ce5b-fa57-4ccd-b109-f2238e4046ec None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:34.737262 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 127/261] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Jul 18 16:27:34 2022] GET /identity/v3/projects/7f680cc460584bf688dae550c6a46776 => generated 302 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:34.737262 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1875ce5b-fa57-4ccd-b109-f2238e4046ec None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:34.763402 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3595c-ba3e-4963-9370-171b76a3bda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:34.764666 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3595c-ba3e-4963-9370-171b76a3bda7 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:34.765718 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3595c-ba3e-4963-9370-171b76a3bda7 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:34.766202 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3595c-ba3e-4963-9370-171b76a3bda7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:34.779166 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e3595c-ba3e-4963-9370-171b76a3bda7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:27:34.789037 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-f8e3595c-ba3e-4963-9370-171b76a3bda7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 16:27:34.789037 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:27:34.789037 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:27:34.789037 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:27:34.789037 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:27:34.789037 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:27:34.789037 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:27:34.789037 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:27:34.789037 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:27:34.789037 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:27:34.789037 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:27:34.789037 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:27:34.789037 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:27:34.789037 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:27:34.789037 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:27:34.789037 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:27:34.790036 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:27:34.790036 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:27:34.790036 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:27:34.790036 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:27:34.790036 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:27:34.790036 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:27:34.790036 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:27:34.790036 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:27:34.790036 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:27:34.790036 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:27:34.790036 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:27:34.790036 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:27:34.790036 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:27:34.790036 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:27:34.790036 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:27:34.790036 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:27:34.790915 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:27:34.790915 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:27:34.790915 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:27:34.790915 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:27:34.790915 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:27:34.790915 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:27:34.790915 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:27:34.790915 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:27:34.790915 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:27:34.790915 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:27:34.790915 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 16:27:34.790915 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:27:34.793858 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 135/262] 10.222.0.81 () {56 vars in 1114 bytes} [Mon Jul 18 16:27:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:27:34.795109 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3595c-ba3e-4963-9370-171b76a3bda7 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:34.860637 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:34.965369 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3595c-ba3e-4963-9370-171b76a3bda7 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:34.985460 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1875ce5b-fa57-4ccd-b109-f2238e4046ec None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:35.006415 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a55a713-741c-4f2a-8cc0-b9ac702682dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:35.007096 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55a713-741c-4f2a-8cc0-b9ac702682dc None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:35.007380 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55a713-741c-4f2a-8cc0-b9ac702682dc None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:35.007659 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55a713-741c-4f2a-8cc0-b9ac702682dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:35.008802 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a55a713-741c-4f2a-8cc0-b9ac702682dc None admin] RBAC: Adding query filter params (role.id=fd83eab44cb343a2b532ce32a2ac31d8, scope.project.id=7f680cc460584bf688dae550c6a46776, user.id=e5306078fd4a49849363cb121dd0ee4c) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:35.009116 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a55a713-741c-4f2a-8cc0-b9ac702682dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:35.010595 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a55a713-741c-4f2a-8cc0-b9ac702682dc None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:35.026092 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 136/263] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Jul 18 16:27:34 2022] GET /identity/v3/role_assignments?user.id=e5306078fd4a49849363cb121dd0ee4c&scope.project.id=7f680cc460584bf688dae550c6a46776&role.id=fd83eab44cb343a2b532ce32a2ac31d8 => generated 608 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:35.026962 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a55a713-741c-4f2a-8cc0-b9ac702682dc None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:35.060104 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:35.064442 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de3c88-474e-4572-8559-54dc3f00fc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:35.065361 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de3c88-474e-4572-8559-54dc3f00fc9a None admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:35.065641 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de3c88-474e-4572-8559-54dc3f00fc9a None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:35.065914 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de3c88-474e-4572-8559-54dc3f00fc9a None admin] PATH_INFO: `/v3/projects/7f680cc460584bf688dae550c6a46776/users/c18a5449ca67465c93c7fb0e2efd1389/roles/ad3a2bc7b2094a4da1a95a143c8d9436` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:35.073964 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9de3c88-474e-4572-8559-54dc3f00fc9a None admin] RBAC: Authorizing `identity:create_grant(project_id=7f680cc460584bf688dae550c6a46776, user_id=c18a5449ca67465c93c7fb0e2efd1389, role_id=ad3a2bc7b2094a4da1a95a143c8d9436)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:35.075458 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9de3c88-474e-4572-8559-54dc3f00fc9a None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:35.174441 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 128/264] 10.222.0.81 () {58 vars in 1439 bytes} [Mon Jul 18 16:27:34 2022] PUT /identity/v3/projects/7f680cc460584bf688dae550c6a46776/users/c18a5449ca67465c93c7fb0e2efd1389/roles/ad3a2bc7b2094a4da1a95a143c8d9436 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:27:35.228609 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a55a713-741c-4f2a-8cc0-b9ac702682dc None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:35.280175 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e292d1-d173-4c1a-9c59-caafc44e5304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:35.280792 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e292d1-d173-4c1a-9c59-caafc44e5304 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:35.281106 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e292d1-d173-4c1a-9c59-caafc44e5304 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:35.281382 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e292d1-d173-4c1a-9c59-caafc44e5304 None admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:35.282170 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e292d1-d173-4c1a-9c59-caafc44e5304 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:35.282478 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e292d1-d173-4c1a-9c59-caafc44e5304 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:35.284011 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e292d1-d173-4c1a-9c59-caafc44e5304 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:35.295838 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 137/265] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Jul 18 16:27:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:35.301901 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de3c88-474e-4572-8559-54dc3f00fc9a None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:35.434322 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:35.442616 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de3c88-474e-4572-8559-54dc3f00fc9a None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:35.506104 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb30422-caf6-4acf-9fd4-b35ba374cca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:35.507389 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb30422-caf6-4acf-9fd4-b35ba374cca4 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:35.507910 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb30422-caf6-4acf-9fd4-b35ba374cca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:35.508651 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb30422-caf6-4acf-9fd4-b35ba374cca4 None admin] PATH_INFO: `/v3/users/e5306078fd4a49849363cb121dd0ee4c` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:35.510164 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb30422-caf6-4acf-9fd4-b35ba374cca4 None admin] RBAC: Authorizing `identity:get_user(user_id=e5306078fd4a49849363cb121dd0ee4c)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:35.511979 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb30422-caf6-4acf-9fd4-b35ba374cca4 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:35.514462 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 129/266] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Jul 18 16:27:35 2022] GET /identity/v3/users/e5306078fd4a49849363cb121dd0ee4c => generated 283 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:35.520412 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e292d1-d173-4c1a-9c59-caafc44e5304 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:35.620169 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:35.670173 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e292d1-d173-4c1a-9c59-caafc44e5304 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:35.687673 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4621ea1c-c17f-4499-8233-82322cbb0a0f None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:35.688442 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4621ea1c-c17f-4499-8233-82322cbb0a0f None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:35.688988 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4621ea1c-c17f-4499-8233-82322cbb0a0f None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:35.691520 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 130/267] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:27:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:27:35.697991 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be784d9d-58f3-4c19-bce0-93ebde602d46 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:35.698388 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be784d9d-58f3-4c19-bce0-93ebde602d46 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:35.698567 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be784d9d-58f3-4c19-bce0-93ebde602d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:35.726808 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a962fcbd-64ff-4c6d-bf71-a687c73178dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:35.727932 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962fcbd-64ff-4c6d-bf71-a687c73178dd None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:35.728634 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962fcbd-64ff-4c6d-bf71-a687c73178dd None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:35.729165 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962fcbd-64ff-4c6d-bf71-a687c73178dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:35.734222 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-be784d9d-58f3-4c19-bce0-93ebde602d46 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:27:35.735477 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-be784d9d-58f3-4c19-bce0-93ebde602d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:27:35.835453 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a962fcbd-64ff-4c6d-bf71-a687c73178dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:35.836970 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a962fcbd-64ff-4c6d-bf71-a687c73178dd None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:35.859584 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 131/268] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:27:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 16:27:35.862258 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd1e381-15b7-48d2-8cdf-4ea722a04d5a None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:35.862763 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd1e381-15b7-48d2-8cdf-4ea722a04d5a None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:35.863497 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd1e381-15b7-48d2-8cdf-4ea722a04d5a None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:35.865804 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 132/269] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:27:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:27:35.873151 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561d722-b278-41f3-a972-f6a5d3de69b8 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:35.873772 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561d722-b278-41f3-a972-f6a5d3de69b8 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:35.873772 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561d722-b278-41f3-a972-f6a5d3de69b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:35.895912 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-b561d722-b278-41f3-a972-f6a5d3de69b8 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:27:35.897110 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-b561d722-b278-41f3-a972-f6a5d3de69b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:27:35.954225 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:35.986290 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 133/270] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:27:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:27:35.987391 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561d722-b278-41f3-a972-f6a5d3de69b8 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:36.009273 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 138/271] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Jul 18 16:27:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:27:36.015369 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:36.016770 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a962fcbd-64ff-4c6d-bf71-a687c73178dd None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:36.117373 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561d722-b278-41f3-a972-f6a5d3de69b8 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:36.152965 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a962fcbd-64ff-4c6d-bf71-a687c73178dd None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:36.170921 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672fdf94-4721-4853-b498-b94578ccd1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:36.172712 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672fdf94-4721-4853-b498-b94578ccd1ae None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:36.173162 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672fdf94-4721-4853-b498-b94578ccd1ae None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:36.173602 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672fdf94-4721-4853-b498-b94578ccd1ae None admin] PATH_INFO: `/v3/roles/member` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:36.200294 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672fdf94-4721-4853-b498-b94578ccd1ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:27:36.215641 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-672fdf94-4721-4853-b498-b94578ccd1ae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 16:27:36.215641 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:27:36.215641 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:27:36.215641 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:27:36.215641 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:27:36.215641 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:27:36.215641 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:27:36.215641 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:27:36.215641 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:27:36.215641 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:27:36.215641 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:27:36.215641 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:27:36.215641 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:27:36.215641 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:27:36.215641 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:27:36.215641 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:27:36.216641 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:27:36.216641 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:27:36.216641 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:27:36.216641 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:27:36.216641 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:27:36.216641 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:27:36.216641 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:27:36.216641 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:27:36.216641 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:27:36.216641 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:27:36.216641 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:27:36.216641 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:27:36.216641 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:27:36.216641 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:27:36.216641 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:27:36.216641 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:27:36.217457 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:27:36.217457 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:27:36.217457 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:27:36.217457 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:27:36.217457 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:27:36.217457 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:27:36.217457 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:27:36.217457 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:27:36.217457 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:27:36.217457 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:27:36.217457 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 16:27:36.217457 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:27:36.218631 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 134/272] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Jul 18 16:27:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:27:36.223690 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672fdf94-4721-4853-b498-b94578ccd1ae None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:36.228662 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73483e00-f1ea-44a9-8118-e8eb6fc4a109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:36.229726 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73483e00-f1ea-44a9-8118-e8eb6fc4a109 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:36.230150 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73483e00-f1ea-44a9-8118-e8eb6fc4a109 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:36.230564 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73483e00-f1ea-44a9-8118-e8eb6fc4a109 None admin] PATH_INFO: `/v3/projects/7f680cc460584bf688dae550c6a46776` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:36.232496 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73483e00-f1ea-44a9-8118-e8eb6fc4a109 None admin] RBAC: Authorizing `identity:get_project(project_id=7f680cc460584bf688dae550c6a46776)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:36.235495 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73483e00-f1ea-44a9-8118-e8eb6fc4a109 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:36.238866 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 139/273] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Jul 18 16:27:36 2022] GET /identity/v3/projects/7f680cc460584bf688dae550c6a46776 => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:36.240003 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73483e00-f1ea-44a9-8118-e8eb6fc4a109 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:36.296203 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:36.335510 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:36.366150 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672fdf94-4721-4853-b498-b94578ccd1ae None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:36.375831 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73483e00-f1ea-44a9-8118-e8eb6fc4a109 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:36.424669 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449212ef-37e8-413d-8e76-9f35ea2582d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:36.425775 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449212ef-37e8-413d-8e76-9f35ea2582d0 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:36.426205 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449212ef-37e8-413d-8e76-9f35ea2582d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:36.426641 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449212ef-37e8-413d-8e76-9f35ea2582d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:36.427140 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3592ff2-43ff-4674-8a93-b69f33c6dd0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:36.427748 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449212ef-37e8-413d-8e76-9f35ea2582d0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:36.428212 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3592ff2-43ff-4674-8a93-b69f33c6dd0e None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:36.428324 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449212ef-37e8-413d-8e76-9f35ea2582d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:36.428657 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3592ff2-43ff-4674-8a93-b69f33c6dd0e None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:36.429024 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3592ff2-43ff-4674-8a93-b69f33c6dd0e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:36.430195 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449212ef-37e8-413d-8e76-9f35ea2582d0 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:36.430427 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3592ff2-43ff-4674-8a93-b69f33c6dd0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:36.432286 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3592ff2-43ff-4674-8a93-b69f33c6dd0e None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:36.434297 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 135/274] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:27:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:36.435358 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3592ff2-43ff-4674-8a93-b69f33c6dd0e None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:36.442074 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 140/275] 10.222.0.81 () {56 vars in 1101 bytes} [Mon Jul 18 16:27:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:36.447542 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449212ef-37e8-413d-8e76-9f35ea2582d0 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:36.560143 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3592ff2-43ff-4674-8a93-b69f33c6dd0e None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:36.570785 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:36.573748 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449212ef-37e8-413d-8e76-9f35ea2582d0 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:36.603532 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36092337-7aff-4d96-8c21-163753ef9138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:36.604627 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36092337-7aff-4d96-8c21-163753ef9138 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:36.605108 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36092337-7aff-4d96-8c21-163753ef9138 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:36.606649 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36092337-7aff-4d96-8c21-163753ef9138 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:36.607752 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36092337-7aff-4d96-8c21-163753ef9138 None admin] RBAC: Adding query filter params (role.id=6bfa001ddac347da894c7231f853c3df, scope.project.id=7f680cc460584bf688dae550c6a46776, user.id=e5306078fd4a49849363cb121dd0ee4c) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:36.608295 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36092337-7aff-4d96-8c21-163753ef9138 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:36.610164 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36092337-7aff-4d96-8c21-163753ef9138 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:36.614435 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc9dd61-7fae-487b-8a7c-9d4219994042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:36.615121 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc9dd61-7fae-487b-8a7c-9d4219994042 None admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:36.615403 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc9dd61-7fae-487b-8a7c-9d4219994042 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:36.615675 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc9dd61-7fae-487b-8a7c-9d4219994042 None admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:36.616518 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc9dd61-7fae-487b-8a7c-9d4219994042 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:36.617904 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc9dd61-7fae-487b-8a7c-9d4219994042 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:36.619253 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 136/276] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Jul 18 16:27:36 2022] GET /identity/v3/role_assignments?user.id=e5306078fd4a49849363cb121dd0ee4c&scope.project.id=7f680cc460584bf688dae550c6a46776&role.id=6bfa001ddac347da894c7231f853c3df => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:36.620412 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36092337-7aff-4d96-8c21-163753ef9138 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:36.654378 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:36.758834 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 141/277] 10.222.0.81 () {60 vars in 1132 bytes} [Mon Jul 18 16:27:36 2022] POST /identity/v3/users => generated 293 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:27:36.764688 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36092337-7aff-4d96-8c21-163753ef9138 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:36.800626 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639226c-63e7-430f-925a-e21d1f210061 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:36.800968 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639226c-63e7-430f-925a-e21d1f210061 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:36.801181 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639226c-63e7-430f-925a-e21d1f210061 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:36.802855 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 142/278] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:27:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:27:36.811048 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2eb40c-7d0f-43f7-953a-93e4e36b4a39 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:36.811543 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2eb40c-7d0f-43f7-953a-93e4e36b4a39 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:36.812454 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2eb40c-7d0f-43f7-953a-93e4e36b4a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:36.823424 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee44cd46-8f0f-4c06-9a2e-c0c3b644f6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:36.824742 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44cd46-8f0f-4c06-9a2e-c0c3b644f6e7 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:36.825228 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44cd46-8f0f-4c06-9a2e-c0c3b644f6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:36.825786 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44cd46-8f0f-4c06-9a2e-c0c3b644f6e7 None admin] PATH_INFO: `/v3/users/368b451d54984854b66fd1327afec277` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:36.837215 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-cd2eb40c-7d0f-43f7-953a-93e4e36b4a39 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:27:36.839027 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-cd2eb40c-7d0f-43f7-953a-93e4e36b4a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:27:36.849234 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee44cd46-8f0f-4c06-9a2e-c0c3b644f6e7 None admin] RBAC: Authorizing `identity:get_user(user_id=368b451d54984854b66fd1327afec277)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:36.851581 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee44cd46-8f0f-4c06-9a2e-c0c3b644f6e7 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:36.854372 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 137/279] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Jul 18 16:27:36 2022] GET /identity/v3/users/368b451d54984854b66fd1327afec277 => generated 293 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:36.860812 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee44cd46-8f0f-4c06-9a2e-c0c3b644f6e7 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:36.942221 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 143/280] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:27:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 16:27:36.962224 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:36.971257 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2eb40c-7d0f-43f7-953a-93e4e36b4a39 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:37.003070 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee44cd46-8f0f-4c06-9a2e-c0c3b644f6e7 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:37.048310 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc51e5d4-a954-4e35-8620-7e06b56fd78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:37.049397 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51e5d4-a954-4e35-8620-7e06b56fd78b None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:37.049746 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51e5d4-a954-4e35-8620-7e06b56fd78b None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:37.050114 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51e5d4-a954-4e35-8620-7e06b56fd78b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:37.051089 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc51e5d4-a954-4e35-8620-7e06b56fd78b None admin] RBAC: Adding query filter params (role.id=ad3a2bc7b2094a4da1a95a143c8d9436, user.id=368b451d54984854b66fd1327afec277, scope.system=all) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:37.051420 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc51e5d4-a954-4e35-8620-7e06b56fd78b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:37.053019 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc51e5d4-a954-4e35-8620-7e06b56fd78b None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:37.059828 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 138/281] 10.222.0.81 () {56 vars in 1308 bytes} [Mon Jul 18 16:27:36 2022] GET /identity/v3/role_assignments?user.id=368b451d54984854b66fd1327afec277&scope.system=all&role.id=ad3a2bc7b2094a4da1a95a143c8d9436 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:37.086477 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:37.110258 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2eb40c-7d0f-43f7-953a-93e4e36b4a39 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:37.173387 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7530ae-6d00-4e65-a223-d32b6f103d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:37.175440 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7530ae-6d00-4e65-a223-d32b6f103d31 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:37.175886 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7530ae-6d00-4e65-a223-d32b6f103d31 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:37.176348 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7530ae-6d00-4e65-a223-d32b6f103d31 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:37.192213 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7530ae-6d00-4e65-a223-d32b6f103d31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:27:37.200667 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-fd7530ae-6d00-4e65-a223-d32b6f103d31 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 16:27:37.200667 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:27:37.200667 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:27:37.200667 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:27:37.200667 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:27:37.200667 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:27:37.200667 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:27:37.200667 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:27:37.200667 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:27:37.200667 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:27:37.200667 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:27:37.200667 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:27:37.200667 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:27:37.200667 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:27:37.200667 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:27:37.200667 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:27:37.201645 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:27:37.201645 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:27:37.201645 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:27:37.201645 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:27:37.201645 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:27:37.201645 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:27:37.201645 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:27:37.201645 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:27:37.201645 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:27:37.201645 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:27:37.201645 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:27:37.201645 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:27:37.201645 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:27:37.201645 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:27:37.201645 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:27:37.201645 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:27:37.202531 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:27:37.202531 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:27:37.202531 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:27:37.202531 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:27:37.202531 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:27:37.202531 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:27:37.202531 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:27:37.202531 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:27:37.202531 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:27:37.202531 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:27:37.202531 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 16:27:37.202531 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:27:37.202531 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 144/282] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Jul 18 16:27:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:27:37.209189 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc51e5d4-a954-4e35-8620-7e06b56fd78b None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:37.332992 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc51e5d4-a954-4e35-8620-7e06b56fd78b None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:37.369361 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a9f997-0281-45a3-8e89-934307d4c616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:37.370046 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9f997-0281-45a3-8e89-934307d4c616 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:37.370333 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9f997-0281-45a3-8e89-934307d4c616 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:37.370611 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9f997-0281-45a3-8e89-934307d4c616 None admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:37.371366 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a9f997-0281-45a3-8e89-934307d4c616 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:37.371674 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a9f997-0281-45a3-8e89-934307d4c616 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:37.373163 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a9f997-0281-45a3-8e89-934307d4c616 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:37.375873 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:37.384020 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 139/283] 10.222.0.81 () {56 vars in 1101 bytes} [Mon Jul 18 16:27:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:37.390019 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7530ae-6d00-4e65-a223-d32b6f103d31 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:37.544750 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7530ae-6d00-4e65-a223-d32b6f103d31 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:37.601910 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d5679-4766-4a50-8cfb-7d17504161e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:37.603016 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d5679-4766-4a50-8cfb-7d17504161e9 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:37.603444 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d5679-4766-4a50-8cfb-7d17504161e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:37.603903 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d5679-4766-4a50-8cfb-7d17504161e9 None admin] PATH_INFO: `/v3/users/8a9e9f8ad8c148fbb1fb1772330616e4` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:37.605273 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7d5679-4766-4a50-8cfb-7d17504161e9 None admin] RBAC: Authorizing `identity:get_user(user_id=8a9e9f8ad8c148fbb1fb1772330616e4)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:37.606890 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7d5679-4766-4a50-8cfb-7d17504161e9 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:37.609631 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 145/284] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Jul 18 16:27:37 2022] GET /identity/v3/users/8a9e9f8ad8c148fbb1fb1772330616e4 => generated 297 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:27:37.614956 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a9f997-0281-45a3-8e89-934307d4c616 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:37.763789 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a9f997-0281-45a3-8e89-934307d4c616 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:37.817903 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feccea90-1640-4c03-bdd7-4c1f7b6f744b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:37.819034 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feccea90-1640-4c03-bdd7-4c1f7b6f744b None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:37.819462 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feccea90-1640-4c03-bdd7-4c1f7b6f744b None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:37.819901 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feccea90-1640-4c03-bdd7-4c1f7b6f744b None admin] PATH_INFO: `/v3/projects/7f680cc460584bf688dae550c6a46776` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:37.821332 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feccea90-1640-4c03-bdd7-4c1f7b6f744b None admin] RBAC: Authorizing `identity:get_project(project_id=7f680cc460584bf688dae550c6a46776)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:37.822946 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feccea90-1640-4c03-bdd7-4c1f7b6f744b None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:37.828655 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 140/285] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Jul 18 16:27:37 2022] GET /identity/v3/projects/7f680cc460584bf688dae550c6a46776 => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:37.834772 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d5679-4766-4a50-8cfb-7d17504161e9 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:37.859901 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:37.934272 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c65116-6497-4149-89f1-72313e328b71 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:37.934939 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c65116-6497-4149-89f1-72313e328b71 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:37.935417 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c65116-6497-4149-89f1-72313e328b71 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:37.937530 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 141/286] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:27:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:27:37.943339 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3650cf85-0452-40b0-963d-2e2c32395905 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:37.943946 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3650cf85-0452-40b0-963d-2e2c32395905 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:37.944470 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3650cf85-0452-40b0-963d-2e2c32395905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:37.974619 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-3650cf85-0452-40b0-963d-2e2c32395905 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:27:37.977280 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-3650cf85-0452-40b0-963d-2e2c32395905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:27:37.998155 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d5679-4766-4a50-8cfb-7d17504161e9 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:38.067876 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:38.076522 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de75a4d-4621-46a3-94c2-44af390dd8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:38.082214 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de75a4d-4621-46a3-94c2-44af390dd8a8 None admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:38.082340 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 142/287] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:27:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:27:38.082434 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de75a4d-4621-46a3-94c2-44af390dd8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:38.082434 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de75a4d-4621-46a3-94c2-44af390dd8a8 None admin] PATH_INFO: `/v3/projects/7f680cc460584bf688dae550c6a46776/users/8a9e9f8ad8c148fbb1fb1772330616e4/roles/2d721f61e3334102a57d236346c17850` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:38.082434 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de75a4d-4621-46a3-94c2-44af390dd8a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=7f680cc460584bf688dae550c6a46776, user_id=8a9e9f8ad8c148fbb1fb1772330616e4, role_id=2d721f61e3334102a57d236346c17850)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:38.082434 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de75a4d-4621-46a3-94c2-44af390dd8a8 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:38.117190 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3650cf85-0452-40b0-963d-2e2c32395905 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:38.201352 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 146/288] 10.222.0.81 () {58 vars in 1439 bytes} [Mon Jul 18 16:27:37 2022] PUT /identity/v3/projects/7f680cc460584bf688dae550c6a46776/users/8a9e9f8ad8c148fbb1fb1772330616e4/roles/2d721f61e3334102a57d236346c17850 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:27:38.243744 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3650cf85-0452-40b0-963d-2e2c32395905 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:38.286938 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568fe588-c456-4f1f-b6bd-fad022614ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:38.287935 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568fe588-c456-4f1f-b6bd-fad022614ced None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:38.288225 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568fe588-c456-4f1f-b6bd-fad022614ced None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:38.288506 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568fe588-c456-4f1f-b6bd-fad022614ced None admin] PATH_INFO: `/v3/roles/member` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:38.305718 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568fe588-c456-4f1f-b6bd-fad022614ced None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:27:38.314166 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-568fe588-c456-4f1f-b6bd-fad022614ced None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 16:27:38.314166 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:27:38.314166 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:27:38.314166 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:27:38.314166 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:27:38.314166 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:27:38.314166 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:27:38.314166 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:27:38.314166 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:27:38.314166 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:27:38.314166 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:27:38.314166 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:27:38.314166 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:27:38.314166 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:27:38.314166 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:27:38.314166 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:27:38.315163 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:27:38.315163 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:27:38.315163 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:27:38.315163 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:27:38.315163 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:27:38.315163 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:27:38.315163 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:27:38.315163 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:27:38.315163 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:27:38.315163 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:27:38.315163 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:27:38.315163 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:27:38.315163 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:27:38.315163 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:27:38.315163 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:27:38.315163 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:27:38.316045 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:27:38.316045 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:27:38.316045 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:27:38.316045 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:27:38.316045 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:27:38.316045 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:27:38.316045 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:27:38.316045 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:27:38.316045 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:27:38.316045 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:27:38.316045 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 16:27:38.316045 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:27:38.316045 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 143/289] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Jul 18 16:27:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:27:38.329234 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de75a4d-4621-46a3-94c2-44af390dd8a8 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:38.452261 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:38.482425 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de75a4d-4621-46a3-94c2-44af390dd8a8 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:38.519557 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0b74b4-a48f-4c71-aa77-f751410f9726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:38.520343 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b74b4-a48f-4c71-aa77-f751410f9726 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:38.520625 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b74b4-a48f-4c71-aa77-f751410f9726 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:38.520901 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b74b4-a48f-4c71-aa77-f751410f9726 None admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:38.521658 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0b74b4-a48f-4c71-aa77-f751410f9726 None admin] RBAC: Adding query filter params (name=member) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:38.521968 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0b74b4-a48f-4c71-aa77-f751410f9726 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:38.523381 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0b74b4-a48f-4c71-aa77-f751410f9726 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:38.533449 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 147/290] 10.222.0.81 () {56 vars in 1101 bytes} [Mon Jul 18 16:27:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:38.539096 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568fe588-c456-4f1f-b6bd-fad022614ced None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:38.616032 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:38.688519 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568fe588-c456-4f1f-b6bd-fad022614ced None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:38.738845 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dfd698-18ac-49fb-815d-12154d79b934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:38.739816 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dfd698-18ac-49fb-815d-12154d79b934 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:38.740098 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dfd698-18ac-49fb-815d-12154d79b934 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:38.740372 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dfd698-18ac-49fb-815d-12154d79b934 None admin] PATH_INFO: `/v3/users/c18a5449ca67465c93c7fb0e2efd1389` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:38.741588 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dfd698-18ac-49fb-815d-12154d79b934 None admin] RBAC: Authorizing `identity:get_user(user_id=c18a5449ca67465c93c7fb0e2efd1389)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:38.743128 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dfd698-18ac-49fb-815d-12154d79b934 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:38.745023 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 144/291] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Jul 18 16:27:38 2022] GET /identity/v3/users/c18a5449ca67465c93c7fb0e2efd1389 => generated 297 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:38.750531 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0b74b4-a48f-4c71-aa77-f751410f9726 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:38.863187 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0b74b4-a48f-4c71-aa77-f751410f9726 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:38.900911 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1107e3f7-4558-4b2c-9771-17c91e12766f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:38.901564 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107e3f7-4558-4b2c-9771-17c91e12766f None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:38.901845 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107e3f7-4558-4b2c-9771-17c91e12766f None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:38.902120 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107e3f7-4558-4b2c-9771-17c91e12766f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:38.905812 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:38.974486 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1107e3f7-4558-4b2c-9771-17c91e12766f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:38.976151 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1107e3f7-4558-4b2c-9771-17c91e12766f None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:39.083353 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 148/292] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Jul 18 16:27:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:27:39.089028 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dfd698-18ac-49fb-815d-12154d79b934 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:39.228076 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dfd698-18ac-49fb-815d-12154d79b934 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:39.262340 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:39.277533 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ff046b-d7a4-4442-bd56-5e8c1d141964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:39.278413 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff046b-d7a4-4442-bd56-5e8c1d141964 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:39.278690 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff046b-d7a4-4442-bd56-5e8c1d141964 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:39.281188 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff046b-d7a4-4442-bd56-5e8c1d141964 None admin] PATH_INFO: `/v3/projects/7f680cc460584bf688dae550c6a46776` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:39.281188 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ff046b-d7a4-4442-bd56-5e8c1d141964 None admin] RBAC: Authorizing `identity:get_project(project_id=7f680cc460584bf688dae550c6a46776)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:39.281809 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ff046b-d7a4-4442-bd56-5e8c1d141964 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:39.283690 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 145/293] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Jul 18 16:27:39 2022] GET /identity/v3/projects/7f680cc460584bf688dae550c6a46776 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:39.289435 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1107e3f7-4558-4b2c-9771-17c91e12766f None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:39.332098 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:39.409847 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1107e3f7-4558-4b2c-9771-17c91e12766f None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:39.447490 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b0a3dc-8aee-420a-929d-92cf07b947fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:39.448191 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b0a3dc-8aee-420a-929d-92cf07b947fa None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:39.448470 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b0a3dc-8aee-420a-929d-92cf07b947fa None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:39.448744 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b0a3dc-8aee-420a-929d-92cf07b947fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:39.449580 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b0a3dc-8aee-420a-929d-92cf07b947fa None admin] RBAC: Adding query filter params (role.id=ad3a2bc7b2094a4da1a95a143c8d9436, scope.project.id=7f680cc460584bf688dae550c6a46776, user.id=c18a5449ca67465c93c7fb0e2efd1389) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:39.449888 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b0a3dc-8aee-420a-929d-92cf07b947fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:39.451321 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b0a3dc-8aee-420a-929d-92cf07b947fa None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:39.466738 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 149/294] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Jul 18 16:27:39 2022] GET /identity/v3/role_assignments?user.id=c18a5449ca67465c93c7fb0e2efd1389&scope.project.id=7f680cc460584bf688dae550c6a46776&role.id=ad3a2bc7b2094a4da1a95a143c8d9436 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:39.725196 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2323b5-d926-4999-b0e3-5f540306e6c9 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:39.725909 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2323b5-d926-4999-b0e3-5f540306e6c9 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:39.726398 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2323b5-d926-4999-b0e3-5f540306e6c9 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:39.728153 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 146/295] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:27:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:27:39.734923 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86744657-674f-40a1-8eb8-a585668b48b3 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:39.735574 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86744657-674f-40a1-8eb8-a585668b48b3 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:39.736117 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86744657-674f-40a1-8eb8-a585668b48b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:39.755031 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-86744657-674f-40a1-8eb8-a585668b48b3 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:27:39.756604 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-86744657-674f-40a1-8eb8-a585668b48b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:27:39.764670 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d9308-4d89-4d75-bca0-7916557275e7 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:39.765302 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d9308-4d89-4d75-bca0-7916557275e7 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:39.765772 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d9308-4d89-4d75-bca0-7916557275e7 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:39.767449 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 147/296] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:27:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:27:39.784215 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280839ca-af63-42e3-889c-6ca0c07cfe83 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:39.784827 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280839ca-af63-42e3-889c-6ca0c07cfe83 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:39.785300 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280839ca-af63-42e3-889c-6ca0c07cfe83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:39.809250 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-280839ca-af63-42e3-889c-6ca0c07cfe83 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:27:39.810777 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-280839ca-af63-42e3-889c-6ca0c07cfe83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:27:39.849493 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 150/297] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:27:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:27:39.857968 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ffe4c8-cc2e-4971-adf9-4d7d9b152eb7 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:39.859897 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ffe4c8-cc2e-4971-adf9-4d7d9b152eb7 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:39.860209 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ffe4c8-cc2e-4971-adf9-4d7d9b152eb7 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:39.861791 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 151/298] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:27:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:27:39.867046 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96518a6c-8ad3-466e-b0e3-3c7319e9ebf1 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:39.868185 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96518a6c-8ad3-466e-b0e3-3c7319e9ebf1 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:39.868185 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96518a6c-8ad3-466e-b0e3-3c7319e9ebf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:39.892805 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-96518a6c-8ad3-466e-b0e3-3c7319e9ebf1 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:27:39.894681 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-96518a6c-8ad3-466e-b0e3-3c7319e9ebf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:27:39.918413 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 148/299] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:27:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:27:39.919365 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280839ca-af63-42e3-889c-6ca0c07cfe83 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:39.931927 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:39.986915 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 152/300] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:27:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 16:27:39.988344 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96518a6c-8ad3-466e-b0e3-3c7319e9ebf1 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:40.040839 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280839ca-af63-42e3-889c-6ca0c07cfe83 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:40.064035 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:40.075765 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f87419-dc97-4952-ac5c-d629fe7d20e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:40.076558 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f87419-dc97-4952-ac5c-d629fe7d20e0 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:40.079853 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f87419-dc97-4952-ac5c-d629fe7d20e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:40.079853 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f87419-dc97-4952-ac5c-d629fe7d20e0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:40.088116 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f87419-dc97-4952-ac5c-d629fe7d20e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:27:40.096460 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-b6f87419-dc97-4952-ac5c-d629fe7d20e0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 16:27:40.096460 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:27:40.096460 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:27:40.096460 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:27:40.096460 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:27:40.096460 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:27:40.096460 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:27:40.096460 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:27:40.096460 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:27:40.096460 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:27:40.096460 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:27:40.096460 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:27:40.096460 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:27:40.096460 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:27:40.096460 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:27:40.096460 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:27:40.097652 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:27:40.097652 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:27:40.097652 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:27:40.097652 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:27:40.097652 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:27:40.097652 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:27:40.097652 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:27:40.097652 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:27:40.097652 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:27:40.097652 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:27:40.097652 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:27:40.097652 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:27:40.097652 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:27:40.097652 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:27:40.097652 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:27:40.097652 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:27:40.098499 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:27:40.098499 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:27:40.098499 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:27:40.098499 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:27:40.098499 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:27:40.098499 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:27:40.098499 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:27:40.098499 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:27:40.098499 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:27:40.098499 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:27:40.098499 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 16:27:40.098499 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:27:40.098499 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 149/301] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Jul 18 16:27:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:27:40.098499 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f87419-dc97-4952-ac5c-d629fe7d20e0 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:40.108639 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96518a6c-8ad3-466e-b0e3-3c7319e9ebf1 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:40.162833 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93cd7b1-53c6-489b-acc6-b0d98bf77bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:40.163636 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93cd7b1-53c6-489b-acc6-b0d98bf77bb6 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:40.163964 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93cd7b1-53c6-489b-acc6-b0d98bf77bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:40.164238 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93cd7b1-53c6-489b-acc6-b0d98bf77bb6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:40.175263 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93cd7b1-53c6-489b-acc6-b0d98bf77bb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:27:40.183028 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-e93cd7b1-53c6-489b-acc6-b0d98bf77bb6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 16:27:40.183028 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:27:40.183028 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:27:40.183028 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:27:40.183028 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:27:40.183028 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:27:40.183028 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:27:40.183028 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:27:40.183028 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:27:40.183028 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:27:40.183028 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:27:40.183028 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:27:40.183028 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:27:40.183028 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:27:40.183028 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:27:40.183028 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:27:40.184055 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:27:40.184055 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:27:40.184055 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:27:40.184055 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:27:40.184055 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:27:40.184055 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:27:40.184055 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:27:40.184055 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:27:40.184055 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:27:40.184055 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:27:40.184055 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:27:40.184055 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:27:40.184055 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:27:40.184055 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:27:40.184055 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:27:40.184055 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:27:40.184881 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:27:40.184881 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:27:40.184881 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:27:40.184881 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:27:40.184881 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:27:40.184881 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:27:40.184881 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:27:40.184881 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:27:40.184881 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:27:40.184881 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:27:40.184881 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 16:27:40.184881 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:27:40.184881 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 153/302] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Jul 18 16:27:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:27:40.185660 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93cd7b1-53c6-489b-acc6-b0d98bf77bb6 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:40.213515 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:40.233685 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f87419-dc97-4952-ac5c-d629fe7d20e0 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:40.270073 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ec489-fa5c-4c8f-9cda-c5fd346a0f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:40.270867 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ec489-fa5c-4c8f-9cda-c5fd346a0f05 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:40.271056 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ec489-fa5c-4c8f-9cda-c5fd346a0f05 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:40.271327 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ec489-fa5c-4c8f-9cda-c5fd346a0f05 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:40.272542 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560ec489-fa5c-4c8f-9cda-c5fd346a0f05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:40.273980 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560ec489-fa5c-4c8f-9cda-c5fd346a0f05 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:40.275835 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 150/303] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:27:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:40.281484 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ec489-fa5c-4c8f-9cda-c5fd346a0f05 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:40.298459 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93cd7b1-53c6-489b-acc6-b0d98bf77bb6 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:40.336182 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9c6699-d1bb-4149-93b1-da5ff1612e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:40.336473 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:40.336991 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c6699-d1bb-4149-93b1-da5ff1612e45 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:40.337273 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c6699-d1bb-4149-93b1-da5ff1612e45 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:40.337547 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c6699-d1bb-4149-93b1-da5ff1612e45 None admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:40.338309 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9c6699-d1bb-4149-93b1-da5ff1612e45 None admin] RBAC: Adding query filter params (name=member) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:40.338610 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9c6699-d1bb-4149-93b1-da5ff1612e45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:40.340027 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9c6699-d1bb-4149-93b1-da5ff1612e45 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:40.349758 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 154/304] 10.222.0.81 () {56 vars in 1101 bytes} [Mon Jul 18 16:27:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:40.350972 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9c6699-d1bb-4149-93b1-da5ff1612e45 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:40.395739 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ec489-fa5c-4c8f-9cda-c5fd346a0f05 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:40.430361 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f378c7-45e7-4b9b-a838-42e3e5f3f184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:40.431042 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f378c7-45e7-4b9b-a838-42e3e5f3f184 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:40.431328 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f378c7-45e7-4b9b-a838-42e3e5f3f184 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:40.431670 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f378c7-45e7-4b9b-a838-42e3e5f3f184 None admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:40.432453 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f378c7-45e7-4b9b-a838-42e3e5f3f184 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:40.432760 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f378c7-45e7-4b9b-a838-42e3e5f3f184 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:40.434132 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f378c7-45e7-4b9b-a838-42e3e5f3f184 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:40.439882 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:40.444953 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 151/305] 10.222.0.81 () {56 vars in 1101 bytes} [Mon Jul 18 16:27:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:40.445638 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f378c7-45e7-4b9b-a838-42e3e5f3f184 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:40.467038 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9c6699-d1bb-4149-93b1-da5ff1612e45 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:40.523706 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023b1137-da6a-45ea-aab6-8ec3473bb8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:40.524528 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b1137-da6a-45ea-aab6-8ec3473bb8be None admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:40.524978 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b1137-da6a-45ea-aab6-8ec3473bb8be None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:40.525386 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b1137-da6a-45ea-aab6-8ec3473bb8be None admin] PATH_INFO: `/v3/groups` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:40.526314 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023b1137-da6a-45ea-aab6-8ec3473bb8be None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:40.528295 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023b1137-da6a-45ea-aab6-8ec3473bb8be None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:40.578757 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f378c7-45e7-4b9b-a838-42e3e5f3f184 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:40.592418 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:40.614263 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13edfad4-1580-4eb5-8516-e61a56cf1f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:40.615135 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13edfad4-1580-4eb5-8516-e61a56cf1f73 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:40.615412 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13edfad4-1580-4eb5-8516-e61a56cf1f73 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:40.615681 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13edfad4-1580-4eb5-8516-e61a56cf1f73 None admin] PATH_INFO: `/v3/users/368b451d54984854b66fd1327afec277` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:40.616929 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13edfad4-1580-4eb5-8516-e61a56cf1f73 None admin] RBAC: Authorizing `identity:get_user(user_id=368b451d54984854b66fd1327afec277)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:40.618368 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13edfad4-1580-4eb5-8516-e61a56cf1f73 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:40.620027 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 152/306] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Jul 18 16:27:40 2022] GET /identity/v3/users/368b451d54984854b66fd1327afec277 => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:40.620785 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13edfad4-1580-4eb5-8516-e61a56cf1f73 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:40.688749 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 155/307] 10.222.0.81 () {60 vars in 1134 bytes} [Mon Jul 18 16:27:40 2022] POST /identity/v3/groups => generated 229 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:27:40.689564 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023b1137-da6a-45ea-aab6-8ec3473bb8be None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:40.725929 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13edfad4-1580-4eb5-8516-e61a56cf1f73 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:40.779232 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03726478-763a-452e-bb25-6572a4a97785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:40.780133 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03726478-763a-452e-bb25-6572a4a97785 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:40.780453 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03726478-763a-452e-bb25-6572a4a97785 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:40.780728 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03726478-763a-452e-bb25-6572a4a97785 None admin] PATH_INFO: `/v3/users/0b4affb65c0d402c95272636ee95dee8` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:40.796956 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03726478-763a-452e-bb25-6572a4a97785 None admin] RBAC: Authorizing `identity:get_user(user_id=0b4affb65c0d402c95272636ee95dee8)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:40.798446 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03726478-763a-452e-bb25-6572a4a97785 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:40.800536 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 153/308] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Jul 18 16:27:40 2022] GET /identity/v3/users/0b4affb65c0d402c95272636ee95dee8 => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:40.801842 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f61bc2-9b5e-4cba-8ac1-2121c237047c None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:40.802138 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f61bc2-9b5e-4cba-8ac1-2121c237047c None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:40.802415 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f61bc2-9b5e-4cba-8ac1-2121c237047c None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:40.804034 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 154/309] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:27:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:27:40.806049 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f61bc2-9b5e-4cba-8ac1-2121c237047c None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:40.830866 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023b1137-da6a-45ea-aab6-8ec3473bb8be None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:40.856084 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:40.879752 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed0d83-c347-4ca8-91f5-e3af0584ca26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:40.880677 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed0d83-c347-4ca8-91f5-e3af0584ca26 None admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:40.880960 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed0d83-c347-4ca8-91f5-e3af0584ca26 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:40.881248 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed0d83-c347-4ca8-91f5-e3af0584ca26 None admin] PATH_INFO: `/v3/system/users/368b451d54984854b66fd1327afec277/roles/ad3a2bc7b2094a4da1a95a143c8d9436` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:40.882868 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfed0d83-c347-4ca8-91f5-e3af0584ca26 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=368b451d54984854b66fd1327afec277, role_id=ad3a2bc7b2094a4da1a95a143c8d9436)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:40.885418 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfed0d83-c347-4ca8-91f5-e3af0584ca26 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:40.923553 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f61bc2-9b5e-4cba-8ac1-2121c237047c None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:40.960700 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eed68f-8230-45f6-901e-eed50b44ab22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:40.961350 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eed68f-8230-45f6-901e-eed50b44ab22 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:40.961626 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eed68f-8230-45f6-901e-eed50b44ab22 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:40.961896 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eed68f-8230-45f6-901e-eed50b44ab22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:40.962721 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eed68f-8230-45f6-901e-eed50b44ab22 None admin] RBAC: Adding query filter params (role.id=2d721f61e3334102a57d236346c17850, user.id=0b4affb65c0d402c95272636ee95dee8, scope.system=all) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:40.963054 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eed68f-8230-45f6-901e-eed50b44ab22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:40.964502 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eed68f-8230-45f6-901e-eed50b44ab22 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:40.969820 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 155/310] 10.222.0.81 () {56 vars in 1308 bytes} [Mon Jul 18 16:27:40 2022] GET /identity/v3/role_assignments?user.id=0b4affb65c0d402c95272636ee95dee8&scope.system=all&role.id=2d721f61e3334102a57d236346c17850 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:40.972143 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9b012-cf90-40d6-86f3-0ec8169cdb80 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:40.972459 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9b012-cf90-40d6-86f3-0ec8169cdb80 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:40.972694 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9b012-cf90-40d6-86f3-0ec8169cdb80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:40.992069 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-44b9b012-cf90-40d6-86f3-0ec8169cdb80 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:27:40.993356 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-44b9b012-cf90-40d6-86f3-0ec8169cdb80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:27:41.055834 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 156/311] 10.222.0.81 () {58 vars in 1334 bytes} [Mon Jul 18 16:27:40 2022] PUT /identity/v3/system/users/368b451d54984854b66fd1327afec277/roles/ad3a2bc7b2094a4da1a95a143c8d9436 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:27:41.086365 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 156/312] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:27:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:27:41.110551 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed0d83-c347-4ca8-91f5-e3af0584ca26 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:41.121902 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:41.237663 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed0d83-c347-4ca8-91f5-e3af0584ca26 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:41.273033 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be36acc-f824-4070-bdff-f5f4adb280c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:41.273831 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be36acc-f824-4070-bdff-f5f4adb280c6 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:41.274105 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be36acc-f824-4070-bdff-f5f4adb280c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:41.274372 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be36acc-f824-4070-bdff-f5f4adb280c6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:41.285756 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be36acc-f824-4070-bdff-f5f4adb280c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:27:41.293635 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-9be36acc-f824-4070-bdff-f5f4adb280c6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 16:27:41.293635 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:27:41.293635 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:27:41.293635 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:27:41.293635 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:27:41.293635 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:27:41.293635 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:27:41.293635 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:27:41.293635 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:27:41.293635 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:27:41.293635 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:27:41.293635 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:27:41.293635 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:27:41.293635 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:27:41.293635 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:27:41.293635 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:27:41.294643 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:27:41.294643 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:27:41.294643 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:27:41.294643 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:27:41.294643 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:27:41.294643 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:27:41.294643 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:27:41.294643 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:27:41.294643 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:27:41.294643 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:27:41.294643 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:27:41.294643 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:27:41.294643 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:27:41.294643 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:27:41.294643 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:27:41.294643 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:27:41.295482 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:27:41.295482 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:27:41.295482 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:27:41.295482 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:27:41.295482 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:27:41.295482 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:27:41.295482 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:27:41.295482 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:27:41.295482 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:27:41.295482 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:27:41.295482 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 16:27:41.295482 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:27:41.295482 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 157/313] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Jul 18 16:27:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:27:41.304973 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b9b012-cf90-40d6-86f3-0ec8169cdb80 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:41.339939 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:41.419468 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b9b012-cf90-40d6-86f3-0ec8169cdb80 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:41.455463 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc70c3-fb56-4b1a-b3e7-6fd838bdfe88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:41.456184 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc70c3-fb56-4b1a-b3e7-6fd838bdfe88 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:41.456597 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc70c3-fb56-4b1a-b3e7-6fd838bdfe88 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:41.456945 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc70c3-fb56-4b1a-b3e7-6fd838bdfe88 None admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:41.457779 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bc70c3-fb56-4b1a-b3e7-6fd838bdfe88 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:41.458191 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bc70c3-fb56-4b1a-b3e7-6fd838bdfe88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:41.459658 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bc70c3-fb56-4b1a-b3e7-6fd838bdfe88 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:41.469887 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 157/314] 10.222.0.81 () {56 vars in 1101 bytes} [Mon Jul 18 16:27:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:41.475285 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be36acc-f824-4070-bdff-f5f4adb280c6 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:41.549211 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:41.583853 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be36acc-f824-4070-bdff-f5f4adb280c6 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:41.617799 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf104a-82c2-4b9f-95c3-ddab987d5362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:41.618593 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf104a-82c2-4b9f-95c3-ddab987d5362 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:41.618873 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf104a-82c2-4b9f-95c3-ddab987d5362 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:41.619146 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf104a-82c2-4b9f-95c3-ddab987d5362 None admin] PATH_INFO: `/v3/users/8a9e9f8ad8c148fbb1fb1772330616e4` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:41.620437 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acf104a-82c2-4b9f-95c3-ddab987d5362 None admin] RBAC: Authorizing `identity:get_user(user_id=8a9e9f8ad8c148fbb1fb1772330616e4)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:41.621893 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acf104a-82c2-4b9f-95c3-ddab987d5362 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:41.623831 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 158/315] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Jul 18 16:27:41 2022] GET /identity/v3/users/8a9e9f8ad8c148fbb1fb1772330616e4 => generated 297 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:41.632813 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc70c3-fb56-4b1a-b3e7-6fd838bdfe88 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:41.753691 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:41.761185 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc70c3-fb56-4b1a-b3e7-6fd838bdfe88 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:41.798870 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe5a7e-1e3d-4566-b13c-7795306ba047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:41.799586 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe5a7e-1e3d-4566-b13c-7795306ba047 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:41.799909 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe5a7e-1e3d-4566-b13c-7795306ba047 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:41.800190 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe5a7e-1e3d-4566-b13c-7795306ba047 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:41.879073 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfe5a7e-1e3d-4566-b13c-7795306ba047 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:41.880538 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfe5a7e-1e3d-4566-b13c-7795306ba047 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:41.982323 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:41.990111 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 158/316] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Jul 18 16:27:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:27:41.995668 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf104a-82c2-4b9f-95c3-ddab987d5362 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:42.109161 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf104a-82c2-4b9f-95c3-ddab987d5362 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:42.147397 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3e945b-928d-4da2-af70-d3e93201131d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:42.148606 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e945b-928d-4da2-af70-d3e93201131d None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:42.149069 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e945b-928d-4da2-af70-d3e93201131d None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:42.149525 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e945b-928d-4da2-af70-d3e93201131d None admin] PATH_INFO: `/v3/projects/7f680cc460584bf688dae550c6a46776` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:42.151048 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3e945b-928d-4da2-af70-d3e93201131d None admin] RBAC: Authorizing `identity:get_project(project_id=7f680cc460584bf688dae550c6a46776)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:42.152747 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3e945b-928d-4da2-af70-d3e93201131d None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:42.154986 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 159/317] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Jul 18 16:27:41 2022] GET /identity/v3/projects/7f680cc460584bf688dae550c6a46776 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:42.161821 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe5a7e-1e3d-4566-b13c-7795306ba047 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:42.271892 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe5a7e-1e3d-4566-b13c-7795306ba047 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:42.309853 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc30a5b-5afa-4834-8885-6b7526e3ad6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:42.311244 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc30a5b-5afa-4834-8885-6b7526e3ad6e None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:42.312321 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc30a5b-5afa-4834-8885-6b7526e3ad6e None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:42.312775 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc30a5b-5afa-4834-8885-6b7526e3ad6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:42.313828 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc30a5b-5afa-4834-8885-6b7526e3ad6e None admin] RBAC: Adding query filter params (role.id=2d721f61e3334102a57d236346c17850, scope.project.id=7f680cc460584bf688dae550c6a46776, user.id=8a9e9f8ad8c148fbb1fb1772330616e4) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:42.314320 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc30a5b-5afa-4834-8885-6b7526e3ad6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:42.315979 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc30a5b-5afa-4834-8885-6b7526e3ad6e None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:42.322782 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 159/318] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Jul 18 16:27:42 2022] GET /identity/v3/role_assignments?user.id=8a9e9f8ad8c148fbb1fb1772330616e4&scope.project.id=7f680cc460584bf688dae550c6a46776&role.id=2d721f61e3334102a57d236346c17850 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:42.901351 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c453b66-9a9d-4375-8dd0-6e03b440c4af None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:42.901872 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c453b66-9a9d-4375-8dd0-6e03b440c4af None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:42.901949 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c453b66-9a9d-4375-8dd0-6e03b440c4af None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:42.903601 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 160/319] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:27:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:27:42.909530 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4029f2-d1da-413d-965b-db09b434957a None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:42.909820 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4029f2-d1da-413d-965b-db09b434957a None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:42.910134 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4029f2-d1da-413d-965b-db09b434957a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:42.927425 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-cc4029f2-d1da-413d-965b-db09b434957a None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:27:42.928669 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-cc4029f2-d1da-413d-965b-db09b434957a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:27:42.984268 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:42.997749 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 160/320] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:27:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:27:43.021245 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c453b66-9a9d-4375-8dd0-6e03b440c4af None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:43.024297 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:43.112221 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ee343-6c28-4eae-930b-eab94e5c3a89 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:43.112537 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ee343-6c28-4eae-930b-eab94e5c3a89 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:43.112777 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ee343-6c28-4eae-930b-eab94e5c3a89 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:43.114319 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 161/321] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:27:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:27:43.119143 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da84719f-d61e-4cb6-b9ed-f71031785135 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:43.119427 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da84719f-d61e-4cb6-b9ed-f71031785135 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:43.119701 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da84719f-d61e-4cb6-b9ed-f71031785135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:43.128954 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c453b66-9a9d-4375-8dd0-6e03b440c4af None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:43.140544 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-da84719f-d61e-4cb6-b9ed-f71031785135 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:27:43.142059 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-da84719f-d61e-4cb6-b9ed-f71031785135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:27:43.168505 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e86b27-6926-4cfa-80de-99c565434150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:43.169237 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e86b27-6926-4cfa-80de-99c565434150 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:43.169495 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e86b27-6926-4cfa-80de-99c565434150 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:43.169763 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e86b27-6926-4cfa-80de-99c565434150 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:43.170964 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e86b27-6926-4cfa-80de-99c565434150 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:43.172450 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e86b27-6926-4cfa-80de-99c565434150 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:43.174257 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 161/322] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:27:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:43.180105 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e86b27-6926-4cfa-80de-99c565434150 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:43.223788 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 162/323] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:27:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 16:27:43.246613 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da84719f-d61e-4cb6-b9ed-f71031785135 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:43.264988 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:43.296287 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e86b27-6926-4cfa-80de-99c565434150 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:43.329388 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4f585-a76f-4022-b198-f72c898ea33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:43.330048 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4f585-a76f-4022-b198-f72c898ea33b None admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:43.330339 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4f585-a76f-4022-b198-f72c898ea33b None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:43.330604 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4f585-a76f-4022-b198-f72c898ea33b None admin] PATH_INFO: `/v3/groups` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:43.331290 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb4f585-a76f-4022-b198-f72c898ea33b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:43.332757 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb4f585-a76f-4022-b198-f72c898ea33b None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:43.346811 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da84719f-d61e-4cb6-b9ed-f71031785135 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:43.366854 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:43.384177 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc11411-5545-432a-b7e6-ce845a24b2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:43.385083 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc11411-5545-432a-b7e6-ce845a24b2ec None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:43.385361 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc11411-5545-432a-b7e6-ce845a24b2ec None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:43.385636 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc11411-5545-432a-b7e6-ce845a24b2ec None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:43.396290 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc11411-5545-432a-b7e6-ce845a24b2ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:27:43.404038 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-4bc11411-5545-432a-b7e6-ce845a24b2ec None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 16:27:43.404038 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:27:43.404038 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:27:43.404038 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:27:43.404038 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:27:43.404038 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:27:43.404038 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:27:43.404038 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:27:43.404038 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:27:43.404038 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:27:43.404038 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:27:43.404038 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:27:43.404038 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:27:43.404038 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:27:43.404038 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:27:43.404038 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:27:43.405008 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:27:43.405008 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:27:43.405008 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:27:43.405008 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:27:43.405008 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:27:43.405008 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:27:43.405008 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:27:43.405008 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:27:43.405008 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:27:43.405008 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:27:43.405008 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:27:43.405008 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:27:43.405008 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:27:43.405008 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:27:43.405008 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:27:43.405008 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:27:43.405853 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:27:43.405853 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:27:43.405853 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:27:43.405853 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:27:43.405853 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:27:43.405853 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:27:43.405853 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:27:43.405853 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:27:43.405853 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:27:43.405853 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:27:43.405853 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 16:27:43.405853 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:27:43.405853 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 163/324] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Jul 18 16:27:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:27:43.406685 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade5a29-2ad7-47e9-a2cc-9e8aadebb759 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:43.406957 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade5a29-2ad7-47e9-a2cc-9e8aadebb759 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:43.407227 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade5a29-2ad7-47e9-a2cc-9e8aadebb759 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:43.408527 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 164/325] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:27:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:27:43.411001 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade5a29-2ad7-47e9-a2cc-9e8aadebb759 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:43.509566 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade5a29-2ad7-47e9-a2cc-9e8aadebb759 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:43.544227 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcc2d9a-f62b-459f-b734-553d3177d7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:43.544894 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc2d9a-f62b-459f-b734-553d3177d7b1 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:43.545175 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc2d9a-f62b-459f-b734-553d3177d7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:43.545523 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc2d9a-f62b-459f-b734-553d3177d7b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:43.546295 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcc2d9a-f62b-459f-b734-553d3177d7b1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:43.546603 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcc2d9a-f62b-459f-b734-553d3177d7b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:43.548050 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcc2d9a-f62b-459f-b734-553d3177d7b1 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:43.556412 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 165/326] 10.222.0.81 () {56 vars in 1101 bytes} [Mon Jul 18 16:27:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:27:43.557708 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d14139c-9dd4-4d8e-8a00-fe73757ba86c None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:43.557993 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d14139c-9dd4-4d8e-8a00-fe73757ba86c None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:43.558269 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d14139c-9dd4-4d8e-8a00-fe73757ba86c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:43.575462 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-7d14139c-9dd4-4d8e-8a00-fe73757ba86c None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:27:43.576697 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-7d14139c-9dd4-4d8e-8a00-fe73757ba86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:27:43.641499 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 166/327] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:27:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:27:43.642331 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d14139c-9dd4-4d8e-8a00-fe73757ba86c None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:43.731597 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 162/328] 10.222.0.81 () {60 vars in 1134 bytes} [Mon Jul 18 16:27:43 2022] POST /identity/v3/groups => generated 226 bytes in 552 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:27:43.733002 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4f585-a76f-4022-b198-f72c898ea33b None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:43.750680 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d14139c-9dd4-4d8e-8a00-fe73757ba86c None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:43.770679 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:43.796669 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b6fbd-d622-4d93-8c3a-de3a9f552966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:43.797576 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b6fbd-d622-4d93-8c3a-de3a9f552966 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:43.797855 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b6fbd-d622-4d93-8c3a-de3a9f552966 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:43.798127 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b6fbd-d622-4d93-8c3a-de3a9f552966 None admin] PATH_INFO: `/v3/users/0b4affb65c0d402c95272636ee95dee8` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:43.799441 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903b6fbd-d622-4d93-8c3a-de3a9f552966 None admin] RBAC: Authorizing `identity:get_user(user_id=0b4affb65c0d402c95272636ee95dee8)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:43.800971 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903b6fbd-d622-4d93-8c3a-de3a9f552966 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:43.803103 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 167/329] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Jul 18 16:27:43 2022] GET /identity/v3/users/0b4affb65c0d402c95272636ee95dee8 => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:43.808785 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b6fbd-d622-4d93-8c3a-de3a9f552966 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:43.858903 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:43.861080 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4f585-a76f-4022-b198-f72c898ea33b None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:43.896391 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:43.903558 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7ad4b-95b2-45e0-a3b3-966a51a9d9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:43.904488 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7ad4b-95b2-45e0-a3b3-966a51a9d9e8 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:43.904770 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7ad4b-95b2-45e0-a3b3-966a51a9d9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:43.905047 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7ad4b-95b2-45e0-a3b3-966a51a9d9e8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:43.918529 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab7ad4b-95b2-45e0-a3b3-966a51a9d9e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:27:43.925915 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-aab7ad4b-95b2-45e0-a3b3-966a51a9d9e8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 16:27:43.925915 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:27:43.925915 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:27:43.925915 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:27:43.925915 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:27:43.925915 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:27:43.925915 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:27:43.925915 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:27:43.925915 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:27:43.925915 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:27:43.925915 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:27:43.925915 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:27:43.925915 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:27:43.925915 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:27:43.925915 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:27:43.925915 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:27:43.926836 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:27:43.926836 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:27:43.926836 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:27:43.926836 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:27:43.926836 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:27:43.926836 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:27:43.926836 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:27:43.926836 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:27:43.926836 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:27:43.926836 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:27:43.926836 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:27:43.926836 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:27:43.926836 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:27:43.926836 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:27:43.926836 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:27:43.926836 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:27:43.928452 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:27:43.928452 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:27:43.928452 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:27:43.928452 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:27:43.928452 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:27:43.928452 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:27:43.928452 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:27:43.928452 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:27:43.928452 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:27:43.928452 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:27:43.928452 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 16:27:43.928452 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:27:43.928452 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 163/330] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Jul 18 16:27:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:27:43.930545 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b6fbd-d622-4d93-8c3a-de3a9f552966 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:43.934014 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7ad4b-95b2-45e0-a3b3-966a51a9d9e8 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:43.974984 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc741cc-b087-4fee-a02c-75f7adedca5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:43.980496 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc741cc-b087-4fee-a02c-75f7adedca5b None admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:43.980496 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc741cc-b087-4fee-a02c-75f7adedca5b None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:43.980496 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc741cc-b087-4fee-a02c-75f7adedca5b None admin] PATH_INFO: `/v3/system/users/0b4affb65c0d402c95272636ee95dee8/roles/2d721f61e3334102a57d236346c17850` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:43.980496 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc741cc-b087-4fee-a02c-75f7adedca5b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0b4affb65c0d402c95272636ee95dee8, role_id=2d721f61e3334102a57d236346c17850)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:43.980496 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc741cc-b087-4fee-a02c-75f7adedca5b None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:44.060119 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7ad4b-95b2-45e0-a3b3-966a51a9d9e8 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:44.095477 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 168/331] 10.222.0.81 () {58 vars in 1334 bytes} [Mon Jul 18 16:27:43 2022] PUT /identity/v3/system/users/0b4affb65c0d402c95272636ee95dee8/roles/2d721f61e3334102a57d236346c17850 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:27:44.096485 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdff316-307c-4aed-932d-1dca932d6bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:44.097211 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdff316-307c-4aed-932d-1dca932d6bc7 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:44.097498 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdff316-307c-4aed-932d-1dca932d6bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:44.097829 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdff316-307c-4aed-932d-1dca932d6bc7 None admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:44.099332 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdff316-307c-4aed-932d-1dca932d6bc7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:44.099332 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdff316-307c-4aed-932d-1dca932d6bc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:44.100853 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdff316-307c-4aed-932d-1dca932d6bc7 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:44.110573 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 164/332] 10.222.0.81 () {56 vars in 1101 bytes} [Mon Jul 18 16:27:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:27:44.116606 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc741cc-b087-4fee-a02c-75f7adedca5b None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:44.251910 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc741cc-b087-4fee-a02c-75f7adedca5b None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:44.253863 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:44.296279 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a1a6ce-1fd5-44e7-b8ee-26b2d763d5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:44.297162 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a1a6ce-1fd5-44e7-b8ee-26b2d763d5e6 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:44.297435 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a1a6ce-1fd5-44e7-b8ee-26b2d763d5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:44.297703 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a1a6ce-1fd5-44e7-b8ee-26b2d763d5e6 None admin] PATH_INFO: `/v3/users/368b451d54984854b66fd1327afec277` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:44.299669 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a1a6ce-1fd5-44e7-b8ee-26b2d763d5e6 None admin] RBAC: Authorizing `identity:get_user(user_id=368b451d54984854b66fd1327afec277)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:44.301144 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a1a6ce-1fd5-44e7-b8ee-26b2d763d5e6 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:44.302804 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 169/333] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Jul 18 16:27:44 2022] GET /identity/v3/users/368b451d54984854b66fd1327afec277 => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:44.308978 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdff316-307c-4aed-932d-1dca932d6bc7 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:44.384197 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:44.441304 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdff316-307c-4aed-932d-1dca932d6bc7 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:44.485535 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d38949-dcff-4a83-bf0f-6f4b6c6d9aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:44.486213 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d38949-dcff-4a83-bf0f-6f4b6c6d9aba None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:44.486492 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d38949-dcff-4a83-bf0f-6f4b6c6d9aba None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:44.486766 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d38949-dcff-4a83-bf0f-6f4b6c6d9aba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:44.487606 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d38949-dcff-4a83-bf0f-6f4b6c6d9aba None admin] RBAC: Adding query filter params (role.id=ad3a2bc7b2094a4da1a95a143c8d9436, user.id=368b451d54984854b66fd1327afec277, scope.system=all) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:44.487939 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d38949-dcff-4a83-bf0f-6f4b6c6d9aba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:44.489397 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d38949-dcff-4a83-bf0f-6f4b6c6d9aba None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:44.507906 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 165/334] 10.222.0.81 () {56 vars in 1308 bytes} [Mon Jul 18 16:27:44 2022] GET /identity/v3/role_assignments?user.id=368b451d54984854b66fd1327afec277&scope.system=all&role.id=ad3a2bc7b2094a4da1a95a143c8d9436 => generated 510 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:46.230190 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c5f013-aa18-4472-9d47-47f4d35b44bb None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:46.230737 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c5f013-aa18-4472-9d47-47f4d35b44bb None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:46.230737 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c5f013-aa18-4472-9d47-47f4d35b44bb None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:46.232416 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 170/335] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:27:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:27:46.237591 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c8eb49-4532-416d-9e14-2836e832a34c None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:46.238042 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c8eb49-4532-416d-9e14-2836e832a34c None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:46.238130 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c8eb49-4532-416d-9e14-2836e832a34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:46.265689 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-e4c8eb49-4532-416d-9e14-2836e832a34c None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:27:46.266915 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-e4c8eb49-4532-416d-9e14-2836e832a34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:27:46.350651 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 166/336] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:27:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:27:46.382523 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c5f013-aa18-4472-9d47-47f4d35b44bb None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:46.539932 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c5f013-aa18-4472-9d47-47f4d35b44bb None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:46.585033 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96249803-0471-4256-86c7-ed2370873b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:46.586308 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96249803-0471-4256-86c7-ed2370873b7c None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:46.586779 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96249803-0471-4256-86c7-ed2370873b7c None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:46.587241 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96249803-0471-4256-86c7-ed2370873b7c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:46.604647 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96249803-0471-4256-86c7-ed2370873b7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:27:46.612505 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-96249803-0471-4256-86c7-ed2370873b7c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 16:27:46.612505 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:27:46.612505 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:27:46.612505 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:27:46.612505 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:27:46.612505 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:27:46.612505 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:27:46.612505 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:27:46.612505 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:27:46.612505 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:27:46.612505 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:27:46.612505 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:27:46.612505 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:27:46.612505 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:27:46.612505 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:27:46.612505 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:27:46.613612 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:27:46.613612 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:27:46.613612 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:27:46.613612 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:27:46.613612 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:27:46.613612 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:27:46.613612 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:27:46.613612 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:27:46.613612 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:27:46.613612 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:27:46.613612 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:27:46.613612 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:27:46.613612 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:27:46.613612 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:27:46.613612 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:27:46.613612 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:27:46.614458 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:27:46.614458 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:27:46.614458 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:27:46.614458 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:27:46.614458 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:27:46.614458 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:27:46.614458 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:27:46.614458 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:27:46.614458 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:27:46.614458 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:27:46.614458 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 16:27:46.614458 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:27:46.614458 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 171/337] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Jul 18 16:27:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:27:46.621839 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c8eb49-4532-416d-9e14-2836e832a34c None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:46.695806 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:46.772244 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c8eb49-4532-416d-9e14-2836e832a34c None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:46.819340 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7029211-9814-4018-a7ff-8054ae5c18f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:46.819971 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7029211-9814-4018-a7ff-8054ae5c18f7 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:46.820356 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7029211-9814-4018-a7ff-8054ae5c18f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:46.820637 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7029211-9814-4018-a7ff-8054ae5c18f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:46.821391 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7029211-9814-4018-a7ff-8054ae5c18f7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:46.821744 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7029211-9814-4018-a7ff-8054ae5c18f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:46.823141 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7029211-9814-4018-a7ff-8054ae5c18f7 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:46.833020 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 167/338] 10.222.0.81 () {56 vars in 1101 bytes} [Mon Jul 18 16:27:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:46.838807 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96249803-0471-4256-86c7-ed2370873b7c None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:46.894653 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:46.987860 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96249803-0471-4256-86c7-ed2370873b7c None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:47.017689 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351f831-8fd4-4935-a26d-1aea865aa441 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:47.018087 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351f831-8fd4-4935-a26d-1aea865aa441 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:47.018372 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351f831-8fd4-4935-a26d-1aea865aa441 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:47.020251 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 168/339] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:27:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:27:47.027080 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b878a16-0323-4c06-a542-417bab48a60f None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:47.027380 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b878a16-0323-4c06-a542-417bab48a60f None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:47.027631 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b878a16-0323-4c06-a542-417bab48a60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:47.029377 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee3db00-4855-4749-aa07-94f79ee94b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:47.030109 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3db00-4855-4749-aa07-94f79ee94b6c None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:47.030396 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3db00-4855-4749-aa07-94f79ee94b6c None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:47.030674 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3db00-4855-4749-aa07-94f79ee94b6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:47.053386 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-8b878a16-0323-4c06-a542-417bab48a60f None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:27:47.054708 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-8b878a16-0323-4c06-a542-417bab48a60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:27:47.154011 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee3db00-4855-4749-aa07-94f79ee94b6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:47.154846 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 169/340] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:27:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 16:27:47.156338 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee3db00-4855-4749-aa07-94f79ee94b6c None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:47.157168 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695ca54-4ad4-456f-b120-8527f8eadb75 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:47.157460 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695ca54-4ad4-456f-b120-8527f8eadb75 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:47.157736 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695ca54-4ad4-456f-b120-8527f8eadb75 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:47.160189 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 170/341] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:27:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:27:47.161347 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e06e4-a764-4d00-82d1-06bc5c97dc5a None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:47.161629 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e06e4-a764-4d00-82d1-06bc5c97dc5a None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:47.161900 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e06e4-a764-4d00-82d1-06bc5c97dc5a None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:47.163275 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 171/342] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:27:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:27:47.169567 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb1bdb-20d7-4030-b935-4c0d4979c852 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:47.175118 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb1bdb-20d7-4030-b935-4c0d4979c852 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:47.175118 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb1bdb-20d7-4030-b935-4c0d4979c852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:47.193762 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:47.195192 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-60fb1bdb-20d7-4030-b935-4c0d4979c852 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:27:47.196881 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-60fb1bdb-20d7-4030-b935-4c0d4979c852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:27:47.231408 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:47.285082 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 172/343] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Jul 18 16:27:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:27:47.286581 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252787e-e1e5-4fce-922e-9a09dd680938 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:47.286944 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252787e-e1e5-4fce-922e-9a09dd680938 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:47.287319 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252787e-e1e5-4fce-922e-9a09dd680938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:47.294178 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 172/344] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:27:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:27:47.297233 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fb1bdb-20d7-4030-b935-4c0d4979c852 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:47.308824 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-7252787e-e1e5-4fce-922e-9a09dd680938 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:27:47.310240 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-7252787e-e1e5-4fce-922e-9a09dd680938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:27:47.410606 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 173/345] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:27:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:27:47.411830 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7252787e-e1e5-4fce-922e-9a09dd680938 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:47.458517 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fb1bdb-20d7-4030-b935-4c0d4979c852 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:47.499654 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae57b386-9aca-4610-a4b9-d05a532fd59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:47.500587 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae57b386-9aca-4610-a4b9-d05a532fd59c None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:47.500872 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae57b386-9aca-4610-a4b9-d05a532fd59c None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:47.501149 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae57b386-9aca-4610-a4b9-d05a532fd59c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:47.507300 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:47.516056 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae57b386-9aca-4610-a4b9-d05a532fd59c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:27:47.524424 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-ae57b386-9aca-4610-a4b9-d05a532fd59c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 16:27:47.524424 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:27:47.524424 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:27:47.524424 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:27:47.524424 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:27:47.524424 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:27:47.524424 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:27:47.524424 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:27:47.524424 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:27:47.524424 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:27:47.524424 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:27:47.524424 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:27:47.524424 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:27:47.524424 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:27:47.524424 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:27:47.524424 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:27:47.531170 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:27:47.531170 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:27:47.531170 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:27:47.531170 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:27:47.531170 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:27:47.531170 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:27:47.531170 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:27:47.531170 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:27:47.531170 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:27:47.531170 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:27:47.531170 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:27:47.531170 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:27:47.531170 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:27:47.531170 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:27:47.531170 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:27:47.531170 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:27:47.532432 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:27:47.532432 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:27:47.532432 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:27:47.532432 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:27:47.532432 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:27:47.532432 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:27:47.532432 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:27:47.532432 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:27:47.532432 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:27:47.532432 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:27:47.532432 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 16:27:47.532432 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:27:47.532432 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 173/346] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Jul 18 16:27:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:27:47.532432 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae57b386-9aca-4610-a4b9-d05a532fd59c None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:47.557589 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:47.565775 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7252787e-e1e5-4fce-922e-9a09dd680938 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:47.623738 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826ed6a9-18cd-4b23-8423-76cd79911945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:47.623738 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ed6a9-18cd-4b23-8423-76cd79911945 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:47.623738 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ed6a9-18cd-4b23-8423-76cd79911945 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:47.623738 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ed6a9-18cd-4b23-8423-76cd79911945 None admin] PATH_INFO: `/v3/projects/edc913ab51354b1da43bd3c47b3b2c51` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:47.624442 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826ed6a9-18cd-4b23-8423-76cd79911945 None admin] RBAC: Authorizing `identity:get_project(project_id=edc913ab51354b1da43bd3c47b3b2c51)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:47.625831 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826ed6a9-18cd-4b23-8423-76cd79911945 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:47.628064 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 174/347] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Jul 18 16:27:47 2022] GET /identity/v3/projects/edc913ab51354b1da43bd3c47b3b2c51 => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:47.628984 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826ed6a9-18cd-4b23-8423-76cd79911945 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:47.659568 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae57b386-9aca-4610-a4b9-d05a532fd59c None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:47.707329 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b2c30-bd9b-43d0-a6c2-5eeac3dca827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:47.708531 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b2c30-bd9b-43d0-a6c2-5eeac3dca827 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:47.709085 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b2c30-bd9b-43d0-a6c2-5eeac3dca827 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:47.709370 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b2c30-bd9b-43d0-a6c2-5eeac3dca827 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:47.724818 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137b2c30-bd9b-43d0-a6c2-5eeac3dca827 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:27:47.734877 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-137b2c30-bd9b-43d0-a6c2-5eeac3dca827 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 16:27:47.734877 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:27:47.734877 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:27:47.734877 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:27:47.734877 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:27:47.734877 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:27:47.734877 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:27:47.734877 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:27:47.734877 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:27:47.734877 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:27:47.734877 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:27:47.734877 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:27:47.734877 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:27:47.734877 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:27:47.734877 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:27:47.734877 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:27:47.737282 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:27:47.737282 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:27:47.737282 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:27:47.737282 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:27:47.737282 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:27:47.737282 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:27:47.737282 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:27:47.737282 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:27:47.737282 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:27:47.737282 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:27:47.737282 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:27:47.737282 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:27:47.737282 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:27:47.737282 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:27:47.737282 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:27:47.737282 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:27:47.738883 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:27:47.738883 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:27:47.738883 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:27:47.738883 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:27:47.738883 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:27:47.738883 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:27:47.738883 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:27:47.738883 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:27:47.738883 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:27:47.738883 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:27:47.738883 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 16:27:47.738883 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:27:47.738883 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 174/348] 10.222.0.81 () {56 vars in 1114 bytes} [Mon Jul 18 16:27:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:27:47.738883 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b2c30-bd9b-43d0-a6c2-5eeac3dca827 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:47.761836 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826ed6a9-18cd-4b23-8423-76cd79911945 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:47.797374 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:47.807401 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7072ead4-2cd1-44c3-829d-a7dd28a0918c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:47.811413 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7072ead4-2cd1-44c3-829d-a7dd28a0918c None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:47.811413 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7072ead4-2cd1-44c3-829d-a7dd28a0918c None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:47.811413 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7072ead4-2cd1-44c3-829d-a7dd28a0918c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:47.830279 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7072ead4-2cd1-44c3-829d-a7dd28a0918c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:27:47.838602 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-7072ead4-2cd1-44c3-829d-a7dd28a0918c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 16:27:47.838602 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:27:47.838602 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:27:47.838602 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:27:47.838602 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:27:47.838602 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:27:47.838602 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:27:47.838602 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:27:47.838602 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:27:47.838602 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:27:47.838602 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:27:47.838602 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:27:47.838602 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:27:47.838602 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:27:47.838602 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:27:47.838602 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:27:47.841097 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:27:47.841097 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:27:47.841097 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:27:47.841097 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:27:47.841097 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:27:47.841097 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:27:47.841097 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:27:47.841097 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:27:47.841097 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:27:47.841097 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:27:47.841097 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:27:47.841097 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:27:47.841097 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:27:47.841097 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:27:47.841097 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:27:47.841097 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:27:47.843492 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:27:47.843492 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:27:47.843492 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:27:47.843492 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:27:47.843492 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:27:47.843492 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:27:47.843492 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:27:47.843492 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:27:47.843492 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:27:47.843492 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:27:47.843492 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 16:27:47.843492 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:27:47.843492 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 175/349] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Jul 18 16:27:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:27:47.843492 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7072ead4-2cd1-44c3-829d-a7dd28a0918c None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:47.850033 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:47.876902 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b2c30-bd9b-43d0-a6c2-5eeac3dca827 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:47.928736 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab279f-1695-4d8a-bd46-8d3cba0ac05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:47.929093 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab279f-1695-4d8a-bd46-8d3cba0ac05e None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:47.929338 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab279f-1695-4d8a-bd46-8d3cba0ac05e None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:47.929615 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab279f-1695-4d8a-bd46-8d3cba0ac05e None admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:47.930372 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ab279f-1695-4d8a-bd46-8d3cba0ac05e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:47.931203 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ab279f-1695-4d8a-bd46-8d3cba0ac05e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:47.932947 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ab279f-1695-4d8a-bd46-8d3cba0ac05e None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:47.945357 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 175/350] 10.222.0.81 () {56 vars in 1101 bytes} [Mon Jul 18 16:27:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:47.946298 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab279f-1695-4d8a-bd46-8d3cba0ac05e None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:47.981218 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7072ead4-2cd1-44c3-829d-a7dd28a0918c None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:48.026559 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f432c6c-a183-4610-b871-352356857107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:48.027438 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f432c6c-a183-4610-b871-352356857107 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:48.027737 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f432c6c-a183-4610-b871-352356857107 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:48.028035 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f432c6c-a183-4610-b871-352356857107 None admin] PATH_INFO: `/v3/groups/f919e7f564bb4057b35dbb12e59ceb96` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:48.035070 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f432c6c-a183-4610-b871-352356857107 None admin] RBAC: Authorizing `identity:get_group(group_id=f919e7f564bb4057b35dbb12e59ceb96)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:48.036606 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f432c6c-a183-4610-b871-352356857107 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:48.038656 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 176/351] 10.222.0.81 () {56 vars in 1180 bytes} [Mon Jul 18 16:27:47 2022] GET /identity/v3/groups/f919e7f564bb4057b35dbb12e59ceb96 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:48.039260 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f432c6c-a183-4610-b871-352356857107 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:48.079173 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab279f-1695-4d8a-bd46-8d3cba0ac05e None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:48.106190 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:48.123502 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1632711-804b-469c-a25a-58f29e58f989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:48.124798 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1632711-804b-469c-a25a-58f29e58f989 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:48.125084 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1632711-804b-469c-a25a-58f29e58f989 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:48.125383 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1632711-804b-469c-a25a-58f29e58f989 None admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:48.126175 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1632711-804b-469c-a25a-58f29e58f989 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:48.126480 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1632711-804b-469c-a25a-58f29e58f989 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:48.127905 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1632711-804b-469c-a25a-58f29e58f989 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:48.137891 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 176/352] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Jul 18 16:27:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:48.138571 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1632711-804b-469c-a25a-58f29e58f989 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:48.149168 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:48.180372 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f432c6c-a183-4610-b871-352356857107 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:48.241323 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c33ce-5a92-4c77-a8ab-4c075cd0b449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:48.242243 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c33ce-5a92-4c77-a8ab-4c075cd0b449 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:48.242690 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c33ce-5a92-4c77-a8ab-4c075cd0b449 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:48.242966 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c33ce-5a92-4c77-a8ab-4c075cd0b449 None admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:48.246845 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511c33ce-5a92-4c77-a8ab-4c075cd0b449 None admin] RBAC: Adding query filter params (name=member) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:48.246845 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511c33ce-5a92-4c77-a8ab-4c075cd0b449 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:48.246845 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511c33ce-5a92-4c77-a8ab-4c075cd0b449 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:48.262611 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 177/353] 10.222.0.81 () {56 vars in 1101 bytes} [Mon Jul 18 16:27:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:48.262611 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1eca8-f856-41a8-bd71-b4a51bafed8b None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:48.262611 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1eca8-f856-41a8-bd71-b4a51bafed8b None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:48.262611 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1eca8-f856-41a8-bd71-b4a51bafed8b None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:48.263024 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 178/354] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:27:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:27:48.263412 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd1eca8-f856-41a8-bd71-b4a51bafed8b None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:48.300362 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1632711-804b-469c-a25a-58f29e58f989 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:48.361548 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490017a6-a14b-4e5d-8886-cfa1c7581140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:48.363111 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490017a6-a14b-4e5d-8886-cfa1c7581140 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:48.363421 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490017a6-a14b-4e5d-8886-cfa1c7581140 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:48.363701 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490017a6-a14b-4e5d-8886-cfa1c7581140 None admin] PATH_INFO: `/v3/users/0b4affb65c0d402c95272636ee95dee8` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:48.365530 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490017a6-a14b-4e5d-8886-cfa1c7581140 None admin] RBAC: Authorizing `identity:get_user(user_id=0b4affb65c0d402c95272636ee95dee8)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:48.366720 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490017a6-a14b-4e5d-8886-cfa1c7581140 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:48.368877 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 177/355] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Jul 18 16:27:48 2022] GET /identity/v3/users/0b4affb65c0d402c95272636ee95dee8 => generated 293 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:48.369758 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490017a6-a14b-4e5d-8886-cfa1c7581140 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:48.412169 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd1eca8-f856-41a8-bd71-b4a51bafed8b None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:48.429667 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:48.458138 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d75ad0-fc40-4ccb-adc9-a1426bfbb603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:48.458915 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d75ad0-fc40-4ccb-adc9-a1426bfbb603 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:48.460267 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d75ad0-fc40-4ccb-adc9-a1426bfbb603 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:48.460267 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d75ad0-fc40-4ccb-adc9-a1426bfbb603 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:48.462483 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d75ad0-fc40-4ccb-adc9-a1426bfbb603 None admin] RBAC: Adding query filter params (group.id=f919e7f564bb4057b35dbb12e59ceb96, role.id=ad3a2bc7b2094a4da1a95a143c8d9436, scope.project.id=edc913ab51354b1da43bd3c47b3b2c51) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:48.462483 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d75ad0-fc40-4ccb-adc9-a1426bfbb603 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:48.466925 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d75ad0-fc40-4ccb-adc9-a1426bfbb603 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:48.479688 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 179/356] 10.222.0.81 () {56 vars in 1376 bytes} [Mon Jul 18 16:27:48 2022] GET /identity/v3/role_assignments?group.id=f919e7f564bb4057b35dbb12e59ceb96&scope.project.id=edc913ab51354b1da43bd3c47b3b2c51&role.id=ad3a2bc7b2094a4da1a95a143c8d9436 => generated 260 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:48.483500 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d75ad0-fc40-4ccb-adc9-a1426bfbb603 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:48.489589 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:48.531056 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490017a6-a14b-4e5d-8886-cfa1c7581140 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:48.584008 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249361ba-6cfd-4440-a600-b0c9bdcd09e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:48.585920 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249361ba-6cfd-4440-a600-b0c9bdcd09e9 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:48.586336 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249361ba-6cfd-4440-a600-b0c9bdcd09e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:48.586638 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249361ba-6cfd-4440-a600-b0c9bdcd09e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:48.649305 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d75ad0-fc40-4ccb-adc9-a1426bfbb603 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:48.692224 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44440c-4808-4487-9546-e32565ccdcef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:48.692895 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44440c-4808-4487-9546-e32565ccdcef None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:48.693177 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44440c-4808-4487-9546-e32565ccdcef None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:48.693454 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44440c-4808-4487-9546-e32565ccdcef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:48.701854 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249361ba-6cfd-4440-a600-b0c9bdcd09e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:48.705933 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249361ba-6cfd-4440-a600-b0c9bdcd09e9 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:48.760279 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:48.797860 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c44440c-4808-4487-9546-e32565ccdcef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:48.799930 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c44440c-4808-4487-9546-e32565ccdcef None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:48.844107 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:48.896280 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 178/357] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Jul 18 16:27:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:27:48.898245 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e3d98-9c98-43b7-b23f-9425104073a4 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:48.898652 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e3d98-9c98-43b7-b23f-9425104073a4 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:48.899070 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e3d98-9c98-43b7-b23f-9425104073a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:48.921707 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-223e3d98-9c98-43b7-b23f-9425104073a4 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:27:48.922942 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-223e3d98-9c98-43b7-b23f-9425104073a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:27:48.968037 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 180/358] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Jul 18 16:27:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:27:48.969762 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44440c-4808-4487-9546-e32565ccdcef None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:49.021944 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 179/359] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:27:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:27:49.022843 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc01aeb-e4bf-44d4-8c8f-3ccc9e39016c None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:49.023134 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc01aeb-e4bf-44d4-8c8f-3ccc9e39016c None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:49.023440 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc01aeb-e4bf-44d4-8c8f-3ccc9e39016c None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:49.026155 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 180/360] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:27:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:27:49.026693 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc01aeb-e4bf-44d4-8c8f-3ccc9e39016c None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:49.094614 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:49.122758 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44440c-4808-4487-9546-e32565ccdcef None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:49.175984 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc01aeb-e4bf-44d4-8c8f-3ccc9e39016c None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:49.178749 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:49.179837 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a0f5df-426b-4c3e-930b-f8ccff49bca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:49.180518 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a0f5df-426b-4c3e-930b-f8ccff49bca3 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:49.180801 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a0f5df-426b-4c3e-930b-f8ccff49bca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:49.181073 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a0f5df-426b-4c3e-930b-f8ccff49bca3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:49.181925 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a0f5df-426b-4c3e-930b-f8ccff49bca3 None admin] RBAC: Adding query filter params (role.id=2d721f61e3334102a57d236346c17850, user.id=0b4affb65c0d402c95272636ee95dee8, scope.system=all) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:49.182234 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a0f5df-426b-4c3e-930b-f8ccff49bca3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:49.183702 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a0f5df-426b-4c3e-930b-f8ccff49bca3 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:49.202970 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 181/361] 10.222.0.81 () {56 vars in 1308 bytes} [Mon Jul 18 16:27:48 2022] GET /identity/v3/role_assignments?user.id=0b4affb65c0d402c95272636ee95dee8&scope.system=all&role.id=2d721f61e3334102a57d236346c17850 => generated 510 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:49.202970 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a0f5df-426b-4c3e-930b-f8ccff49bca3 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:49.247880 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd127c-1cda-4ce6-ad28-c0ed48cb0ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:49.248793 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd127c-1cda-4ce6-ad28-c0ed48cb0ef5 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:49.249078 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd127c-1cda-4ce6-ad28-c0ed48cb0ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:49.249354 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd127c-1cda-4ce6-ad28-c0ed48cb0ef5 None admin] PATH_INFO: `/v3/projects/edc913ab51354b1da43bd3c47b3b2c51` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:49.250755 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dd127c-1cda-4ce6-ad28-c0ed48cb0ef5 None admin] RBAC: Authorizing `identity:get_project(project_id=edc913ab51354b1da43bd3c47b3b2c51)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:49.252313 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dd127c-1cda-4ce6-ad28-c0ed48cb0ef5 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:49.254154 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 181/362] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Jul 18 16:27:49 2022] GET /identity/v3/projects/edc913ab51354b1da43bd3c47b3b2c51 => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:49.255462 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d286b1-185f-4140-9c85-651fd432a1e4 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:49.259301 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d286b1-185f-4140-9c85-651fd432a1e4 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:49.259676 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d286b1-185f-4140-9c85-651fd432a1e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:49.281349 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-e4d286b1-185f-4140-9c85-651fd432a1e4 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:27:49.282628 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-e4d286b1-185f-4140-9c85-651fd432a1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:27:49.349636 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a0f5df-426b-4c3e-930b-f8ccff49bca3 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:49.397021 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 182/363] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:27:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:27:49.397913 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d286b1-185f-4140-9c85-651fd432a1e4 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:49.409230 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09279c31-164c-4dda-9aea-130402feca21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:49.409765 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09279c31-164c-4dda-9aea-130402feca21 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:49.410056 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09279c31-164c-4dda-9aea-130402feca21 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:49.410362 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09279c31-164c-4dda-9aea-130402feca21 None admin] PATH_INFO: `/v3/projects/7f680cc460584bf688dae550c6a46776` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:49.411702 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09279c31-164c-4dda-9aea-130402feca21 None admin] RBAC: Authorizing `identity:get_project(project_id=7f680cc460584bf688dae550c6a46776)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:49.413405 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09279c31-164c-4dda-9aea-130402feca21 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:49.416357 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 182/364] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Jul 18 16:27:49 2022] GET /identity/v3/projects/7f680cc460584bf688dae550c6a46776 => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:49.416526 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09279c31-164c-4dda-9aea-130402feca21 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:49.426998 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:49.545699 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d286b1-185f-4140-9c85-651fd432a1e4 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:49.547420 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:49.577325 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09279c31-164c-4dda-9aea-130402feca21 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:49.594141 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe961970-8289-4d16-b165-8af39035fa5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:49.595116 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe961970-8289-4d16-b165-8af39035fa5b None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:49.595429 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe961970-8289-4d16-b165-8af39035fa5b None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:49.596066 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe961970-8289-4d16-b165-8af39035fa5b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:49.609197 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe961970-8289-4d16-b165-8af39035fa5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:27:49.617440 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-fe961970-8289-4d16-b165-8af39035fa5b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 16:27:49.617440 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:27:49.617440 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:27:49.617440 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:27:49.617440 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:27:49.617440 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:27:49.617440 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:27:49.617440 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:27:49.617440 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:27:49.617440 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:27:49.617440 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:27:49.617440 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:27:49.617440 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:27:49.617440 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:27:49.617440 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:27:49.617440 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:27:49.618413 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:27:49.618413 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:27:49.618413 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:27:49.618413 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:27:49.618413 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:27:49.618413 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:27:49.618413 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:27:49.618413 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:27:49.618413 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:27:49.618413 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:27:49.618413 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:27:49.618413 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:27:49.618413 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:27:49.618413 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:27:49.618413 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:27:49.618413 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:27:49.619250 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:27:49.619250 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:27:49.619250 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:27:49.619250 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:27:49.619250 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:27:49.619250 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:27:49.619250 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:27:49.619250 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:27:49.619250 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:27:49.619250 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:27:49.619250 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 16:27:49.619250 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:27:49.619250 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 183/365] 10.222.0.81 () {56 vars in 1114 bytes} [Mon Jul 18 16:27:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:27:49.620764 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe961970-8289-4d16-b165-8af39035fa5b None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:49.634588 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f681618-28e3-4a4e-bba5-e9593b8c6776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:49.635467 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f681618-28e3-4a4e-bba5-e9593b8c6776 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:49.635769 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f681618-28e3-4a4e-bba5-e9593b8c6776 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:49.636055 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f681618-28e3-4a4e-bba5-e9593b8c6776 None admin] PATH_INFO: `/v3/groups/f919e7f564bb4057b35dbb12e59ceb96` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:49.637283 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f681618-28e3-4a4e-bba5-e9593b8c6776 None admin] RBAC: Authorizing `identity:get_group(group_id=f919e7f564bb4057b35dbb12e59ceb96)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:49.638752 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f681618-28e3-4a4e-bba5-e9593b8c6776 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:49.641714 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 183/366] 10.222.0.81 () {56 vars in 1180 bytes} [Mon Jul 18 16:27:49 2022] GET /identity/v3/groups/f919e7f564bb4057b35dbb12e59ceb96 => generated 226 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:49.644889 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f681618-28e3-4a4e-bba5-e9593b8c6776 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:49.756114 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:49.766222 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe961970-8289-4d16-b165-8af39035fa5b None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:49.806054 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f681618-28e3-4a4e-bba5-e9593b8c6776 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:49.813578 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39fe43b-c489-4f92-9406-ec46ba5bafc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:49.814445 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39fe43b-c489-4f92-9406-ec46ba5bafc5 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:49.814726 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39fe43b-c489-4f92-9406-ec46ba5bafc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:49.815401 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39fe43b-c489-4f92-9406-ec46ba5bafc5 None admin] PATH_INFO: `/v3/groups/f919e7f564bb4057b35dbb12e59ceb96` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:49.818713 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39fe43b-c489-4f92-9406-ec46ba5bafc5 None admin] RBAC: Authorizing `identity:get_group(group_id=f919e7f564bb4057b35dbb12e59ceb96)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:49.818713 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39fe43b-c489-4f92-9406-ec46ba5bafc5 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:49.819954 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 184/367] 10.222.0.81 () {56 vars in 1180 bytes} [Mon Jul 18 16:27:49 2022] GET /identity/v3/groups/f919e7f564bb4057b35dbb12e59ceb96 => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:49.820307 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39fe43b-c489-4f92-9406-ec46ba5bafc5 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:49.865721 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:49.866998 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23404475-930f-451f-b24e-43854961f900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:49.867741 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23404475-930f-451f-b24e-43854961f900 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:49.868236 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23404475-930f-451f-b24e-43854961f900 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:49.868514 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23404475-930f-451f-b24e-43854961f900 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:49.884862 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23404475-930f-451f-b24e-43854961f900 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:27:49.895161 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-23404475-930f-451f-b24e-43854961f900 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:27:49.895161 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:27:49.895161 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:27:49.895161 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:27:49.895161 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:27:49.895161 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:27:49.895161 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:27:49.895161 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:27:49.895161 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:27:49.895161 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:27:49.895161 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:27:49.895161 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:27:49.895161 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:27:49.895161 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:27:49.895161 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:27:49.895161 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:27:49.896220 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:27:49.896220 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:27:49.896220 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:27:49.896220 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:27:49.896220 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:27:49.896220 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:27:49.896220 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:27:49.896220 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:27:49.896220 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:27:49.896220 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:27:49.896220 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:27:49.896220 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:27:49.896220 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:27:49.896220 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:27:49.896220 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:27:49.896220 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:27:49.897464 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:27:49.897464 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:27:49.897464 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:27:49.897464 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:27:49.897464 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:27:49.897464 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:27:49.897464 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:27:49.897464 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:27:49.897464 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:27:49.897464 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:27:49.897464 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:27:49.897464 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:27:49.897464 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 184/368] 10.222.0.81 () {56 vars in 1096 bytes} [Mon Jul 18 16:27:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:27:49.897464 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23404475-930f-451f-b24e-43854961f900 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:50.001795 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39fe43b-c489-4f92-9406-ec46ba5bafc5 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:50.036599 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23404475-930f-451f-b24e-43854961f900 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:50.070784 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7568bfaa-f883-4029-ba9a-1bdfc8a58b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:50.071998 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7568bfaa-f883-4029-ba9a-1bdfc8a58b0a None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:50.072508 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7568bfaa-f883-4029-ba9a-1bdfc8a58b0a None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:50.072988 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7568bfaa-f883-4029-ba9a-1bdfc8a58b0a None admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:50.074428 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7568bfaa-f883-4029-ba9a-1bdfc8a58b0a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:50.074964 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7568bfaa-f883-4029-ba9a-1bdfc8a58b0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:50.078445 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:50.079093 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7568bfaa-f883-4029-ba9a-1bdfc8a58b0a None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:50.088030 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406bec0-9a73-488b-adb5-58a31c2deb2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:50.088718 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406bec0-9a73-488b-adb5-58a31c2deb2c None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:50.089711 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406bec0-9a73-488b-adb5-58a31c2deb2c None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:50.090031 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406bec0-9a73-488b-adb5-58a31c2deb2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:50.092138 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4406bec0-9a73-488b-adb5-58a31c2deb2c None admin] RBAC: Adding query filter params (group.id=f919e7f564bb4057b35dbb12e59ceb96, role.id=6bfa001ddac347da894c7231f853c3df, scope.project.id=edc913ab51354b1da43bd3c47b3b2c51) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:50.092138 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4406bec0-9a73-488b-adb5-58a31c2deb2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:50.093655 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4406bec0-9a73-488b-adb5-58a31c2deb2c None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:50.094572 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 185/369] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Jul 18 16:27:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:50.095862 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7568bfaa-f883-4029-ba9a-1bdfc8a58b0a None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:50.101540 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 185/370] 10.222.0.81 () {56 vars in 1376 bytes} [Mon Jul 18 16:27:49 2022] GET /identity/v3/role_assignments?group.id=f919e7f564bb4057b35dbb12e59ceb96&scope.project.id=edc913ab51354b1da43bd3c47b3b2c51&role.id=6bfa001ddac347da894c7231f853c3df => generated 260 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:50.103382 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406bec0-9a73-488b-adb5-58a31c2deb2c None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:50.262679 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406bec0-9a73-488b-adb5-58a31c2deb2c None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:50.289467 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:50.306001 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7568bfaa-f883-4029-ba9a-1bdfc8a58b0a None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:50.312238 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ad8d83-4890-4e82-b75a-a782230edf5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:50.312951 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad8d83-4890-4e82-b75a-a782230edf5a None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:50.313238 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad8d83-4890-4e82-b75a-a782230edf5a None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:50.313566 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad8d83-4890-4e82-b75a-a782230edf5a None admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:50.314352 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ad8d83-4890-4e82-b75a-a782230edf5a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:50.314662 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ad8d83-4890-4e82-b75a-a782230edf5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:50.317280 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ad8d83-4890-4e82-b75a-a782230edf5a None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:50.327488 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 186/371] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Jul 18 16:27:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:50.332690 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ad8d83-4890-4e82-b75a-a782230edf5a None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:50.383571 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1320cfc5-80a2-4c02-98ec-75acdc56ac15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:50.385043 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320cfc5-80a2-4c02-98ec-75acdc56ac15 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:50.385600 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320cfc5-80a2-4c02-98ec-75acdc56ac15 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:50.386036 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320cfc5-80a2-4c02-98ec-75acdc56ac15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:50.388487 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1320cfc5-80a2-4c02-98ec-75acdc56ac15 None admin] RBAC: Adding query filter params (group.id=f919e7f564bb4057b35dbb12e59ceb96, role.id=ad3a2bc7b2094a4da1a95a143c8d9436, scope.project.id=7f680cc460584bf688dae550c6a46776) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:50.389021 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1320cfc5-80a2-4c02-98ec-75acdc56ac15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:50.395991 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1320cfc5-80a2-4c02-98ec-75acdc56ac15 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:50.406392 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 186/372] 10.222.0.81 () {56 vars in 1376 bytes} [Mon Jul 18 16:27:50 2022] GET /identity/v3/role_assignments?group.id=f919e7f564bb4057b35dbb12e59ceb96&scope.project.id=7f680cc460584bf688dae550c6a46776&role.id=ad3a2bc7b2094a4da1a95a143c8d9436 => generated 260 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:50.407332 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1320cfc5-80a2-4c02-98ec-75acdc56ac15 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:50.428654 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:50.533511 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ad8d83-4890-4e82-b75a-a782230edf5a None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:50.580747 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ee4210-7eda-4357-89e7-89971f511d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:50.581481 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee4210-7eda-4357-89e7-89971f511d90 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:50.581767 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee4210-7eda-4357-89e7-89971f511d90 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:50.582046 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee4210-7eda-4357-89e7-89971f511d90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:50.637461 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1320cfc5-80a2-4c02-98ec-75acdc56ac15 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:50.694213 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1431d6e4-9418-4977-8476-68a3290f365b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:50.695271 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1431d6e4-9418-4977-8476-68a3290f365b None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:50.695818 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1431d6e4-9418-4977-8476-68a3290f365b None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:50.696295 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1431d6e4-9418-4977-8476-68a3290f365b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:50.724739 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ee4210-7eda-4357-89e7-89971f511d90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:50.727137 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ee4210-7eda-4357-89e7-89971f511d90 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:50.749087 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:50.812402 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:50.857496 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1431d6e4-9418-4977-8476-68a3290f365b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:50.859756 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1431d6e4-9418-4977-8476-68a3290f365b None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:50.865705 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 187/373] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Jul 18 16:27:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:27:50.873267 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ee4210-7eda-4357-89e7-89971f511d90 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:51.087483 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 187/374] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Jul 18 16:27:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 681 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:27:51.094160 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1431d6e4-9418-4977-8476-68a3290f365b None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:51.119276 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ee4210-7eda-4357-89e7-89971f511d90 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:51.202572 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371e09c8-ba87-4b1d-b212-1f8ecb6c0128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:51.204795 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e09c8-ba87-4b1d-b212-1f8ecb6c0128 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:51.205604 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e09c8-ba87-4b1d-b212-1f8ecb6c0128 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:51.206366 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e09c8-ba87-4b1d-b212-1f8ecb6c0128 None admin] PATH_INFO: `/v3/projects/7f680cc460584bf688dae550c6a46776` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:51.209074 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371e09c8-ba87-4b1d-b212-1f8ecb6c0128 None admin] RBAC: Authorizing `identity:get_project(project_id=7f680cc460584bf688dae550c6a46776)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:51.213895 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371e09c8-ba87-4b1d-b212-1f8ecb6c0128 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:51.218695 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 188/375] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Jul 18 16:27:50 2022] GET /identity/v3/projects/7f680cc460584bf688dae550c6a46776 => generated 302 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:51.221543 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9737199-bd20-4d65-bf67-446f11a36eca None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:51.222424 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9737199-bd20-4d65-bf67-446f11a36eca None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:51.223177 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9737199-bd20-4d65-bf67-446f11a36eca None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:51.226552 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 189/376] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:27:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:27:51.232485 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9737199-bd20-4d65-bf67-446f11a36eca None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:51.239465 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:51.284797 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:51.326088 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1431d6e4-9418-4977-8476-68a3290f365b None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:51.383743 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb07d9f-d467-4286-b228-4f21068390bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:51.384630 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb07d9f-d467-4286-b228-4f21068390bf None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:51.384874 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb07d9f-d467-4286-b228-4f21068390bf None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:51.385156 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb07d9f-d467-4286-b228-4f21068390bf None admin] PATH_INFO: `/v3/projects/33688c7877734008b9dfee18021dbcd6` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:51.386332 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb07d9f-d467-4286-b228-4f21068390bf None admin] RBAC: Authorizing `identity:get_project(project_id=33688c7877734008b9dfee18021dbcd6)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:51.387936 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb07d9f-d467-4286-b228-4f21068390bf None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:51.390586 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 188/377] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Jul 18 16:27:51 2022] GET /identity/v3/projects/33688c7877734008b9dfee18021dbcd6 => generated 344 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:27:51.391902 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00cdf52-fe5f-4c02-a073-9b65f3fb5640 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:51.392189 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00cdf52-fe5f-4c02-a073-9b65f3fb5640 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:51.392482 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00cdf52-fe5f-4c02-a073-9b65f3fb5640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:51.401086 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9737199-bd20-4d65-bf67-446f11a36eca None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:51.415236 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-e00cdf52-fe5f-4c02-a073-9b65f3fb5640 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:27:51.416693 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-e00cdf52-fe5f-4c02-a073-9b65f3fb5640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:27:51.447780 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df654f6-961e-4096-ad37-64de979ea5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:51.449815 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df654f6-961e-4096-ad37-64de979ea5a3 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:51.450642 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df654f6-961e-4096-ad37-64de979ea5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:51.451496 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df654f6-961e-4096-ad37-64de979ea5a3 None admin] PATH_INFO: `/v3/groups/f919e7f564bb4057b35dbb12e59ceb96` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:51.454191 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df654f6-961e-4096-ad37-64de979ea5a3 None admin] RBAC: Authorizing `identity:get_group(group_id=f919e7f564bb4057b35dbb12e59ceb96)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:51.456908 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df654f6-961e-4096-ad37-64de979ea5a3 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:51.460108 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 190/378] 10.222.0.81 () {56 vars in 1180 bytes} [Mon Jul 18 16:27:51 2022] GET /identity/v3/groups/f919e7f564bb4057b35dbb12e59ceb96 => generated 226 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:51.462018 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df654f6-961e-4096-ad37-64de979ea5a3 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:51.498871 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 189/379] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:27:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:27:51.499801 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00cdf52-fe5f-4c02-a073-9b65f3fb5640 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:51.565491 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:51.609135 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:51.613576 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00cdf52-fe5f-4c02-a073-9b65f3fb5640 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:51.616732 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df654f6-961e-4096-ad37-64de979ea5a3 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:51.655789 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856b8ab0-1bdf-471d-a625-03773d00ed12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:51.655789 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b8ab0-1bdf-471d-a625-03773d00ed12 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:51.655789 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b8ab0-1bdf-471d-a625-03773d00ed12 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:51.655789 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b8ab0-1bdf-471d-a625-03773d00ed12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:51.656262 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856b8ab0-1bdf-471d-a625-03773d00ed12 None admin] RBAC: Adding query filter params (group.id=f919e7f564bb4057b35dbb12e59ceb96, role.id=6bfa001ddac347da894c7231f853c3df, scope.project.id=7f680cc460584bf688dae550c6a46776) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:51.656262 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856b8ab0-1bdf-471d-a625-03773d00ed12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:51.656396 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdfac9f-9423-490d-9348-f08b0107162b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:51.656963 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdfac9f-9423-490d-9348-f08b0107162b None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:51.657241 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdfac9f-9423-490d-9348-f08b0107162b None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:51.657338 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856b8ab0-1bdf-471d-a625-03773d00ed12 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:51.657519 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdfac9f-9423-490d-9348-f08b0107162b None admin] PATH_INFO: `/v3/groups/f2fdbef6b69c48c8a28886e7b4c7c018` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:51.664545 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdfac9f-9423-490d-9348-f08b0107162b None admin] RBAC: Authorizing `identity:get_group(group_id=f2fdbef6b69c48c8a28886e7b4c7c018)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:51.664734 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 190/380] 10.222.0.81 () {56 vars in 1376 bytes} [Mon Jul 18 16:27:51 2022] GET /identity/v3/role_assignments?group.id=f919e7f564bb4057b35dbb12e59ceb96&scope.project.id=7f680cc460584bf688dae550c6a46776&role.id=6bfa001ddac347da894c7231f853c3df => generated 260 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:51.665559 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856b8ab0-1bdf-471d-a625-03773d00ed12 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:51.666513 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdfac9f-9423-490d-9348-f08b0107162b None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:51.669483 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 191/381] 10.222.0.81 () {56 vars in 1180 bytes} [Mon Jul 18 16:27:51 2022] GET /identity/v3/groups/f2fdbef6b69c48c8a28886e7b4c7c018 => generated 229 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:51.681183 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdfac9f-9423-490d-9348-f08b0107162b None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:51.788323 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856b8ab0-1bdf-471d-a625-03773d00ed12 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:51.819106 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:51.832508 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ee502-8113-4c5e-b1ad-65f9ff628a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:51.833382 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ee502-8113-4c5e-b1ad-65f9ff628a37 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:51.833666 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ee502-8113-4c5e-b1ad-65f9ff628a37 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:51.833944 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ee502-8113-4c5e-b1ad-65f9ff628a37 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:51.848708 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ee502-8113-4c5e-b1ad-65f9ff628a37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:27:51.858867 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-ab0ee502-8113-4c5e-b1ad-65f9ff628a37 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 16:27:51.858867 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:27:51.858867 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:27:51.858867 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:27:51.858867 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:27:51.858867 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:27:51.858867 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:27:51.858867 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:27:51.858867 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:27:51.858867 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:27:51.858867 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:27:51.858867 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:27:51.858867 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:27:51.858867 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:27:51.858867 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:27:51.858867 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:27:51.860018 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:27:51.860018 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:27:51.860018 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:27:51.860018 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:27:51.860018 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:27:51.860018 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:27:51.860018 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:27:51.860018 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:27:51.860018 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:27:51.860018 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:27:51.860018 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:27:51.860018 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:27:51.860018 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:27:51.860018 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:27:51.860018 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:27:51.860018 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:27:51.860847 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:27:51.860847 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:27:51.860847 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:27:51.860847 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:27:51.860847 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:27:51.860847 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:27:51.860847 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:27:51.860847 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:27:51.860847 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:27:51.860847 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:27:51.860847 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 16:27:51.860847 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:27:51.860847 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 191/382] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Jul 18 16:27:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:27:51.866991 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ee502-8113-4c5e-b1ad-65f9ff628a37 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:51.877988 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdfac9f-9423-490d-9348-f08b0107162b None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:51.946504 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ff1e8a-03f2-47c1-8ea3-6e26b86ae53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:51.948341 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff1e8a-03f2-47c1-8ea3-6e26b86ae53b None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:51.948886 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff1e8a-03f2-47c1-8ea3-6e26b86ae53b None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:51.949381 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff1e8a-03f2-47c1-8ea3-6e26b86ae53b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:51.950742 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ff1e8a-03f2-47c1-8ea3-6e26b86ae53b None admin] RBAC: Adding query filter params (group.id=f2fdbef6b69c48c8a28886e7b4c7c018, role.id=fd83eab44cb343a2b532ce32a2ac31d8, scope.project.id=33688c7877734008b9dfee18021dbcd6) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:51.951322 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ff1e8a-03f2-47c1-8ea3-6e26b86ae53b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:51.953920 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ff1e8a-03f2-47c1-8ea3-6e26b86ae53b None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:51.962410 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 192/383] 10.222.0.81 () {56 vars in 1376 bytes} [Mon Jul 18 16:27:51 2022] GET /identity/v3/role_assignments?group.id=f2fdbef6b69c48c8a28886e7b4c7c018&scope.project.id=33688c7877734008b9dfee18021dbcd6&role.id=fd83eab44cb343a2b532ce32a2ac31d8 => generated 260 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:27:52.015015 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ee502-8113-4c5e-b1ad-65f9ff628a37 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:52.053891 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb1e8e4-6331-4c78-bd27-24a8f7f47085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:52.054588 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb1e8e4-6331-4c78-bd27-24a8f7f47085 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:52.054874 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb1e8e4-6331-4c78-bd27-24a8f7f47085 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:52.055153 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb1e8e4-6331-4c78-bd27-24a8f7f47085 None admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:52.055989 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb1e8e4-6331-4c78-bd27-24a8f7f47085 None admin] RBAC: Adding query filter params (name=member) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:52.056306 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb1e8e4-6331-4c78-bd27-24a8f7f47085 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:52.057734 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb1e8e4-6331-4c78-bd27-24a8f7f47085 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:52.068161 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 192/384] 10.222.0.81 () {56 vars in 1101 bytes} [Mon Jul 18 16:27:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:27:52.074059 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ff1e8a-03f2-47c1-8ea3-6e26b86ae53b None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:52.120475 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:52.233878 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ff1e8a-03f2-47c1-8ea3-6e26b86ae53b None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:52.277976 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549db733-bdaa-46c1-8ed1-2dfbcbc39547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:52.278850 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549db733-bdaa-46c1-8ed1-2dfbcbc39547 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:52.279161 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549db733-bdaa-46c1-8ed1-2dfbcbc39547 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:52.279465 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549db733-bdaa-46c1-8ed1-2dfbcbc39547 None admin] PATH_INFO: `/v3/groups/f919e7f564bb4057b35dbb12e59ceb96` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:52.280875 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549db733-bdaa-46c1-8ed1-2dfbcbc39547 None admin] RBAC: Authorizing `identity:get_group(group_id=f919e7f564bb4057b35dbb12e59ceb96)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:52.282380 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549db733-bdaa-46c1-8ed1-2dfbcbc39547 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:52.284469 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 193/385] 10.222.0.81 () {56 vars in 1180 bytes} [Mon Jul 18 16:27:52 2022] GET /identity/v3/groups/f919e7f564bb4057b35dbb12e59ceb96 => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:52.290064 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb1e8e4-6331-4c78-bd27-24a8f7f47085 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:52.337507 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:52.405632 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb1e8e4-6331-4c78-bd27-24a8f7f47085 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:52.442794 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211e178-dafe-406e-91d7-8d2966f9b60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:52.443831 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211e178-dafe-406e-91d7-8d2966f9b60d None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:52.444168 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211e178-dafe-406e-91d7-8d2966f9b60d None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:52.444334 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211e178-dafe-406e-91d7-8d2966f9b60d None admin] PATH_INFO: `/v3/projects/edc913ab51354b1da43bd3c47b3b2c51` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:52.445647 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5211e178-dafe-406e-91d7-8d2966f9b60d None admin] RBAC: Authorizing `identity:get_project(project_id=edc913ab51354b1da43bd3c47b3b2c51)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:52.447131 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5211e178-dafe-406e-91d7-8d2966f9b60d None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:52.449297 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 193/386] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Jul 18 16:27:52 2022] GET /identity/v3/projects/edc913ab51354b1da43bd3c47b3b2c51 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:52.455992 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549db733-bdaa-46c1-8ed1-2dfbcbc39547 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:52.593585 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:52.604158 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549db733-bdaa-46c1-8ed1-2dfbcbc39547 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:52.645628 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba8d8f1-efda-488b-a23f-72e987f5d042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:52.646538 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8d8f1-efda-488b-a23f-72e987f5d042 None admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:52.646816 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8d8f1-efda-488b-a23f-72e987f5d042 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:52.647085 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8d8f1-efda-488b-a23f-72e987f5d042 None admin] PATH_INFO: `/v3/projects/edc913ab51354b1da43bd3c47b3b2c51/groups/f919e7f564bb4057b35dbb12e59ceb96/roles/ad3a2bc7b2094a4da1a95a143c8d9436` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:52.650707 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba8d8f1-efda-488b-a23f-72e987f5d042 None admin] RBAC: Authorizing `identity:create_grant(project_id=edc913ab51354b1da43bd3c47b3b2c51, group_id=f919e7f564bb4057b35dbb12e59ceb96, role_id=ad3a2bc7b2094a4da1a95a143c8d9436)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:52.652239 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba8d8f1-efda-488b-a23f-72e987f5d042 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:52.729318 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 194/387] 10.222.0.81 () {58 vars in 1442 bytes} [Mon Jul 18 16:27:52 2022] PUT /identity/v3/projects/edc913ab51354b1da43bd3c47b3b2c51/groups/f919e7f564bb4057b35dbb12e59ceb96/roles/ad3a2bc7b2094a4da1a95a143c8d9436 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:27:53.057246 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63813489-71d1-4407-a9bb-3c3e4447778a None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:53.057950 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63813489-71d1-4407-a9bb-3c3e4447778a None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:53.058533 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63813489-71d1-4407-a9bb-3c3e4447778a None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:53.060466 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 194/388] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:27:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:27:53.069993 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1cc8b6-2d0f-43c7-9cac-de86a5ac9bea None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:53.070327 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1cc8b6-2d0f-43c7-9cac-de86a5ac9bea None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:53.070560 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1cc8b6-2d0f-43c7-9cac-de86a5ac9bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:53.089188 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-0e1cc8b6-2d0f-43c7-9cac-de86a5ac9bea None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:27:53.090396 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-0e1cc8b6-2d0f-43c7-9cac-de86a5ac9bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:27:53.175806 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 195/389] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:27:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:27:53.199734 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63813489-71d1-4407-a9bb-3c3e4447778a None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:53.220345 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6488219-6af7-4358-9263-8d13ddf8a3b0 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:53.220850 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6488219-6af7-4358-9263-8d13ddf8a3b0 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:53.221512 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6488219-6af7-4358-9263-8d13ddf8a3b0 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:53.224733 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 196/390] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:27:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:27:53.230153 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef66c2-f8aa-4514-83c8-1e6160872d8d None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:53.230433 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef66c2-f8aa-4514-83c8-1e6160872d8d None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:53.230707 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef66c2-f8aa-4514-83c8-1e6160872d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:53.261007 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-bdef66c2-f8aa-4514-83c8-1e6160872d8d None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:27:53.265029 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-bdef66c2-f8aa-4514-83c8-1e6160872d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:27:53.413512 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 197/391] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:27:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 16:27:53.427660 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63813489-71d1-4407-a9bb-3c3e4447778a None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:53.439604 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:53.445236 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef66c2-f8aa-4514-83c8-1e6160872d8d None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:53.460658 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:53.502025 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e65d61a-7931-4bcd-9545-34dcfdde6b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:53.503379 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65d61a-7931-4bcd-9545-34dcfdde6b81 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:53.503759 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65d61a-7931-4bcd-9545-34dcfdde6b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:53.504272 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65d61a-7931-4bcd-9545-34dcfdde6b81 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:53.530256 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e65d61a-7931-4bcd-9545-34dcfdde6b81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:27:53.542571 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-5e65d61a-7931-4bcd-9545-34dcfdde6b81 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 16:27:53.542571 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:27:53.542571 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:27:53.542571 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:27:53.542571 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:27:53.542571 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:27:53.542571 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:27:53.542571 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:27:53.542571 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:27:53.542571 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:27:53.542571 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:27:53.542571 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:27:53.542571 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:27:53.542571 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:27:53.542571 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:27:53.542571 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:27:53.543568 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:27:53.543568 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:27:53.543568 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:27:53.543568 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:27:53.543568 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:27:53.543568 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:27:53.543568 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:27:53.543568 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:27:53.543568 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:27:53.543568 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:27:53.543568 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:27:53.543568 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:27:53.543568 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:27:53.543568 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:27:53.543568 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:27:53.543568 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:27:53.544426 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:27:53.544426 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:27:53.544426 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:27:53.544426 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:27:53.544426 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:27:53.544426 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:27:53.544426 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:27:53.544426 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:27:53.544426 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:27:53.544426 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:27:53.544426 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 16:27:53.544426 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:27:53.551936 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 195/392] 10.222.0.81 () {56 vars in 1114 bytes} [Mon Jul 18 16:27:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:27:53.557738 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e65d61a-7931-4bcd-9545-34dcfdde6b81 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:53.655941 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef66c2-f8aa-4514-83c8-1e6160872d8d None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:53.745414 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1b5c31-d9dc-469a-bdb2-b6836903ffc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:53.746242 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b5c31-d9dc-469a-bdb2-b6836903ffc1 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:53.746527 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b5c31-d9dc-469a-bdb2-b6836903ffc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:53.746802 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b5c31-d9dc-469a-bdb2-b6836903ffc1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:53.756729 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e65d61a-7931-4bcd-9545-34dcfdde6b81 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:53.758761 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1b5c31-d9dc-469a-bdb2-b6836903ffc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:27:53.768250 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-6e1b5c31-d9dc-469a-bdb2-b6836903ffc1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 16:27:53.768250 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:27:53.768250 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:27:53.768250 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:27:53.768250 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:27:53.768250 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:27:53.768250 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:27:53.768250 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:27:53.768250 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:27:53.768250 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:27:53.768250 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:27:53.768250 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:27:53.768250 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:27:53.768250 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:27:53.768250 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:27:53.768250 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:27:53.770085 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:27:53.770085 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:27:53.770085 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:27:53.770085 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:27:53.770085 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:27:53.770085 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:27:53.770085 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:27:53.770085 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:27:53.770085 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:27:53.770085 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:27:53.770085 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:27:53.770085 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:27:53.770085 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:27:53.770085 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:27:53.770085 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:27:53.770085 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:27:53.773201 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:27:53.773201 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:27:53.773201 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:27:53.773201 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:27:53.773201 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:27:53.773201 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:27:53.773201 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:27:53.773201 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:27:53.773201 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:27:53.773201 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:27:53.773201 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 16:27:53.773201 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:27:53.773201 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 198/393] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Jul 18 16:27:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:27:53.785183 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1b5c31-d9dc-469a-bdb2-b6836903ffc1 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:53.809024 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02481f67-2884-4bd5-b254-d45ca74237e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:53.811812 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02481f67-2884-4bd5-b254-d45ca74237e7 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:53.813597 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02481f67-2884-4bd5-b254-d45ca74237e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:53.814090 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02481f67-2884-4bd5-b254-d45ca74237e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:53.815278 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02481f67-2884-4bd5-b254-d45ca74237e7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:53.815755 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02481f67-2884-4bd5-b254-d45ca74237e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:53.820405 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02481f67-2884-4bd5-b254-d45ca74237e7 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:53.853796 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 196/394] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Jul 18 16:27:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:53.869818 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02481f67-2884-4bd5-b254-d45ca74237e7 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:53.910527 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:53.960238 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:54.003499 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02481f67-2884-4bd5-b254-d45ca74237e7 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:54.034269 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1b5c31-d9dc-469a-bdb2-b6836903ffc1 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:54.051377 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c5b317-5c80-4e2e-b751-6e731b98b72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:54.052298 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5b317-5c80-4e2e-b751-6e731b98b72b None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:54.054672 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5b317-5c80-4e2e-b751-6e731b98b72b None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:54.054986 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5b317-5c80-4e2e-b751-6e731b98b72b None admin] PATH_INFO: `/v3/groups/f919e7f564bb4057b35dbb12e59ceb96` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:54.057642 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c5b317-5c80-4e2e-b751-6e731b98b72b None admin] RBAC: Authorizing `identity:get_group(group_id=f919e7f564bb4057b35dbb12e59ceb96)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:54.059107 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c5b317-5c80-4e2e-b751-6e731b98b72b None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:54.062301 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 197/395] 10.222.0.81 () {56 vars in 1180 bytes} [Mon Jul 18 16:27:53 2022] GET /identity/v3/groups/f919e7f564bb4057b35dbb12e59ceb96 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:27:54.073185 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c5b317-5c80-4e2e-b751-6e731b98b72b None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:54.094415 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5dae1b-d0bd-4f90-ad0b-c1b85d05a4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:54.095103 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5dae1b-d0bd-4f90-ad0b-c1b85d05a4b2 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:54.095380 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5dae1b-d0bd-4f90-ad0b-c1b85d05a4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:54.095651 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5dae1b-d0bd-4f90-ad0b-c1b85d05a4b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:54.096522 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5dae1b-d0bd-4f90-ad0b-c1b85d05a4b2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:54.096830 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5dae1b-d0bd-4f90-ad0b-c1b85d05a4b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:54.098231 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5dae1b-d0bd-4f90-ad0b-c1b85d05a4b2 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:54.116517 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 199/396] 10.222.0.81 () {56 vars in 1101 bytes} [Mon Jul 18 16:27:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:54.124268 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5dae1b-d0bd-4f90-ad0b-c1b85d05a4b2 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:54.287036 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:54.296795 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c5b317-5c80-4e2e-b751-6e731b98b72b None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:54.366184 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5dae1b-d0bd-4f90-ad0b-c1b85d05a4b2 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:54.390823 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa3d5ab-a93f-45e1-aee2-ffd4ff4d2018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:54.391691 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa3d5ab-a93f-45e1-aee2-ffd4ff4d2018 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:54.391994 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa3d5ab-a93f-45e1-aee2-ffd4ff4d2018 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:54.392261 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa3d5ab-a93f-45e1-aee2-ffd4ff4d2018 None admin] PATH_INFO: `/v3/projects/edc913ab51354b1da43bd3c47b3b2c51` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:54.394183 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa3d5ab-a93f-45e1-aee2-ffd4ff4d2018 None admin] RBAC: Authorizing `identity:get_project(project_id=edc913ab51354b1da43bd3c47b3b2c51)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:54.395706 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa3d5ab-a93f-45e1-aee2-ffd4ff4d2018 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:54.399581 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 198/397] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Jul 18 16:27:54 2022] GET /identity/v3/projects/edc913ab51354b1da43bd3c47b3b2c51 => generated 298 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:54.407185 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa3d5ab-a93f-45e1-aee2-ffd4ff4d2018 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:54.444176 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:54.449152 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c7d4b9-515d-43ca-ab7e-45d4741ae555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:54.450090 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7d4b9-515d-43ca-ab7e-45d4741ae555 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:54.450365 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7d4b9-515d-43ca-ab7e-45d4741ae555 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:54.450704 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7d4b9-515d-43ca-ab7e-45d4741ae555 None admin] PATH_INFO: `/v3/groups/f919e7f564bb4057b35dbb12e59ceb96` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:54.452577 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c7d4b9-515d-43ca-ab7e-45d4741ae555 None admin] RBAC: Authorizing `identity:get_group(group_id=f919e7f564bb4057b35dbb12e59ceb96)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:54.454036 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c7d4b9-515d-43ca-ab7e-45d4741ae555 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:54.457557 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 200/398] 10.222.0.81 () {56 vars in 1180 bytes} [Mon Jul 18 16:27:54 2022] GET /identity/v3/groups/f919e7f564bb4057b35dbb12e59ceb96 => generated 226 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:54.461724 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c7d4b9-515d-43ca-ab7e-45d4741ae555 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:54.646163 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa3d5ab-a93f-45e1-aee2-ffd4ff4d2018 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:54.726097 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d122efa-55f1-43ee-953c-83bcab8b4be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:54.729088 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c7d4b9-515d-43ca-ab7e-45d4741ae555 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:54.731307 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d122efa-55f1-43ee-953c-83bcab8b4be4 None admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:54.731595 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d122efa-55f1-43ee-953c-83bcab8b4be4 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:54.731904 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d122efa-55f1-43ee-953c-83bcab8b4be4 None admin] PATH_INFO: `/v3/projects/edc913ab51354b1da43bd3c47b3b2c51/groups/f919e7f564bb4057b35dbb12e59ceb96/roles/6bfa001ddac347da894c7231f853c3df` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:54.735096 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d122efa-55f1-43ee-953c-83bcab8b4be4 None admin] RBAC: Authorizing `identity:create_grant(project_id=edc913ab51354b1da43bd3c47b3b2c51, group_id=f919e7f564bb4057b35dbb12e59ceb96, role_id=6bfa001ddac347da894c7231f853c3df)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:54.736594 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d122efa-55f1-43ee-953c-83bcab8b4be4 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:54.778453 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0219ac7-e438-45c3-8d27-728e222d6312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:54.779399 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0219ac7-e438-45c3-8d27-728e222d6312 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:54.780265 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0219ac7-e438-45c3-8d27-728e222d6312 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:54.780545 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0219ac7-e438-45c3-8d27-728e222d6312 None admin] PATH_INFO: `/v3/projects/7f680cc460584bf688dae550c6a46776` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:54.781791 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0219ac7-e438-45c3-8d27-728e222d6312 None admin] RBAC: Authorizing `identity:get_project(project_id=7f680cc460584bf688dae550c6a46776)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:54.783254 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0219ac7-e438-45c3-8d27-728e222d6312 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:54.785563 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 201/399] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Jul 18 16:27:54 2022] GET /identity/v3/projects/7f680cc460584bf688dae550c6a46776 => generated 302 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:54.791385 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0219ac7-e438-45c3-8d27-728e222d6312 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:54.847862 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 199/400] 10.222.0.81 () {58 vars in 1442 bytes} [Mon Jul 18 16:27:54 2022] PUT /identity/v3/projects/edc913ab51354b1da43bd3c47b3b2c51/groups/f919e7f564bb4057b35dbb12e59ceb96/roles/6bfa001ddac347da894c7231f853c3df => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:27:54.850382 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f422ea1-4bd8-438b-8408-0be2be1f6fe1 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:54.850687 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f422ea1-4bd8-438b-8408-0be2be1f6fe1 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:54.850968 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f422ea1-4bd8-438b-8408-0be2be1f6fe1 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:54.861235 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 200/401] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:27:54 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:27:54.878429 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae4d94-adb4-4cf3-84e7-3afb778ac6d3 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:54.878729 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae4d94-adb4-4cf3-84e7-3afb778ac6d3 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:54.879057 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae4d94-adb4-4cf3-84e7-3afb778ac6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:54.892190 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:54.922249 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-72ae4d94-adb4-4cf3-84e7-3afb778ac6d3 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:27:54.923371 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-72ae4d94-adb4-4cf3-84e7-3afb778ac6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:27:54.964113 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:54.964952 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0219ac7-e438-45c3-8d27-728e222d6312 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:55.034066 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10058369-29c9-4df4-aee9-33ddeec7fba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:55.035824 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10058369-29c9-4df4-aee9-33ddeec7fba9 None admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:55.036479 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10058369-29c9-4df4-aee9-33ddeec7fba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:55.036974 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10058369-29c9-4df4-aee9-33ddeec7fba9 None admin] PATH_INFO: `/v3/projects/7f680cc460584bf688dae550c6a46776/groups/f919e7f564bb4057b35dbb12e59ceb96/roles/ad3a2bc7b2094a4da1a95a143c8d9436` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:55.039757 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10058369-29c9-4df4-aee9-33ddeec7fba9 None admin] RBAC: Authorizing `identity:create_grant(project_id=7f680cc460584bf688dae550c6a46776, group_id=f919e7f564bb4057b35dbb12e59ceb96, role_id=ad3a2bc7b2094a4da1a95a143c8d9436)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:55.042098 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10058369-29c9-4df4-aee9-33ddeec7fba9 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:55.058192 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 201/402] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:27:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:27:55.059363 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5454c3d2-96dd-4368-8421-708c7428c80b None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:55.059636 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5454c3d2-96dd-4368-8421-708c7428c80b None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:55.059967 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5454c3d2-96dd-4368-8421-708c7428c80b None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:55.061421 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 202/403] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:27:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:27:55.067633 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be869eb-c5e1-440c-8093-2a6b332b3c34 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:55.068556 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be869eb-c5e1-440c-8093-2a6b332b3c34 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:55.069046 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be869eb-c5e1-440c-8093-2a6b332b3c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:55.096463 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-8be869eb-c5e1-440c-8093-2a6b332b3c34 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:27:55.098284 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-8be869eb-c5e1-440c-8093-2a6b332b3c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:27:55.155256 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 202/404] 10.222.0.81 () {58 vars in 1442 bytes} [Mon Jul 18 16:27:54 2022] PUT /identity/v3/projects/7f680cc460584bf688dae550c6a46776/groups/f919e7f564bb4057b35dbb12e59ceb96/roles/ad3a2bc7b2094a4da1a95a143c8d9436 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:27:55.157152 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10058369-29c9-4df4-aee9-33ddeec7fba9 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:55.246016 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 203/405] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:27:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 16:27:55.306827 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10058369-29c9-4df4-aee9-33ddeec7fba9 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:55.310947 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be869eb-c5e1-440c-8093-2a6b332b3c34 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:55.343057 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:55.356502 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12492325-6252-4ba0-bb71-fd2b3c02402c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:55.357343 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12492325-6252-4ba0-bb71-fd2b3c02402c None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:55.357663 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12492325-6252-4ba0-bb71-fd2b3c02402c None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:55.359983 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12492325-6252-4ba0-bb71-fd2b3c02402c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:55.392352 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12492325-6252-4ba0-bb71-fd2b3c02402c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:27:55.408946 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-12492325-6252-4ba0-bb71-fd2b3c02402c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 16:27:55.408946 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:27:55.408946 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:27:55.408946 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:27:55.408946 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:27:55.408946 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:27:55.408946 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:27:55.408946 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:27:55.408946 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:27:55.408946 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:27:55.408946 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:27:55.408946 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:27:55.408946 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:27:55.408946 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:27:55.408946 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:27:55.408946 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:27:55.409945 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:27:55.409945 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:27:55.409945 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:27:55.409945 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:27:55.409945 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:27:55.409945 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:27:55.409945 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:27:55.409945 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:27:55.409945 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:27:55.409945 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:27:55.409945 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:27:55.409945 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:27:55.409945 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:27:55.409945 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:27:55.409945 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:27:55.409945 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:27:55.410767 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:27:55.410767 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:27:55.410767 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:27:55.410767 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:27:55.410767 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:27:55.410767 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:27:55.410767 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:27:55.410767 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:27:55.410767 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:27:55.410767 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:27:55.410767 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 16:27:55.410767 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:27:55.410767 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 203/406] 10.222.0.81 () {56 vars in 1114 bytes} [Mon Jul 18 16:27:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:27:55.417902 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12492325-6252-4ba0-bb71-fd2b3c02402c None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:55.447108 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:55.471117 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be869eb-c5e1-440c-8093-2a6b332b3c34 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:55.550317 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979b7bc2-e947-4d76-b7a2-9a429cdd41e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:55.551944 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b7bc2-e947-4d76-b7a2-9a429cdd41e4 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:55.552443 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b7bc2-e947-4d76-b7a2-9a429cdd41e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:55.553152 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b7bc2-e947-4d76-b7a2-9a429cdd41e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:55.569932 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979b7bc2-e947-4d76-b7a2-9a429cdd41e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:27:55.580470 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-979b7bc2-e947-4d76-b7a2-9a429cdd41e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:27:55.580470 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:27:55.580470 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:27:55.580470 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:27:55.580470 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:27:55.580470 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:27:55.580470 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:27:55.580470 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:27:55.580470 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:27:55.580470 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:27:55.580470 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:27:55.580470 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:27:55.580470 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:27:55.580470 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:27:55.580470 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:27:55.580470 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:27:55.585131 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:27:55.585131 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:27:55.585131 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:27:55.585131 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:27:55.585131 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:27:55.585131 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:27:55.585131 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:27:55.585131 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:27:55.585131 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:27:55.585131 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:27:55.585131 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:27:55.585131 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:27:55.585131 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:27:55.585131 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:27:55.585131 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:27:55.585131 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:27:55.586643 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:27:55.586643 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:27:55.586643 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:27:55.586643 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:27:55.586643 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:27:55.586643 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:27:55.586643 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:27:55.586643 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:27:55.586643 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:27:55.586643 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:27:55.586643 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:27:55.586643 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:27:55.586643 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 204/407] 10.222.0.81 () {56 vars in 1096 bytes} [Mon Jul 18 16:27:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:27:55.589097 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d177e1-b540-41c8-9e03-14670ae488ec None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:55.589259 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d177e1-b540-41c8-9e03-14670ae488ec None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:55.589644 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d177e1-b540-41c8-9e03-14670ae488ec None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:55.591652 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 205/408] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:27:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:27:55.592525 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12492325-6252-4ba0-bb71-fd2b3c02402c None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:55.593399 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d177e1-b540-41c8-9e03-14670ae488ec None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:55.634515 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0194b05f-0387-496b-9cfd-06b8607e44df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:55.635462 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194b05f-0387-496b-9cfd-06b8607e44df None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:55.635991 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194b05f-0387-496b-9cfd-06b8607e44df None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:55.636514 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194b05f-0387-496b-9cfd-06b8607e44df None admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:55.637484 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0194b05f-0387-496b-9cfd-06b8607e44df None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:55.637936 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0194b05f-0387-496b-9cfd-06b8607e44df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:55.640164 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0194b05f-0387-496b-9cfd-06b8607e44df None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:55.651004 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 204/409] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Jul 18 16:27:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:55.656968 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c13cf-5392-4f5a-9332-ce55237d55a8 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:55.657526 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c13cf-5392-4f5a-9332-ce55237d55a8 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:55.657958 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c13cf-5392-4f5a-9332-ce55237d55a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:55.677822 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-d16c13cf-5392-4f5a-9332-ce55237d55a8 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:27:55.680103 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-d16c13cf-5392-4f5a-9332-ce55237d55a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:27:55.712851 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d177e1-b540-41c8-9e03-14670ae488ec None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:55.738521 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:55.753592 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66633073-9866-4ce5-bc24-935ac347eb30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:55.754538 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66633073-9866-4ce5-bc24-935ac347eb30 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:55.754906 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66633073-9866-4ce5-bc24-935ac347eb30 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:55.755439 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66633073-9866-4ce5-bc24-935ac347eb30 None admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:55.756747 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66633073-9866-4ce5-bc24-935ac347eb30 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:55.757166 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66633073-9866-4ce5-bc24-935ac347eb30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:55.759424 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66633073-9866-4ce5-bc24-935ac347eb30 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:55.765088 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 205/410] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:27:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:27:55.766382 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c13cf-5392-4f5a-9332-ce55237d55a8 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:55.775844 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 206/411] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Jul 18 16:27:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:27:55.779833 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66633073-9866-4ce5-bc24-935ac347eb30 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:55.793143 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:55.898390 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c13cf-5392-4f5a-9332-ce55237d55a8 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:55.924896 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66633073-9866-4ce5-bc24-935ac347eb30 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:55.943334 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702cb9b3-d1c6-4978-b705-0e90eff194b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:55.944522 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702cb9b3-d1c6-4978-b705-0e90eff194b5 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:55.944802 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702cb9b3-d1c6-4978-b705-0e90eff194b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:55.945081 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702cb9b3-d1c6-4978-b705-0e90eff194b5 None admin] PATH_INFO: `/v3/groups/f919e7f564bb4057b35dbb12e59ceb96` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:55.946928 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702cb9b3-d1c6-4978-b705-0e90eff194b5 None admin] RBAC: Authorizing `identity:get_group(group_id=f919e7f564bb4057b35dbb12e59ceb96)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:55.948725 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702cb9b3-d1c6-4978-b705-0e90eff194b5 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:55.955366 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 206/412] 10.222.0.81 () {56 vars in 1180 bytes} [Mon Jul 18 16:27:55 2022] GET /identity/v3/groups/f919e7f564bb4057b35dbb12e59ceb96 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:55.955366 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702cb9b3-d1c6-4978-b705-0e90eff194b5 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:55.980968 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f6ea2-7b5b-4e30-baeb-745abf15d458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:55.982488 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f6ea2-7b5b-4e30-baeb-745abf15d458 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:55.983626 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f6ea2-7b5b-4e30-baeb-745abf15d458 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:55.984221 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f6ea2-7b5b-4e30-baeb-745abf15d458 None admin] PATH_INFO: `/v3/groups/f2fdbef6b69c48c8a28886e7b4c7c018` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:55.985802 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6f6ea2-7b5b-4e30-baeb-745abf15d458 None admin] RBAC: Authorizing `identity:get_group(group_id=f2fdbef6b69c48c8a28886e7b4c7c018)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:55.987666 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6f6ea2-7b5b-4e30-baeb-745abf15d458 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:55.990208 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 207/413] 10.222.0.81 () {56 vars in 1180 bytes} [Mon Jul 18 16:27:55 2022] GET /identity/v3/groups/f2fdbef6b69c48c8a28886e7b4c7c018 => generated 229 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:55.991268 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f6ea2-7b5b-4e30-baeb-745abf15d458 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:56.024609 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:56.093966 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:56.099985 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702cb9b3-d1c6-4978-b705-0e90eff194b5 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:56.136084 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f6ea2-7b5b-4e30-baeb-745abf15d458 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:56.144714 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be4f657-0eef-400d-b5e7-c15dd59ee4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:56.145532 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4f657-0eef-400d-b5e7-c15dd59ee4d1 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:56.145815 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4f657-0eef-400d-b5e7-c15dd59ee4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:56.146090 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4f657-0eef-400d-b5e7-c15dd59ee4d1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:56.159984 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be4f657-0eef-400d-b5e7-c15dd59ee4d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:27:56.169678 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-4be4f657-0eef-400d-b5e7-c15dd59ee4d1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 16:27:56.169678 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:27:56.169678 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:27:56.169678 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:27:56.169678 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:27:56.169678 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:27:56.169678 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:27:56.169678 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:27:56.169678 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:27:56.169678 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:27:56.169678 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:27:56.169678 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:27:56.169678 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:27:56.169678 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:27:56.169678 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:27:56.169678 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:27:56.171202 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:27:56.171202 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:27:56.171202 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:27:56.171202 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:27:56.171202 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:27:56.171202 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:27:56.171202 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:27:56.171202 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:27:56.171202 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:27:56.171202 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:27:56.171202 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:27:56.171202 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:27:56.171202 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:27:56.171202 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:27:56.171202 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:27:56.171202 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:27:56.172592 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:27:56.172592 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:27:56.172592 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:27:56.172592 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:27:56.172592 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:27:56.172592 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:27:56.172592 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:27:56.172592 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:27:56.172592 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:27:56.172592 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:27:56.172592 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 16:27:56.172592 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:27:56.172592 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 207/414] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Jul 18 16:27:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:27:56.172592 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be4f657-0eef-400d-b5e7-c15dd59ee4d1 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:56.206048 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db0c8e1-e554-4ba7-9ce1-c9db4077e07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:56.207323 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0c8e1-e554-4ba7-9ce1-c9db4077e07d None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:56.207874 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0c8e1-e554-4ba7-9ce1-c9db4077e07d None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:56.208348 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0c8e1-e554-4ba7-9ce1-c9db4077e07d None admin] PATH_INFO: `/v3/projects/7f680cc460584bf688dae550c6a46776` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:56.209879 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db0c8e1-e554-4ba7-9ce1-c9db4077e07d None admin] RBAC: Authorizing `identity:get_project(project_id=7f680cc460584bf688dae550c6a46776)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:56.211576 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db0c8e1-e554-4ba7-9ce1-c9db4077e07d None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:56.213665 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 208/415] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Jul 18 16:27:55 2022] GET /identity/v3/projects/7f680cc460584bf688dae550c6a46776 => generated 302 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:56.214706 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db0c8e1-e554-4ba7-9ce1-c9db4077e07d None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:56.335046 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be4f657-0eef-400d-b5e7-c15dd59ee4d1 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:56.346492 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:56.354545 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db0c8e1-e554-4ba7-9ce1-c9db4077e07d None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:56.377464 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0812a3-9930-463e-863b-23e3a2ac269d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:56.378669 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0812a3-9930-463e-863b-23e3a2ac269d None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:56.379209 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0812a3-9930-463e-863b-23e3a2ac269d None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:56.379895 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0812a3-9930-463e-863b-23e3a2ac269d None admin] PATH_INFO: `/v3/projects/33688c7877734008b9dfee18021dbcd6` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:56.381338 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0812a3-9930-463e-863b-23e3a2ac269d None admin] RBAC: Authorizing `identity:get_project(project_id=33688c7877734008b9dfee18021dbcd6)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:56.383347 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0812a3-9930-463e-863b-23e3a2ac269d None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:56.391286 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 208/416] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Jul 18 16:27:56 2022] GET /identity/v3/projects/33688c7877734008b9dfee18021dbcd6 => generated 344 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:56.392854 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0812a3-9930-463e-863b-23e3a2ac269d None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:56.399080 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7434409-6153-476c-893a-cf9adf5c2348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:56.399838 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7434409-6153-476c-893a-cf9adf5c2348 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:56.400062 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7434409-6153-476c-893a-cf9adf5c2348 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:56.400349 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7434409-6153-476c-893a-cf9adf5c2348 None admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:56.402123 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7434409-6153-476c-893a-cf9adf5c2348 None admin] RBAC: Adding query filter params (name=member) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:56.402434 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7434409-6153-476c-893a-cf9adf5c2348 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:56.403871 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7434409-6153-476c-893a-cf9adf5c2348 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:56.416565 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 209/417] 10.222.0.81 () {56 vars in 1101 bytes} [Mon Jul 18 16:27:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:56.417716 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7434409-6153-476c-893a-cf9adf5c2348 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:56.430764 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:56.538501 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0812a3-9930-463e-863b-23e3a2ac269d None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:56.566938 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7434409-6153-476c-893a-cf9adf5c2348 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:56.590047 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec6f321-7a62-4013-9058-b01e6d219bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:56.591833 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6f321-7a62-4013-9058-b01e6d219bb6 None admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:56.592940 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6f321-7a62-4013-9058-b01e6d219bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:56.593963 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6f321-7a62-4013-9058-b01e6d219bb6 None admin] PATH_INFO: `/v3/projects/7f680cc460584bf688dae550c6a46776/groups/f919e7f564bb4057b35dbb12e59ceb96/roles/6bfa001ddac347da894c7231f853c3df` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:56.597300 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec6f321-7a62-4013-9058-b01e6d219bb6 None admin] RBAC: Authorizing `identity:create_grant(project_id=7f680cc460584bf688dae550c6a46776, group_id=f919e7f564bb4057b35dbb12e59ceb96, role_id=6bfa001ddac347da894c7231f853c3df)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:56.600124 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec6f321-7a62-4013-9058-b01e6d219bb6 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:56.615012 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f525af-3f49-4166-98f6-997192f174cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:56.615932 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f525af-3f49-4166-98f6-997192f174cf None admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:56.616215 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f525af-3f49-4166-98f6-997192f174cf None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:56.616491 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f525af-3f49-4166-98f6-997192f174cf None admin] PATH_INFO: `/v3/projects/33688c7877734008b9dfee18021dbcd6/groups/f2fdbef6b69c48c8a28886e7b4c7c018/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:56.618496 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f525af-3f49-4166-98f6-997192f174cf None admin] RBAC: Authorizing `identity:create_grant(project_id=33688c7877734008b9dfee18021dbcd6, group_id=f2fdbef6b69c48c8a28886e7b4c7c018, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:56.619986 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f525af-3f49-4166-98f6-997192f174cf None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:56.735030 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 209/418] 10.222.0.81 () {58 vars in 1442 bytes} [Mon Jul 18 16:27:56 2022] PUT /identity/v3/projects/7f680cc460584bf688dae550c6a46776/groups/f919e7f564bb4057b35dbb12e59ceb96/roles/6bfa001ddac347da894c7231f853c3df => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:27:56.735030 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec6f321-7a62-4013-9058-b01e6d219bb6 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:56.770568 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 210/419] 10.222.0.81 () {58 vars in 1442 bytes} [Mon Jul 18 16:27:56 2022] PUT /identity/v3/projects/33688c7877734008b9dfee18021dbcd6/groups/f2fdbef6b69c48c8a28886e7b4c7c018/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:27:56.813187 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:56.914900 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec6f321-7a62-4013-9058-b01e6d219bb6 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:56.966466 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8382c373-f0d0-47ef-9cd8-f098c9ac9239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:56.967679 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382c373-f0d0-47ef-9cd8-f098c9ac9239 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:56.968005 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382c373-f0d0-47ef-9cd8-f098c9ac9239 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:56.968336 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382c373-f0d0-47ef-9cd8-f098c9ac9239 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:57.081818 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8382c373-f0d0-47ef-9cd8-f098c9ac9239 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:57.083592 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8382c373-f0d0-47ef-9cd8-f098c9ac9239 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:57.131327 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:57.173205 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f6500-5928-4e2b-9337-f7ceb10c847c None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:57.173760 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f6500-5928-4e2b-9337-f7ceb10c847c None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:57.174048 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f6500-5928-4e2b-9337-f7ceb10c847c None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:57.179941 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 211/420] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:27:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:27:57.182037 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e21a63-2913-42f8-a569-c96478674aec None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:57.182534 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e21a63-2913-42f8-a569-c96478674aec None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:57.183032 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e21a63-2913-42f8-a569-c96478674aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:57.202046 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-a4e21a63-2913-42f8-a569-c96478674aec None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:27:57.203788 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-a4e21a63-2913-42f8-a569-c96478674aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:27:57.231835 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 210/421] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Jul 18 16:27:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:27:57.244029 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8382c373-f0d0-47ef-9cd8-f098c9ac9239 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:57.349475 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:57.364594 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 212/422] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:27:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 16:27:57.400938 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e21a63-2913-42f8-a569-c96478674aec None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:57.435893 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8382c373-f0d0-47ef-9cd8-f098c9ac9239 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:57.502466 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a740b-8aa9-4ab7-98e4-39ed00f43edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:57.503330 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a740b-8aa9-4ab7-98e4-39ed00f43edc None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:57.503605 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a740b-8aa9-4ab7-98e4-39ed00f43edc None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:57.503900 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a740b-8aa9-4ab7-98e4-39ed00f43edc None admin] PATH_INFO: `/v3/projects/edc913ab51354b1da43bd3c47b3b2c51` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:57.505671 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a740b-8aa9-4ab7-98e4-39ed00f43edc None admin] RBAC: Authorizing `identity:get_project(project_id=edc913ab51354b1da43bd3c47b3b2c51)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:57.507115 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a740b-8aa9-4ab7-98e4-39ed00f43edc None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:57.509379 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 211/423] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Jul 18 16:27:57 2022] GET /identity/v3/projects/edc913ab51354b1da43bd3c47b3b2c51 => generated 298 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:27:57.510554 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b5b375-ec6b-4f11-b668-bd966c96ada5 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:57.511180 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b5b375-ec6b-4f11-b668-bd966c96ada5 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:57.511180 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b5b375-ec6b-4f11-b668-bd966c96ada5 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:57.517794 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 212/424] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:27:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:27:57.518637 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b5b375-ec6b-4f11-b668-bd966c96ada5 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:57.524069 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:57.563285 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e21a63-2913-42f8-a569-c96478674aec None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:57.602822 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b71e1-e5b1-478a-b6ac-39aa5ce695e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:57.604061 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b71e1-e5b1-478a-b6ac-39aa5ce695e9 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:57.604549 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b71e1-e5b1-478a-b6ac-39aa5ce695e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:57.605057 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b71e1-e5b1-478a-b6ac-39aa5ce695e9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:57.617215 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524b71e1-e5b1-478a-b6ac-39aa5ce695e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:27:57.626648 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-524b71e1-e5b1-478a-b6ac-39aa5ce695e9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 16:27:57.626648 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:27:57.626648 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:27:57.626648 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:27:57.626648 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:27:57.626648 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:27:57.626648 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:27:57.626648 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:27:57.626648 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:27:57.626648 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:27:57.626648 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:27:57.626648 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:27:57.626648 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:27:57.626648 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:27:57.626648 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:27:57.626648 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:27:57.627550 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:27:57.627550 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:27:57.627550 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:27:57.627550 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:27:57.627550 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:27:57.627550 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:27:57.627550 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:27:57.627550 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:27:57.627550 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:27:57.627550 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:27:57.627550 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:27:57.627550 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:27:57.627550 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:27:57.627550 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:27:57.627550 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:27:57.627550 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:27:57.628407 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:27:57.628407 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:27:57.628407 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:27:57.628407 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:27:57.628407 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:27:57.628407 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:27:57.628407 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:27:57.628407 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:27:57.628407 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:27:57.628407 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:27:57.628407 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 16:27:57.628407 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:27:57.629737 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 213/425] 10.222.0.81 () {56 vars in 1114 bytes} [Mon Jul 18 16:27:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:27:57.630669 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0afa0-7e90-4a58-93a6-948daa2dc470 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:57.630947 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0afa0-7e90-4a58-93a6-948daa2dc470 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:57.631219 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0afa0-7e90-4a58-93a6-948daa2dc470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:57.633881 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b5b375-ec6b-4f11-b668-bd966c96ada5 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:57.650608 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-5ee0afa0-7e90-4a58-93a6-948daa2dc470 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:27:57.652170 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-5ee0afa0-7e90-4a58-93a6-948daa2dc470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:27:57.681050 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f7604-2d34-4401-a129-5f99a6dccd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:57.681958 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f7604-2d34-4401-a129-5f99a6dccd6f None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:57.682237 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f7604-2d34-4401-a129-5f99a6dccd6f None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:57.682508 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f7604-2d34-4401-a129-5f99a6dccd6f None admin] PATH_INFO: `/v3/groups/f919e7f564bb4057b35dbb12e59ceb96` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:57.683769 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9f7604-2d34-4401-a129-5f99a6dccd6f None admin] RBAC: Authorizing `identity:get_group(group_id=f919e7f564bb4057b35dbb12e59ceb96)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:57.686793 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9f7604-2d34-4401-a129-5f99a6dccd6f None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:57.693938 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 213/426] 10.222.0.81 () {56 vars in 1180 bytes} [Mon Jul 18 16:27:57 2022] GET /identity/v3/groups/f919e7f564bb4057b35dbb12e59ceb96 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:57.695618 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f7604-2d34-4401-a129-5f99a6dccd6f None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:57.712848 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:57.737807 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 214/427] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:27:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:27:57.739062 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee0afa0-7e90-4a58-93a6-948daa2dc470 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:57.780463 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:57.812590 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f7604-2d34-4401-a129-5f99a6dccd6f None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:57.849363 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28397ec6-8cc8-44ab-8d0a-5ead3917456c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:57.850033 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28397ec6-8cc8-44ab-8d0a-5ead3917456c None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:57.850311 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28397ec6-8cc8-44ab-8d0a-5ead3917456c None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:57.850680 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28397ec6-8cc8-44ab-8d0a-5ead3917456c None admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:57.851327 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28397ec6-8cc8-44ab-8d0a-5ead3917456c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:57.851868 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28397ec6-8cc8-44ab-8d0a-5ead3917456c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:57.855510 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28397ec6-8cc8-44ab-8d0a-5ead3917456c None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:57.865771 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 214/428] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Jul 18 16:27:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:57.866631 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28397ec6-8cc8-44ab-8d0a-5ead3917456c None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:57.908476 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee0afa0-7e90-4a58-93a6-948daa2dc470 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:57.954616 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53fe055-d854-4bb0-9858-0ee5860ff630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:57.955328 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53fe055-d854-4bb0-9858-0ee5860ff630 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:57.955613 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53fe055-d854-4bb0-9858-0ee5860ff630 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:57.955914 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53fe055-d854-4bb0-9858-0ee5860ff630 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:57.957193 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53fe055-d854-4bb0-9858-0ee5860ff630 None admin] RBAC: Adding query filter params (group.id=f919e7f564bb4057b35dbb12e59ceb96, role.id=ad3a2bc7b2094a4da1a95a143c8d9436, scope.project.id=edc913ab51354b1da43bd3c47b3b2c51) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:57.957306 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53fe055-d854-4bb0-9858-0ee5860ff630 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:57.958746 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53fe055-d854-4bb0-9858-0ee5860ff630 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:57.970513 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 215/429] 10.222.0.81 () {56 vars in 1376 bytes} [Mon Jul 18 16:27:57 2022] GET /identity/v3/role_assignments?group.id=f919e7f564bb4057b35dbb12e59ceb96&scope.project.id=edc913ab51354b1da43bd3c47b3b2c51&role.id=ad3a2bc7b2094a4da1a95a143c8d9436 => generated 611 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:57.971882 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53fe055-d854-4bb0-9858-0ee5860ff630 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:58.007377 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28397ec6-8cc8-44ab-8d0a-5ead3917456c None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:58.062837 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f59440-ec8c-4e4b-a480-dcf235588041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:58.063853 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f59440-ec8c-4e4b-a480-dcf235588041 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:58.064139 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f59440-ec8c-4e4b-a480-dcf235588041 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:58.064413 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f59440-ec8c-4e4b-a480-dcf235588041 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:58.065206 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:58.066617 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:58.079202 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f59440-ec8c-4e4b-a480-dcf235588041 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:27:58.087491 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-59f59440-ec8c-4e4b-a480-dcf235588041 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 16:27:58.087491 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:27:58.087491 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:27:58.087491 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:27:58.087491 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:27:58.087491 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:27:58.087491 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:27:58.087491 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:27:58.087491 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:27:58.087491 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:27:58.087491 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:27:58.087491 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:27:58.087491 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:27:58.087491 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:27:58.087491 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:27:58.087491 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:27:58.088619 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:27:58.088619 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:27:58.088619 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:27:58.088619 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:27:58.088619 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:27:58.088619 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:27:58.088619 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:27:58.088619 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:27:58.088619 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:27:58.088619 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:27:58.088619 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:27:58.088619 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:27:58.088619 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:27:58.088619 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:27:58.088619 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:27:58.088619 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:27:58.089451 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:27:58.089451 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:27:58.089451 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:27:58.089451 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:27:58.089451 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:27:58.089451 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:27:58.089451 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:27:58.089451 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:27:58.089451 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:27:58.089451 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:27:58.089451 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 16:27:58.089451 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:27:58.089451 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 215/430] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Jul 18 16:27:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:27:58.097700 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f59440-ec8c-4e4b-a480-dcf235588041 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:58.148182 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53fe055-d854-4bb0-9858-0ee5860ff630 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:58.209994 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4a95ba-b6ce-4cfb-850d-2707403367f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:58.211062 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a95ba-b6ce-4cfb-850d-2707403367f3 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:58.211580 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a95ba-b6ce-4cfb-850d-2707403367f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:58.212108 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a95ba-b6ce-4cfb-850d-2707403367f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:58.222684 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f59440-ec8c-4e4b-a480-dcf235588041 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:58.265726 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23612245-8d6e-4e1f-aeb8-f6d7ffb42322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:58.266530 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23612245-8d6e-4e1f-aeb8-f6d7ffb42322 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:58.266821 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23612245-8d6e-4e1f-aeb8-f6d7ffb42322 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:58.267093 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23612245-8d6e-4e1f-aeb8-f6d7ffb42322 None admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:58.267900 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23612245-8d6e-4e1f-aeb8-f6d7ffb42322 None admin] RBAC: Adding query filter params (name=member) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:58.268233 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23612245-8d6e-4e1f-aeb8-f6d7ffb42322 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:58.269875 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23612245-8d6e-4e1f-aeb8-f6d7ffb42322 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:58.280628 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 216/431] 10.222.0.81 () {56 vars in 1101 bytes} [Mon Jul 18 16:27:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:58.286831 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23612245-8d6e-4e1f-aeb8-f6d7ffb42322 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:58.295760 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4a95ba-b6ce-4cfb-850d-2707403367f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:58.297588 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4a95ba-b6ce-4cfb-850d-2707403367f3 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:58.354308 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:58.359946 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:58.410433 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23612245-8d6e-4e1f-aeb8-f6d7ffb42322 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:58.415102 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 216/432] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Jul 18 16:27:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:27:58.421321 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4a95ba-b6ce-4cfb-850d-2707403367f3 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:58.461112 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd31dfd-4b25-4a9b-bd3e-a6e48bda6a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:58.462271 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd31dfd-4b25-4a9b-bd3e-a6e48bda6a54 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:58.462869 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd31dfd-4b25-4a9b-bd3e-a6e48bda6a54 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:58.463352 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd31dfd-4b25-4a9b-bd3e-a6e48bda6a54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:58.546878 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd31dfd-4b25-4a9b-bd3e-a6e48bda6a54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:58.547207 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4a95ba-b6ce-4cfb-850d-2707403367f3 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:58.549106 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd31dfd-4b25-4a9b-bd3e-a6e48bda6a54 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:58.586312 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de608afd-41a6-4223-98c1-e50291dcb710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:58.587176 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de608afd-41a6-4223-98c1-e50291dcb710 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:58.587455 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de608afd-41a6-4223-98c1-e50291dcb710 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:58.587751 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de608afd-41a6-4223-98c1-e50291dcb710 None admin] PATH_INFO: `/v3/projects/edc913ab51354b1da43bd3c47b3b2c51` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:58.589802 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de608afd-41a6-4223-98c1-e50291dcb710 None admin] RBAC: Authorizing `identity:get_project(project_id=edc913ab51354b1da43bd3c47b3b2c51)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:58.592180 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de608afd-41a6-4223-98c1-e50291dcb710 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:58.594357 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 217/433] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Jul 18 16:27:58 2022] GET /identity/v3/projects/edc913ab51354b1da43bd3c47b3b2c51 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:58.604796 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de608afd-41a6-4223-98c1-e50291dcb710 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:58.614850 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:58.627540 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:58.669035 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 217/434] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Jul 18 16:27:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 18 16:27:58.675456 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd31dfd-4b25-4a9b-bd3e-a6e48bda6a54 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:58.722662 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de608afd-41a6-4223-98c1-e50291dcb710 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:58.760848 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c5bc09-932a-44f2-a015-37b4773610a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:58.761871 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5bc09-932a-44f2-a015-37b4773610a7 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:58.762256 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5bc09-932a-44f2-a015-37b4773610a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:58.762640 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5bc09-932a-44f2-a015-37b4773610a7 None admin] PATH_INFO: `/v3/groups/f919e7f564bb4057b35dbb12e59ceb96` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:58.764069 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c5bc09-932a-44f2-a015-37b4773610a7 None admin] RBAC: Authorizing `identity:get_group(group_id=f919e7f564bb4057b35dbb12e59ceb96)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:58.765691 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c5bc09-932a-44f2-a015-37b4773610a7 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:58.767816 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 218/435] 10.222.0.81 () {56 vars in 1180 bytes} [Mon Jul 18 16:27:58 2022] GET /identity/v3/groups/f919e7f564bb4057b35dbb12e59ceb96 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:58.774600 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c5bc09-932a-44f2-a015-37b4773610a7 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:58.798764 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd31dfd-4b25-4a9b-bd3e-a6e48bda6a54 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:58.843472 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16d2d09-ecd5-4f00-8a90-fbf4b4443152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:58.844690 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d2d09-ecd5-4f00-8a90-fbf4b4443152 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:58.845153 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d2d09-ecd5-4f00-8a90-fbf4b4443152 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:58.845608 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d2d09-ecd5-4f00-8a90-fbf4b4443152 None admin] PATH_INFO: `/v3/projects/7f680cc460584bf688dae550c6a46776` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:58.847073 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16d2d09-ecd5-4f00-8a90-fbf4b4443152 None admin] RBAC: Authorizing `identity:get_project(project_id=7f680cc460584bf688dae550c6a46776)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:58.848747 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16d2d09-ecd5-4f00-8a90-fbf4b4443152 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:58.850953 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 218/436] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Jul 18 16:27:58 2022] GET /identity/v3/projects/7f680cc460584bf688dae550c6a46776 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:27:58.857053 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16d2d09-ecd5-4f00-8a90-fbf4b4443152 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:58.892842 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:58.896245 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:58.912959 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c5bc09-932a-44f2-a015-37b4773610a7 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:58.959862 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3125b3-95cb-4753-8f41-d407666db273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:58.960503 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3125b3-95cb-4753-8f41-d407666db273 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:58.960503 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3125b3-95cb-4753-8f41-d407666db273 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:58.960812 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3125b3-95cb-4753-8f41-d407666db273 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:58.961615 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3125b3-95cb-4753-8f41-d407666db273 None admin] RBAC: Adding query filter params (group.id=f919e7f564bb4057b35dbb12e59ceb96, role.id=6bfa001ddac347da894c7231f853c3df, scope.project.id=edc913ab51354b1da43bd3c47b3b2c51) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:58.961947 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3125b3-95cb-4753-8f41-d407666db273 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:58.963840 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3125b3-95cb-4753-8f41-d407666db273 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:58.975324 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 219/437] 10.222.0.81 () {56 vars in 1376 bytes} [Mon Jul 18 16:27:58 2022] GET /identity/v3/role_assignments?group.id=f919e7f564bb4057b35dbb12e59ceb96&scope.project.id=edc913ab51354b1da43bd3c47b3b2c51&role.id=6bfa001ddac347da894c7231f853c3df => generated 611 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:59.016597 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16d2d09-ecd5-4f00-8a90-fbf4b4443152 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:59.065778 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef92ec9-e54a-4315-b71c-478930183e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:59.066691 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef92ec9-e54a-4315-b71c-478930183e90 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:59.066974 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef92ec9-e54a-4315-b71c-478930183e90 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:59.067253 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef92ec9-e54a-4315-b71c-478930183e90 None admin] PATH_INFO: `/v3/groups/f919e7f564bb4057b35dbb12e59ceb96` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:59.068648 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef92ec9-e54a-4315-b71c-478930183e90 None admin] RBAC: Authorizing `identity:get_group(group_id=f919e7f564bb4057b35dbb12e59ceb96)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:59.070362 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef92ec9-e54a-4315-b71c-478930183e90 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:59.072481 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 219/438] 10.222.0.81 () {56 vars in 1180 bytes} [Mon Jul 18 16:27:58 2022] GET /identity/v3/groups/f919e7f564bb4057b35dbb12e59ceb96 => generated 226 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:27:59.078626 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3125b3-95cb-4753-8f41-d407666db273 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:59.230929 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3125b3-95cb-4753-8f41-d407666db273 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:59.299501 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d396cc-1ddc-40d8-a531-eab0a8fbafb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:59.300697 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d396cc-1ddc-40d8-a531-eab0a8fbafb9 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:59.301198 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d396cc-1ddc-40d8-a531-eab0a8fbafb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:59.301698 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d396cc-1ddc-40d8-a531-eab0a8fbafb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:59.303319 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d396cc-1ddc-40d8-a531-eab0a8fbafb9 None admin] RBAC: Adding query filter params (group.id=f919e7f564bb4057b35dbb12e59ceb96, role.id=ad3a2bc7b2094a4da1a95a143c8d9436, scope.project.id=7f680cc460584bf688dae550c6a46776) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:59.303933 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d396cc-1ddc-40d8-a531-eab0a8fbafb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:59.306721 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d396cc-1ddc-40d8-a531-eab0a8fbafb9 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:59.315953 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f07d51-5ed1-40ff-b807-9857152bc8f3 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:59.316260 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f07d51-5ed1-40ff-b807-9857152bc8f3 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:59.316515 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f07d51-5ed1-40ff-b807-9857152bc8f3 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:59.318262 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 220/439] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:27:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:27:59.318597 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 220/440] 10.222.0.81 () {56 vars in 1376 bytes} [Mon Jul 18 16:27:59 2022] GET /identity/v3/role_assignments?group.id=f919e7f564bb4057b35dbb12e59ceb96&scope.project.id=7f680cc460584bf688dae550c6a46776&role.id=ad3a2bc7b2094a4da1a95a143c8d9436 => generated 611 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:27:59.324179 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b9d45c-0b0d-4eb8-b517-f258c422febf None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:59.324549 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b9d45c-0b0d-4eb8-b517-f258c422febf None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:59.324839 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b9d45c-0b0d-4eb8-b517-f258c422febf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:59.345307 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-92b9d45c-0b0d-4eb8-b517-f258c422febf None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:27:59.346604 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-92b9d45c-0b0d-4eb8-b517-f258c422febf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:27:59.453094 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 221/441] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:27:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:27:59.472800 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e20f684-5b47-4d61-9ccf-72cf2e7f89fb None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:59.473442 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e20f684-5b47-4d61-9ccf-72cf2e7f89fb None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:59.473920 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e20f684-5b47-4d61-9ccf-72cf2e7f89fb None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:59.475535 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 221/442] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:27:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:27:59.482383 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040978b-6ac8-4f61-ba83-809c9fd7bbe3 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:59.483356 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040978b-6ac8-4f61-ba83-809c9fd7bbe3 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:59.483456 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040978b-6ac8-4f61-ba83-809c9fd7bbe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:59.485554 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e20f684-5b47-4d61-9ccf-72cf2e7f89fb None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:59.502767 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-b040978b-6ac8-4f61-ba83-809c9fd7bbe3 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:27:59.507234 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-b040978b-6ac8-4f61-ba83-809c9fd7bbe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:27:59.507403 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:59.526654 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:59.595278 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 222/443] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:27:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:27:59.619471 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b040978b-6ac8-4f61-ba83-809c9fd7bbe3 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:59.631391 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e20f684-5b47-4d61-9ccf-72cf2e7f89fb None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:59.677479 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77a8a69-c3d2-4dd9-a9e8-4a3de3b85a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:59.677714 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a8a69-c3d2-4dd9-a9e8-4a3de3b85a33 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:59.677980 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a8a69-c3d2-4dd9-a9e8-4a3de3b85a33 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:59.678242 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a8a69-c3d2-4dd9-a9e8-4a3de3b85a33 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:59.690897 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77a8a69-c3d2-4dd9-a9e8-4a3de3b85a33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:27:59.698685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-a77a8a69-c3d2-4dd9-a9e8-4a3de3b85a33 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:27:59.698685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:27:59.698685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:27:59.698685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:27:59.698685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:27:59.698685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:27:59.698685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:27:59.698685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:27:59.698685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:27:59.698685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:27:59.698685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:27:59.698685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:27:59.698685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:27:59.698685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:27:59.698685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:27:59.698685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:27:59.699899 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:27:59.699899 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:27:59.699899 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:27:59.699899 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:27:59.699899 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:27:59.699899 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:27:59.699899 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:27:59.699899 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:27:59.699899 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:27:59.699899 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:27:59.699899 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:27:59.699899 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:27:59.699899 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:27:59.699899 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:27:59.699899 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:27:59.699899 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:27:59.700918 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:27:59.700918 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:27:59.700918 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:27:59.700918 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:27:59.700918 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:27:59.700918 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:27:59.700918 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:27:59.700918 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:27:59.700918 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:27:59.700918 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:27:59.700918 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:27:59.700918 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:27:59.700918 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 222/444] 10.222.0.81 () {56 vars in 1096 bytes} [Mon Jul 18 16:27:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:27:59.705792 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77a8a69-c3d2-4dd9-a9e8-4a3de3b85a33 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:59.740379 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b040978b-6ac8-4f61-ba83-809c9fd7bbe3 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:59.782803 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac87ae0b-fceb-4f86-9789-b81bb538c097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:59.785212 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87ae0b-fceb-4f86-9789-b81bb538c097 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:59.785212 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87ae0b-fceb-4f86-9789-b81bb538c097 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:59.785212 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87ae0b-fceb-4f86-9789-b81bb538c097 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:59.785462 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:59.796708 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac87ae0b-fceb-4f86-9789-b81bb538c097 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:27:59.805337 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-ac87ae0b-fceb-4f86-9789-b81bb538c097 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 16:27:59.805337 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:27:59.805337 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:27:59.805337 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:27:59.805337 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:27:59.805337 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:27:59.805337 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:27:59.805337 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:27:59.805337 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:27:59.805337 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:27:59.805337 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:27:59.805337 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:27:59.805337 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:27:59.805337 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:27:59.805337 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:27:59.805337 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:27:59.806546 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:27:59.806546 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:27:59.806546 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:27:59.806546 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:27:59.806546 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:27:59.806546 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:27:59.806546 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:27:59.806546 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:27:59.806546 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:27:59.806546 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:27:59.806546 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:27:59.806546 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:27:59.806546 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:27:59.806546 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:27:59.806546 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:27:59.806546 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:27:59.808679 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:27:59.808679 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:27:59.808679 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:27:59.808679 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:27:59.808679 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:27:59.808679 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:27:59.808679 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:27:59.808679 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:27:59.808679 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:27:59.808679 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:27:59.808679 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 16:27:59.808679 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:27:59.808679 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 223/445] 10.222.0.81 () {56 vars in 1114 bytes} [Mon Jul 18 16:27:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:27:59.813118 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac87ae0b-fceb-4f86-9789-b81bb538c097 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:59.817624 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77a8a69-c3d2-4dd9-a9e8-4a3de3b85a33 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:59.830069 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:27:59.865767 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cfb366-63bf-4da9-b638-551f6f14ec02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:59.866439 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cfb366-63bf-4da9-b638-551f6f14ec02 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:59.866716 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cfb366-63bf-4da9-b638-551f6f14ec02 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:59.867087 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cfb366-63bf-4da9-b638-551f6f14ec02 None admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:59.867877 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cfb366-63bf-4da9-b638-551f6f14ec02 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:59.868182 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cfb366-63bf-4da9-b638-551f6f14ec02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:59.870074 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cfb366-63bf-4da9-b638-551f6f14ec02 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:59.883163 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 223/446] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Jul 18 16:27:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:27:59.889680 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cfb366-63bf-4da9-b638-551f6f14ec02 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:27:59.942199 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac87ae0b-fceb-4f86-9789-b81bb538c097 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:27:59.983227 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c51057-620d-434e-a4f0-45a955c39596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:27:59.984200 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c51057-620d-434e-a4f0-45a955c39596 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:27:59.984977 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c51057-620d-434e-a4f0-45a955c39596 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:27:59.985132 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c51057-620d-434e-a4f0-45a955c39596 None admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:27:59.986144 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c51057-620d-434e-a4f0-45a955c39596 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:27:59.986585 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c51057-620d-434e-a4f0-45a955c39596 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:27:59.988272 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c51057-620d-434e-a4f0-45a955c39596 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:27:59.997296 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 224/447] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Jul 18 16:27:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:28:00.003379 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c51057-620d-434e-a4f0-45a955c39596 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:00.011888 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cfb366-63bf-4da9-b638-551f6f14ec02 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:00.047215 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639c99c8-ec8b-4e7d-be2c-bb8e3a9859db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:00.047897 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c99c8-ec8b-4e7d-be2c-bb8e3a9859db None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:00.048181 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c99c8-ec8b-4e7d-be2c-bb8e3a9859db None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:00.048459 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c99c8-ec8b-4e7d-be2c-bb8e3a9859db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:00.052034 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:00.084225 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:00.110131 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c51057-620d-434e-a4f0-45a955c39596 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:00.130946 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639c99c8-ec8b-4e7d-be2c-bb8e3a9859db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:00.132522 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639c99c8-ec8b-4e7d-be2c-bb8e3a9859db None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:00.146727 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb3890-bed9-4cfc-8f9a-fcb7123ef3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:00.147392 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb3890-bed9-4cfc-8f9a-fcb7123ef3a2 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:00.147986 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb3890-bed9-4cfc-8f9a-fcb7123ef3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:00.148179 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb3890-bed9-4cfc-8f9a-fcb7123ef3a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:00.225230 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bb3890-bed9-4cfc-8f9a-fcb7123ef3a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:00.226719 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bb3890-bed9-4cfc-8f9a-fcb7123ef3a2 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:00.248843 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 224/448] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Jul 18 16:27:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:28:00.254904 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639c99c8-ec8b-4e7d-be2c-bb8e3a9859db None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:00.298781 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:00.313744 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:00.346430 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 225/449] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Jul 18 16:28:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:28:00.352200 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb3890-bed9-4cfc-8f9a-fcb7123ef3a2 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:00.377123 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639c99c8-ec8b-4e7d-be2c-bb8e3a9859db None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:00.414034 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f8bac-3443-4677-9b0f-b3367d7926aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:00.414893 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f8bac-3443-4677-9b0f-b3367d7926aa None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:00.415174 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f8bac-3443-4677-9b0f-b3367d7926aa None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:00.415450 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f8bac-3443-4677-9b0f-b3367d7926aa None admin] PATH_INFO: `/v3/projects/33688c7877734008b9dfee18021dbcd6` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:00.416884 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58f8bac-3443-4677-9b0f-b3367d7926aa None admin] RBAC: Authorizing `identity:get_project(project_id=33688c7877734008b9dfee18021dbcd6)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:00.418483 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58f8bac-3443-4677-9b0f-b3367d7926aa None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:00.420298 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 225/450] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Jul 18 16:28:00 2022] GET /identity/v3/projects/33688c7877734008b9dfee18021dbcd6 => generated 344 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:28:00.426038 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f8bac-3443-4677-9b0f-b3367d7926aa None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:00.459839 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb3890-bed9-4cfc-8f9a-fcb7123ef3a2 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:00.501871 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc985b-7858-4ac5-a50a-56b5bdad4770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:00.502850 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc985b-7858-4ac5-a50a-56b5bdad4770 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:00.503319 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc985b-7858-4ac5-a50a-56b5bdad4770 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:00.503794 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc985b-7858-4ac5-a50a-56b5bdad4770 None admin] PATH_INFO: `/v3/projects/7f680cc460584bf688dae550c6a46776` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:00.505029 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fc985b-7858-4ac5-a50a-56b5bdad4770 None admin] RBAC: Authorizing `identity:get_project(project_id=7f680cc460584bf688dae550c6a46776)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:00.506569 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fc985b-7858-4ac5-a50a-56b5bdad4770 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:00.508617 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 226/451] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Jul 18 16:28:00 2022] GET /identity/v3/projects/7f680cc460584bf688dae550c6a46776 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:28:00.517840 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc985b-7858-4ac5-a50a-56b5bdad4770 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:00.541825 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f8bac-3443-4677-9b0f-b3367d7926aa None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:00.554834 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:00.577914 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:00.584452 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ef065-dc01-4b20-8ea7-f37d501117ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:00.585325 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ef065-dc01-4b20-8ea7-f37d501117ac None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:00.585601 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ef065-dc01-4b20-8ea7-f37d501117ac None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:00.585874 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ef065-dc01-4b20-8ea7-f37d501117ac None admin] PATH_INFO: `/v3/groups/f2fdbef6b69c48c8a28886e7b4c7c018` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:00.587097 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1ef065-dc01-4b20-8ea7-f37d501117ac None admin] RBAC: Authorizing `identity:get_group(group_id=f2fdbef6b69c48c8a28886e7b4c7c018)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:00.588602 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1ef065-dc01-4b20-8ea7-f37d501117ac None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:00.590676 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 226/452] 10.222.0.81 () {56 vars in 1180 bytes} [Mon Jul 18 16:28:00 2022] GET /identity/v3/groups/f2fdbef6b69c48c8a28886e7b4c7c018 => generated 229 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:28:00.597183 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ef065-dc01-4b20-8ea7-f37d501117ac None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:00.640661 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc985b-7858-4ac5-a50a-56b5bdad4770 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:00.675889 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9903e56-9857-4604-9a4b-ab93e25bfd15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:00.676759 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9903e56-9857-4604-9a4b-ab93e25bfd15 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:00.677034 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9903e56-9857-4604-9a4b-ab93e25bfd15 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:00.677307 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9903e56-9857-4604-9a4b-ab93e25bfd15 None admin] PATH_INFO: `/v3/groups/f919e7f564bb4057b35dbb12e59ceb96` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:00.678509 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9903e56-9857-4604-9a4b-ab93e25bfd15 None admin] RBAC: Authorizing `identity:get_group(group_id=f919e7f564bb4057b35dbb12e59ceb96)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:00.680013 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9903e56-9857-4604-9a4b-ab93e25bfd15 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:00.681671 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 227/453] 10.222.0.81 () {56 vars in 1180 bytes} [Mon Jul 18 16:28:00 2022] GET /identity/v3/groups/f919e7f564bb4057b35dbb12e59ceb96 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:28:00.688786 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9903e56-9857-4604-9a4b-ab93e25bfd15 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:00.729041 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ef065-dc01-4b20-8ea7-f37d501117ac None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:00.763091 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42819d14-6500-46a1-8e0d-7b1eb898eca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:00.764294 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42819d14-6500-46a1-8e0d-7b1eb898eca7 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:00.764572 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42819d14-6500-46a1-8e0d-7b1eb898eca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:00.764850 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42819d14-6500-46a1-8e0d-7b1eb898eca7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:00.765678 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42819d14-6500-46a1-8e0d-7b1eb898eca7 None admin] RBAC: Adding query filter params (group.id=f2fdbef6b69c48c8a28886e7b4c7c018, role.id=fd83eab44cb343a2b532ce32a2ac31d8, scope.project.id=33688c7877734008b9dfee18021dbcd6) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:00.765985 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42819d14-6500-46a1-8e0d-7b1eb898eca7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:00.767415 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42819d14-6500-46a1-8e0d-7b1eb898eca7 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:00.773556 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 227/454] 10.222.0.81 () {56 vars in 1376 bytes} [Mon Jul 18 16:28:00 2022] GET /identity/v3/role_assignments?group.id=f2fdbef6b69c48c8a28886e7b4c7c018&scope.project.id=33688c7877734008b9dfee18021dbcd6&role.id=fd83eab44cb343a2b532ce32a2ac31d8 => generated 611 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:00.796632 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9903e56-9857-4604-9a4b-ab93e25bfd15 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:00.809475 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:00.836481 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a7591b-0b73-4a6e-bd66-d62e150c6c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:00.837155 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a7591b-0b73-4a6e-bd66-d62e150c6c63 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:00.837506 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a7591b-0b73-4a6e-bd66-d62e150c6c63 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:00.837718 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a7591b-0b73-4a6e-bd66-d62e150c6c63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:00.838563 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a7591b-0b73-4a6e-bd66-d62e150c6c63 None admin] RBAC: Adding query filter params (group.id=f919e7f564bb4057b35dbb12e59ceb96, role.id=6bfa001ddac347da894c7231f853c3df, scope.project.id=7f680cc460584bf688dae550c6a46776) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:00.838874 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a7591b-0b73-4a6e-bd66-d62e150c6c63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:00.840592 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a7591b-0b73-4a6e-bd66-d62e150c6c63 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:00.847376 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 228/455] 10.222.0.81 () {56 vars in 1376 bytes} [Mon Jul 18 16:28:00 2022] GET /identity/v3/role_assignments?group.id=f919e7f564bb4057b35dbb12e59ceb96&scope.project.id=7f680cc460584bf688dae550c6a46776&role.id=6bfa001ddac347da894c7231f853c3df => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:28:03.535976 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce780e5c-6551-46d6-84e0-64b99e164192 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:03.536946 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce780e5c-6551-46d6-84e0-64b99e164192 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:03.537446 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce780e5c-6551-46d6-84e0-64b99e164192 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:03.539252 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 228/456] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:28:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:03.545559 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32506c65-8da9-4ad1-84fc-56681a6218f6 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:03.546357 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32506c65-8da9-4ad1-84fc-56681a6218f6 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:03.546802 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32506c65-8da9-4ad1-84fc-56681a6218f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:03.572713 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-32506c65-8da9-4ad1-84fc-56681a6218f6 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:03.574152 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-32506c65-8da9-4ad1-84fc-56681a6218f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:03.660526 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 229/457] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:28:03.693055 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce780e5c-6551-46d6-84e0-64b99e164192 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:03.743392 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:03.810191 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9da984-cdf0-4392-be64-c33f371ecc7e None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:03.811036 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9da984-cdf0-4392-be64-c33f371ecc7e None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:03.811273 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9da984-cdf0-4392-be64-c33f371ecc7e None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:03.813204 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 230/458] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:28:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:28:03.824086 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96cda41-9fb2-4116-b793-bec9ede063a3 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:03.824655 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96cda41-9fb2-4116-b793-bec9ede063a3 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:03.825124 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96cda41-9fb2-4116-b793-bec9ede063a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:03.837389 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce780e5c-6551-46d6-84e0-64b99e164192 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:03.845927 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-f96cda41-9fb2-4116-b793-bec9ede063a3 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:03.847365 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-f96cda41-9fb2-4116-b793-bec9ede063a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:03.876156 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929bebed-8c3f-4ae3-8fef-18d0b430a2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:03.877200 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929bebed-8c3f-4ae3-8fef-18d0b430a2cf None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:03.877627 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929bebed-8c3f-4ae3-8fef-18d0b430a2cf None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:03.878078 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929bebed-8c3f-4ae3-8fef-18d0b430a2cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:03.889982 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929bebed-8c3f-4ae3-8fef-18d0b430a2cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:03.891803 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929bebed-8c3f-4ae3-8fef-18d0b430a2cf None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:03.910702 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-929bebed-8c3f-4ae3-8fef-18d0b430a2cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:03.910702 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:03.910702 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:03.910702 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:03.910702 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:03.910702 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:03.910702 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:03.910702 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:03.910702 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:03.910702 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:03.910702 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:03.910702 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:03.910702 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:28:03.910702 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:28:03.910702 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:28:03.911685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:28:03.911685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:03.911685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:03.911685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:03.911685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:03.911685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:03.911685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:03.911685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:03.911685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:03.911685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:03.911685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:03.911685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:03.911685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:03.911685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:03.911685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:03.911685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:03.911685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:03.912583 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:28:03.912583 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:28:03.912583 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:03.912583 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:03.914833 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 229/459] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:28:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:03.920926 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d779ddb-7446-4204-8f9b-213ecf077f47 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:03.921417 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d779ddb-7446-4204-8f9b-213ecf077f47 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:03.921894 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d779ddb-7446-4204-8f9b-213ecf077f47 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:03.923655 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 230/460] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:28:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:03.924544 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d779ddb-7446-4204-8f9b-213ecf077f47 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:03.929936 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 231/461] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 16:28:03.939927 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb4d17-663f-48a6-94f5-f980ec600c78 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:03.940455 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb4d17-663f-48a6-94f5-f980ec600c78 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:03.940901 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb4d17-663f-48a6-94f5-f980ec600c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:03.966069 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-0bdb4d17-663f-48a6-94f5-f980ec600c78 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:03.972314 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-0bdb4d17-663f-48a6-94f5-f980ec600c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:04.016210 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:04.026201 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:04.041368 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d779ddb-7446-4204-8f9b-213ecf077f47 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:04.053006 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 232/462] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:28:04.054282 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb4d17-663f-48a6-94f5-f980ec600c78 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:04.090285 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd5a2c-e2d1-4e60-819e-d904cec287f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:04.091338 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd5a2c-e2d1-4e60-819e-d904cec287f5 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:04.092461 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd5a2c-e2d1-4e60-819e-d904cec287f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:04.092974 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd5a2c-e2d1-4e60-819e-d904cec287f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:04.093920 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bd5a2c-e2d1-4e60-819e-d904cec287f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:04.094434 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bd5a2c-e2d1-4e60-819e-d904cec287f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:04.096255 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bd5a2c-e2d1-4e60-819e-d904cec287f5 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:04.110011 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 231/463] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:28:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:04.115659 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd5a2c-e2d1-4e60-819e-d904cec287f5 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:04.172877 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb4d17-663f-48a6-94f5-f980ec600c78 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:04.212043 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f6b2a4-4100-4d44-8607-bfe6f5957e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:04.212838 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6b2a4-4100-4d44-8607-bfe6f5957e6a None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:04.213115 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6b2a4-4100-4d44-8607-bfe6f5957e6a None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:04.213385 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6b2a4-4100-4d44-8607-bfe6f5957e6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:04.224645 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd5a2c-e2d1-4e60-819e-d904cec287f5 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:04.225350 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f6b2a4-4100-4d44-8607-bfe6f5957e6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:04.226990 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f6b2a4-4100-4d44-8607-bfe6f5957e6a None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:04.245614 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-b2f6b2a4-4100-4d44-8607-bfe6f5957e6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:04.245614 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:04.245614 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:04.245614 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:04.245614 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:04.245614 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:04.245614 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:04.245614 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:04.245614 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:04.245614 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:04.245614 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:04.245614 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:04.245614 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:28:04.245614 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:28:04.245614 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:28:04.246522 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:28:04.246522 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:04.246522 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:04.246522 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:04.246522 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:04.246522 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:04.246522 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:04.246522 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:04.246522 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:04.246522 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:04.246522 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:04.246522 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:04.246522 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:04.246522 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:04.246522 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:04.246522 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:04.246522 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:04.247593 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:28:04.247593 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:28:04.247593 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:04.247593 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:04.247593 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 233/464] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:28:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:04.252387 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f6b2a4-4100-4d44-8607-bfe6f5957e6a None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:04.260159 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd3e3b7-3e91-4144-9ff6-b809eb723ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:04.260954 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3e3b7-3e91-4144-9ff6-b809eb723ca7 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:04.261237 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3e3b7-3e91-4144-9ff6-b809eb723ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:04.261620 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3e3b7-3e91-4144-9ff6-b809eb723ca7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:04.271248 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:04.273427 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd3e3b7-3e91-4144-9ff6-b809eb723ca7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:04.274870 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd3e3b7-3e91-4144-9ff6-b809eb723ca7 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:04.283655 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:04.293256 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-2dd3e3b7-3e91-4144-9ff6-b809eb723ca7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:04.293256 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:04.293256 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:04.293256 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:04.293256 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:04.293256 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:04.293256 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:04.293256 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:04.293256 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:04.293256 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:04.293256 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:04.293256 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:04.293256 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:28:04.293256 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:28:04.293256 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:28:04.294139 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:28:04.294139 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:04.294139 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:04.294139 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:04.294139 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:04.294139 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:04.294139 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:04.294139 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:04.294139 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:04.294139 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:04.294139 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:04.294139 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:04.294139 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:04.294139 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:04.294139 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:04.294139 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:04.294139 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:04.295088 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:28:04.295088 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:28:04.295088 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:04.295088 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:04.295088 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 232/465] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:28:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:04.296205 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d676a9-a3df-43e2-8580-a374079c34ce None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:04.296488 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d676a9-a3df-43e2-8580-a374079c34ce None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:04.296759 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d676a9-a3df-43e2-8580-a374079c34ce None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:04.298232 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 233/466] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:28:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:04.298670 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d676a9-a3df-43e2-8580-a374079c34ce None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:04.368069 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f6b2a4-4100-4d44-8607-bfe6f5957e6a None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:04.405499 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d7bf5a-9020-405b-bb75-9b089fa32ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:04.406161 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7bf5a-9020-405b-bb75-9b089fa32ffe None admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:04.406460 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7bf5a-9020-405b-bb75-9b089fa32ffe None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:04.406730 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7bf5a-9020-405b-bb75-9b089fa32ffe None admin] PATH_INFO: `/v3/users` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:04.407239 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d676a9-a3df-43e2-8580-a374079c34ce None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:04.407423 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d7bf5a-9020-405b-bb75-9b089fa32ffe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:04.408911 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d7bf5a-9020-405b-bb75-9b089fa32ffe None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:04.444610 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cca8d1-654f-443e-8554-f552fea2c226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:04.445282 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cca8d1-654f-443e-8554-f552fea2c226 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:04.445563 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cca8d1-654f-443e-8554-f552fea2c226 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:04.445837 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cca8d1-654f-443e-8554-f552fea2c226 None admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:04.446589 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cca8d1-654f-443e-8554-f552fea2c226 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:04.447023 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cca8d1-654f-443e-8554-f552fea2c226 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:04.448471 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cca8d1-654f-443e-8554-f552fea2c226 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:04.468618 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 234/467] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:28:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:04.468618 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cca8d1-654f-443e-8554-f552fea2c226 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:04.531024 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:04.556180 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 234/468] 10.222.0.81 () {60 vars in 1132 bytes} [Mon Jul 18 16:28:04 2022] POST /identity/v3/users => generated 246 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:28:04.557736 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac4656-6eb7-4158-85bb-001d645128d8 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:04.558210 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac4656-6eb7-4158-85bb-001d645128d8 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:04.558629 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac4656-6eb7-4158-85bb-001d645128d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:04.576679 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cca8d1-654f-443e-8554-f552fea2c226 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:04.607825 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-7fac4656-6eb7-4158-85bb-001d645128d8 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:04.609038 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-7fac4656-6eb7-4158-85bb-001d645128d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:04.620467 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc187d91-0efd-4317-b86c-63a408297785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:04.620467 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc187d91-0efd-4317-b86c-63a408297785 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:04.620467 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc187d91-0efd-4317-b86c-63a408297785 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:04.620467 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc187d91-0efd-4317-b86c-63a408297785 None admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:04.620858 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc187d91-0efd-4317-b86c-63a408297785 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:04.620858 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc187d91-0efd-4317-b86c-63a408297785 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:04.620858 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc187d91-0efd-4317-b86c-63a408297785 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:04.641631 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 235/469] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:28:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:04.644258 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc187d91-0efd-4317-b86c-63a408297785 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:04.698407 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 235/470] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:28:04.699402 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fac4656-6eb7-4158-85bb-001d645128d8 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:04.702628 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:04.799847 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc187d91-0efd-4317-b86c-63a408297785 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:04.827181 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:04.844888 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fac4656-6eb7-4158-85bb-001d645128d8 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:04.849169 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4342ab55-4e14-42cb-9911-eb4a3e7e60a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:04.850263 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342ab55-4e14-42cb-9911-eb4a3e7e60a3 None admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:04.850709 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342ab55-4e14-42cb-9911-eb4a3e7e60a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:04.851148 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342ab55-4e14-42cb-9911-eb4a3e7e60a3 None admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:04.852203 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4342ab55-4e14-42cb-9911-eb4a3e7e60a3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:04.854171 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4342ab55-4e14-42cb-9911-eb4a3e7e60a3 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:04.932879 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b646c067-93f8-465e-8183-7d47a8225103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:04.933880 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b646c067-93f8-465e-8183-7d47a8225103 None admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:04.934298 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b646c067-93f8-465e-8183-7d47a8225103 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:04.934709 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b646c067-93f8-465e-8183-7d47a8225103 None admin] PATH_INFO: `/v3/users` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:04.936175 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b646c067-93f8-465e-8183-7d47a8225103 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:04.937911 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b646c067-93f8-465e-8183-7d47a8225103 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:05.041928 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 236/471] 10.222.0.81 () {60 vars in 1132 bytes} [Mon Jul 18 16:28:04 2022] POST /identity/v3/users => generated 248 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:28:05.042775 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4342ab55-4e14-42cb-9911-eb4a3e7e60a3 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:05.114053 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 236/472] 10.222.0.81 () {60 vars in 1132 bytes} [Mon Jul 18 16:28:04 2022] POST /identity/v3/users => generated 248 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:28:05.114053 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7018c9a-a733-4925-8c23-988b0f0cbf8a None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:05.114053 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7018c9a-a733-4925-8c23-988b0f0cbf8a None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:05.114053 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7018c9a-a733-4925-8c23-988b0f0cbf8a None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:05.114053 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 237/473] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:28:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:05.125944 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e17e03-4eb9-4c61-9e6b-21c8a291bc32 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:05.126265 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e17e03-4eb9-4c61-9e6b-21c8a291bc32 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:05.126504 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e17e03-4eb9-4c61-9e6b-21c8a291bc32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:05.160823 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-76e17e03-4eb9-4c61-9e6b-21c8a291bc32 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:05.162087 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-76e17e03-4eb9-4c61-9e6b-21c8a291bc32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:05.221623 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4342ab55-4e14-42cb-9911-eb4a3e7e60a3 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:05.266699 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:05.274896 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec407774-f901-4332-b3a5-c407a52b8d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:05.278721 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec407774-f901-4332-b3a5-c407a52b8d3a None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:05.278721 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec407774-f901-4332-b3a5-c407a52b8d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:05.278721 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec407774-f901-4332-b3a5-c407a52b8d3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:05.286354 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 238/474] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:28:05.299027 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec407774-f901-4332-b3a5-c407a52b8d3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:05.300569 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec407774-f901-4332-b3a5-c407a52b8d3a None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:05.321442 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-ec407774-f901-4332-b3a5-c407a52b8d3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:05.321442 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:05.321442 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:05.321442 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:05.321442 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:05.321442 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:05.321442 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:05.321442 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:05.321442 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:05.321442 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:05.321442 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:05.321442 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:05.321442 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:28:05.321442 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:28:05.321442 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:28:05.322394 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:28:05.322394 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:05.322394 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:05.322394 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:05.322394 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:05.322394 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:05.322394 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:05.322394 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:05.322394 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:05.322394 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:05.322394 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:05.322394 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:05.322394 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:05.322394 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:05.322394 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:05.322394 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:05.322394 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:05.323291 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:28:05.323291 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:28:05.323291 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:05.323291 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:05.323291 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 237/475] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:28:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:05.325153 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e17e03-4eb9-4c61-9e6b-21c8a291bc32 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:05.328517 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec407774-f901-4332-b3a5-c407a52b8d3a None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:05.377409 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:05.476053 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec407774-f901-4332-b3a5-c407a52b8d3a None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:05.498526 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e17e03-4eb9-4c61-9e6b-21c8a291bc32 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:05.524255 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e888a2a2-f457-4a63-991e-6a6797fae357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:05.525786 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888a2a2-f457-4a63-991e-6a6797fae357 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:05.526259 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888a2a2-f457-4a63-991e-6a6797fae357 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:05.527095 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888a2a2-f457-4a63-991e-6a6797fae357 None admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:05.528290 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e888a2a2-f457-4a63-991e-6a6797fae357 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:05.529217 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e888a2a2-f457-4a63-991e-6a6797fae357 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:05.531417 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e888a2a2-f457-4a63-991e-6a6797fae357 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:05.540733 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6905bbe0-6172-4f50-81d7-f63b48c4a1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:05.541416 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6905bbe0-6172-4f50-81d7-f63b48c4a1d9 None admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:05.541698 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6905bbe0-6172-4f50-81d7-f63b48c4a1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:05.541974 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6905bbe0-6172-4f50-81d7-f63b48c4a1d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:05.542724 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6905bbe0-6172-4f50-81d7-f63b48c4a1d9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:05.545392 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6905bbe0-6172-4f50-81d7-f63b48c4a1d9 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:05.547675 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 238/476] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:28:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:28:05.553398 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e888a2a2-f457-4a63-991e-6a6797fae357 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:05.588375 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.sql.core [None req-6905bbe0-6172-4f50-81d7-f63b48c4a1d9 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 18 16:28:05.588375 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 18 16:28:05.588375 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [parameters: {'id': 'e499b70b7d844a52a78ce920b097dc7d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 18 16:28:05.588375 dv-cinder-846173-3-smb devstack@keystone.service[80545]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80545) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 18 16:28:05.612926 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-6905bbe0-6172-4f50-81d7-f63b48c4a1d9 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 18 16:28:05.612926 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:05.612926 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 18 16:28:05.612926 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 18 16:28:05.612926 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 18 16:28:05.612926 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 18 16:28:05.612926 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 18 16:28:05.612926 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application result = self._query(query) Jul 18 16:28:05.612926 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 18 16:28:05.612926 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application conn.query(q) Jul 18 16:28:05.612926 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 18 16:28:05.612926 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 18 16:28:05.612926 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 18 16:28:05.612926 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application result.read() Jul 18 16:28:05.612926 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 18 16:28:05.613899 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 18 16:28:05.613899 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 18 16:28:05.613899 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 18 16:28:05.613899 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 18 16:28:05.613899 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 18 16:28:05.613899 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 18 16:28:05.613899 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 18 16:28:05.613899 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 18 16:28:05.613899 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:05.613899 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 18 16:28:05.613899 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:05.613899 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:05.613899 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 18 16:28:05.613899 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 18 16:28:05.613899 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 18 16:28:05.613899 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return ref.to_dict() Jul 18 16:28:05.613899 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 18 16:28:05.613899 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application next(self.gen) Jul 18 16:28:05.614865 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 18 16:28:05.614865 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application yield resource Jul 18 16:28:05.614865 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 18 16:28:05.614865 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application next(self.gen) Jul 18 16:28:05.614865 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 18 16:28:05.614865 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application self.session.rollback() Jul 18 16:28:05.614865 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 16:28:05.614865 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application self.force_reraise() Jul 18 16:28:05.614865 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 16:28:05.614865 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise self.value Jul 18 16:28:05.614865 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 18 16:28:05.614865 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 18 16:28:05.614865 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 18 16:28:05.614865 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application session.commit() Jul 18 16:28:05.614865 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 18 16:28:05.614865 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 18 16:28:05.614865 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 18 16:28:05.615783 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application self._prepare_impl() Jul 18 16:28:05.615783 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 18 16:28:05.615783 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application self.session.flush() Jul 18 16:28:05.615783 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 18 16:28:05.615783 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application self._flush(objects) Jul 18 16:28:05.615783 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 18 16:28:05.615783 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 18 16:28:05.615783 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 18 16:28:05.615783 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application compat.raise_( Jul 18 16:28:05.615783 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 18 16:28:05.615783 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception Jul 18 16:28:05.615783 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 18 16:28:05.615783 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application flush_context.execute() Jul 18 16:28:05.615783 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 18 16:28:05.615783 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rec.execute(self) Jul 18 16:28:05.615783 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 18 16:28:05.615783 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 18 16:28:05.616721 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 18 16:28:05.616721 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 18 16:28:05.616721 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 18 16:28:05.616721 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 18 16:28:05.616721 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 18 16:28:05.616721 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 18 16:28:05.616721 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 18 16:28:05.616721 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 18 16:28:05.616721 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 18 16:28:05.616721 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 18 16:28:05.616721 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 18 16:28:05.616721 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 18 16:28:05.616721 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 18 16:28:05.616721 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 18 16:28:05.616721 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 18 16:28:05.616721 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception Jul 18 16:28:05.619442 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 18 16:28:05.619442 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 18 16:28:05.619442 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 18 16:28:05.619442 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 18 16:28:05.619442 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 18 16:28:05.619442 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application result = self._query(query) Jul 18 16:28:05.619442 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 18 16:28:05.619442 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application conn.query(q) Jul 18 16:28:05.619442 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 18 16:28:05.619442 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 18 16:28:05.619442 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 18 16:28:05.619442 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application result.read() Jul 18 16:28:05.619442 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 18 16:28:05.619442 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 18 16:28:05.619442 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 18 16:28:05.619442 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 18 16:28:05.620580 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 18 16:28:05.620580 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 18 16:28:05.620580 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 18 16:28:05.620580 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 18 16:28:05.620580 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 18 16:28:05.620580 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 18 16:28:05.620580 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [parameters: {'id': 'e499b70b7d844a52a78ce920b097dc7d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 18 16:28:05.620580 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 18 16:28:05.620580 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:05.620580 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 16:28:05.620580 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:05.620580 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:05.620580 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:05.620580 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:05.620580 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:05.620580 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:05.621510 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:05.621510 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:05.621510 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:05.621510 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:05.621510 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:05.621510 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:05.621510 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 18 16:28:05.621510 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 18 16:28:05.621510 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:05.621510 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:05.621510 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 18 16:28:05.621510 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 18 16:28:05.621510 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 18 16:28:05.621510 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 18 16:28:05.621510 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 18 16:28:05.621510 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:05.622367 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 239/477] 10.222.0.81 () {60 vars in 1131 bytes} [Mon Jul 18 16:28:05 2022] POST /identity/v3/roles => generated 144 bytes in 293 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:28:05.622367 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6905bbe0-6172-4f50-81d7-f63b48c4a1d9 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:05.671416 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:05.686521 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e888a2a2-f457-4a63-991e-6a6797fae357 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:05.727570 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90097e70-4687-4d93-af9b-87ca1a4446e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:05.728578 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90097e70-4687-4d93-af9b-87ca1a4446e5 None admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:05.730728 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90097e70-4687-4d93-af9b-87ca1a4446e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:05.732862 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90097e70-4687-4d93-af9b-87ca1a4446e5 None admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:05.733767 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90097e70-4687-4d93-af9b-87ca1a4446e5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:05.736237 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90097e70-4687-4d93-af9b-87ca1a4446e5 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:05.752051 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:05.806563 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6905bbe0-6172-4f50-81d7-f63b48c4a1d9 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:05.830041 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 239/478] 10.222.0.81 () {60 vars in 1132 bytes} [Mon Jul 18 16:28:05 2022] POST /identity/v3/users => generated 249 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:28:05.852214 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91d2a54-81f3-4e13-a2a9-651f334dde61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:05.853059 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d2a54-81f3-4e13-a2a9-651f334dde61 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:05.853344 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d2a54-81f3-4e13-a2a9-651f334dde61 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:05.853620 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d2a54-81f3-4e13-a2a9-651f334dde61 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:05.878581 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91d2a54-81f3-4e13-a2a9-651f334dde61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:28:05.887240 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-f91d2a54-81f3-4e13-a2a9-651f334dde61 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 16:28:05.887240 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:05.887240 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:05.887240 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:05.887240 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:05.887240 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:05.887240 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:05.887240 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:05.887240 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:05.887240 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:05.887240 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:05.887240 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:05.887240 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:28:05.887240 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:28:05.887240 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:28:05.887240 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:28:05.888345 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:28:05.888345 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:28:05.888345 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:28:05.888345 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:28:05.888345 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:05.888345 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:05.888345 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:05.888345 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:05.888345 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:05.888345 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:05.888345 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:05.888345 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:05.888345 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:05.888345 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:05.888345 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:05.888345 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:05.889204 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:05.889204 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:05.889204 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:05.889204 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:05.889204 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:28:05.889204 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:28:05.889204 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:28:05.889204 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:28:05.889204 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:28:05.889204 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:28:05.889204 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 16:28:05.889204 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:05.892786 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 240/479] 10.222.0.81 () {56 vars in 1114 bytes} [Mon Jul 18 16:28:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:05.899398 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90097e70-4687-4d93-af9b-87ca1a4446e5 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:06.030183 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90097e70-4687-4d93-af9b-87ca1a4446e5 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:06.064588 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edb446f-7050-447f-9296-6b794c3e1b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:06.065264 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb446f-7050-447f-9296-6b794c3e1b5b None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:06.065549 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb446f-7050-447f-9296-6b794c3e1b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:06.065823 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb446f-7050-447f-9296-6b794c3e1b5b None admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:06.066574 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edb446f-7050-447f-9296-6b794c3e1b5b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:06.066883 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edb446f-7050-447f-9296-6b794c3e1b5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:06.068372 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edb446f-7050-447f-9296-6b794c3e1b5b None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:06.077393 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 240/480] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Jul 18 16:28:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:06.964837 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b4ae16-8623-4aa4-ba29-213d5f5dc40f None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:06.965808 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b4ae16-8623-4aa4-ba29-213d5f5dc40f None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:06.966361 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b4ae16-8623-4aa4-ba29-213d5f5dc40f None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:06.968262 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 241/481] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:28:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:06.973929 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239692ca-56b6-405f-9d7c-d9c0b193974d None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:06.974838 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239692ca-56b6-405f-9d7c-d9c0b193974d None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:06.975322 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239692ca-56b6-405f-9d7c-d9c0b193974d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:06.991539 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:07.001588 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-239692ca-56b6-405f-9d7c-d9c0b193974d None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:07.003062 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-239692ca-56b6-405f-9d7c-d9c0b193974d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:07.105626 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 241/482] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:28:07.141068 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b4ae16-8623-4aa4-ba29-213d5f5dc40f None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:07.269395 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b4ae16-8623-4aa4-ba29-213d5f5dc40f None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:07.288522 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:07.314777 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa2c78c-df8f-4db4-afb7-a56510a02c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:07.315573 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2c78c-df8f-4db4-afb7-a56510a02c88 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:07.315882 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2c78c-df8f-4db4-afb7-a56510a02c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:07.316159 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2c78c-df8f-4db4-afb7-a56510a02c88 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:07.332596 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa2c78c-df8f-4db4-afb7-a56510a02c88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:28:07.340289 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-4aa2c78c-df8f-4db4-afb7-a56510a02c88 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:28:07.340289 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:07.340289 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:07.340289 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:07.340289 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:07.340289 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:07.340289 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:07.340289 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:07.340289 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:07.340289 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:07.340289 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:07.340289 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:07.340289 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:28:07.340289 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:28:07.340289 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:28:07.340289 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:28:07.341174 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:28:07.341174 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:28:07.341174 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:28:07.341174 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:28:07.341174 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:07.341174 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:07.341174 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:07.341174 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:07.341174 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:07.341174 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:07.341174 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:07.341174 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:07.341174 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:07.341174 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:07.341174 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:07.341174 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:07.342528 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:07.342528 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:07.342528 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:07.342528 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:07.342528 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:28:07.342528 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:28:07.342528 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:28:07.342528 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:28:07.342528 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:28:07.342528 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:28:07.342528 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:28:07.342528 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:07.342528 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 242/483] 10.222.0.81 () {56 vars in 1102 bytes} [Mon Jul 18 16:28:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:07.352818 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239692ca-56b6-405f-9d7c-d9c0b193974d None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:07.507694 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239692ca-56b6-405f-9d7c-d9c0b193974d None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:07.548611 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b9b52-a1a9-4cf8-83df-bafc91068ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:07.549203 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b9b52-a1a9-4cf8-83df-bafc91068ccb None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:07.549483 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b9b52-a1a9-4cf8-83df-bafc91068ccb None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:07.549757 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b9b52-a1a9-4cf8-83df-bafc91068ccb None admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:07.550520 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1b9b52-a1a9-4cf8-83df-bafc91068ccb None admin] RBAC: Adding query filter params (name=service) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:07.550826 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1b9b52-a1a9-4cf8-83df-bafc91068ccb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:07.552306 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1b9b52-a1a9-4cf8-83df-bafc91068ccb None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:07.555041 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:07.562805 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 242/484] 10.222.0.81 () {56 vars in 1103 bytes} [Mon Jul 18 16:28:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:07.568363 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa2c78c-df8f-4db4-afb7-a56510a02c88 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:07.679383 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20766503-52cb-4337-b6ff-a6b66ce11944 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:07.679703 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20766503-52cb-4337-b6ff-a6b66ce11944 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:07.679989 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20766503-52cb-4337-b6ff-a6b66ce11944 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:07.682033 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa2c78c-df8f-4db4-afb7-a56510a02c88 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:07.682320 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 243/485] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:28:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:28:07.688617 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ef05c8-93df-48bb-80a8-ec1c9d143561 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:07.688918 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ef05c8-93df-48bb-80a8-ec1c9d143561 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:07.689175 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ef05c8-93df-48bb-80a8-ec1c9d143561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:07.723097 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0426a81d-758e-46c1-aa83-2cb5f0196bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:07.724308 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426a81d-758e-46c1-aa83-2cb5f0196bb8 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:07.724823 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426a81d-758e-46c1-aa83-2cb5f0196bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:07.725323 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426a81d-758e-46c1-aa83-2cb5f0196bb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:07.736821 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-d8ef05c8-93df-48bb-80a8-ec1c9d143561 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:07.738056 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-d8ef05c8-93df-48bb-80a8-ec1c9d143561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:07.741795 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0426a81d-758e-46c1-aa83-2cb5f0196bb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:07.745149 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0426a81d-758e-46c1-aa83-2cb5f0196bb8 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:07.769828 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-0426a81d-758e-46c1-aa83-2cb5f0196bb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:07.769828 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:07.769828 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:07.769828 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:07.769828 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:07.769828 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:07.769828 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:07.769828 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:07.769828 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:07.769828 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:07.769828 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:07.769828 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:07.769828 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:28:07.769828 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:28:07.769828 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:28:07.770897 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:28:07.770897 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:07.770897 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:07.770897 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:07.770897 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:07.770897 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:07.770897 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:07.770897 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:07.770897 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:07.770897 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:07.770897 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:07.770897 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:07.770897 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:07.770897 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:07.770897 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:07.770897 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:07.770897 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:07.771770 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:28:07.771770 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:28:07.771770 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:07.771770 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:07.776407 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 243/486] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:28:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:07.782014 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0426a81d-758e-46c1-aa83-2cb5f0196bb8 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:07.846819 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:07.893991 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 244/487] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 16:28:07.917749 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ef05c8-93df-48bb-80a8-ec1c9d143561 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:08.006067 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0426a81d-758e-46c1-aa83-2cb5f0196bb8 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:08.081851 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396830ba-d578-49de-bced-98138161977e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:08.082526 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396830ba-d578-49de-bced-98138161977e None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:08.082855 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396830ba-d578-49de-bced-98138161977e None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:08.083130 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396830ba-d578-49de-bced-98138161977e None admin] PATH_INFO: `/v3/domains` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:08.083889 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396830ba-d578-49de-bced-98138161977e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:08.084193 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396830ba-d578-49de-bced-98138161977e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:08.085747 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396830ba-d578-49de-bced-98138161977e None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:08.114450 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 244/488] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:28:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:08.121216 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396830ba-d578-49de-bced-98138161977e None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:08.126966 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ef05c8-93df-48bb-80a8-ec1c9d143561 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:08.157039 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:08.165309 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e87f9a-5942-4a8b-89bc-d5212e45c0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:08.166120 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e87f9a-5942-4a8b-89bc-d5212e45c0e1 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:08.166402 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e87f9a-5942-4a8b-89bc-d5212e45c0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:08.172306 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e87f9a-5942-4a8b-89bc-d5212e45c0e1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:08.178248 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e87f9a-5942-4a8b-89bc-d5212e45c0e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:28:08.186702 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-30e87f9a-5942-4a8b-89bc-d5212e45c0e1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:28:08.186702 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:08.186702 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:08.186702 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:08.186702 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:08.186702 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:08.186702 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:08.186702 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:08.186702 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:08.186702 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:08.186702 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:08.186702 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:08.186702 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:28:08.186702 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:28:08.186702 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:28:08.186702 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:28:08.187641 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:28:08.187641 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:28:08.187641 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:28:08.187641 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:28:08.187641 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:08.187641 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:08.187641 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:08.187641 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:08.187641 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:08.187641 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:08.187641 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:08.187641 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:08.187641 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:08.187641 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:08.187641 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:08.187641 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:08.188969 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:08.188969 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:08.188969 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:08.188969 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:08.188969 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:28:08.188969 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:28:08.188969 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:28:08.188969 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:28:08.188969 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:28:08.188969 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:28:08.188969 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:28:08.188969 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:08.188969 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 245/489] 10.222.0.81 () {56 vars in 1102 bytes} [Mon Jul 18 16:28:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:08.189833 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc8a0d-eb87-4871-8350-d581b282ce79 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:08.190070 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc8a0d-eb87-4871-8350-d581b282ce79 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:08.190289 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc8a0d-eb87-4871-8350-d581b282ce79 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:08.195546 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 246/490] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:28:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:08.195546 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc8a0d-eb87-4871-8350-d581b282ce79 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:08.232138 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:08.244239 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396830ba-d578-49de-bced-98138161977e None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:08.282556 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52024a0-9a7e-40c7-b6f6-cbc97a49fdd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:08.283803 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52024a0-9a7e-40c7-b6f6-cbc97a49fdd1 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:08.284309 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52024a0-9a7e-40c7-b6f6-cbc97a49fdd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:08.284763 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52024a0-9a7e-40c7-b6f6-cbc97a49fdd1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:08.293145 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52024a0-9a7e-40c7-b6f6-cbc97a49fdd1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:08.295131 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52024a0-9a7e-40c7-b6f6-cbc97a49fdd1 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:08.309269 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc8a0d-eb87-4871-8350-d581b282ce79 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:08.314933 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-c52024a0-9a7e-40c7-b6f6-cbc97a49fdd1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 16:28:08.314933 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:08.314933 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:08.314933 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:08.314933 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:08.314933 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:08.314933 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:08.314933 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:08.314933 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:08.314933 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:08.314933 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:08.314933 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:08.314933 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:28:08.314933 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:28:08.314933 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:28:08.314933 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:28:08.316108 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:08.316108 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:08.316108 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:28:08.316108 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:28:08.316108 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:28:08.316108 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:28:08.316108 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:08.316108 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:08.316108 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:08.316108 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:08.316108 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:08.316108 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:08.316108 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:08.316108 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:08.316108 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:08.316108 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:08.316108 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:08.316108 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:08.317020 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:08.317020 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:08.317020 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:28:08.317020 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:28:08.317020 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:28:08.317020 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:28:08.317020 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:28:08.317020 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:28:08.317020 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 16:28:08.317020 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:08.320024 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 245/491] 10.222.0.81 () {56 vars in 1093 bytes} [Mon Jul 18 16:28:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:08.321840 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003eb51e-3bf8-4a43-acef-c146ef675989 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:08.322282 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003eb51e-3bf8-4a43-acef-c146ef675989 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:08.322680 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003eb51e-3bf8-4a43-acef-c146ef675989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:08.342431 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-003eb51e-3bf8-4a43-acef-c146ef675989 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:08.344671 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-003eb51e-3bf8-4a43-acef-c146ef675989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:08.356602 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5aba17-80ed-41ad-b27c-f3fae8f2f4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:08.357861 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5aba17-80ed-41ad-b27c-f3fae8f2f4c9 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:08.358166 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5aba17-80ed-41ad-b27c-f3fae8f2f4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:08.358572 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5aba17-80ed-41ad-b27c-f3fae8f2f4c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:08.359526 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5aba17-80ed-41ad-b27c-f3fae8f2f4c9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:08.360099 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5aba17-80ed-41ad-b27c-f3fae8f2f4c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:08.361975 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5aba17-80ed-41ad-b27c-f3fae8f2f4c9 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:08.374546 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 247/492] 10.222.0.81 () {56 vars in 1103 bytes} [Mon Jul 18 16:28:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:08.375612 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5aba17-80ed-41ad-b27c-f3fae8f2f4c9 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:08.432626 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:08.439882 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 246/493] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:28:08.441115 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003eb51e-3bf8-4a43-acef-c146ef675989 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:08.504887 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5aba17-80ed-41ad-b27c-f3fae8f2f4c9 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:08.543221 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9601eef3-e175-40af-abe7-28465bff68e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:08.543936 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9601eef3-e175-40af-abe7-28465bff68e6 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:08.544219 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9601eef3-e175-40af-abe7-28465bff68e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:08.545022 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9601eef3-e175-40af-abe7-28465bff68e6 None admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:08.545867 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9601eef3-e175-40af-abe7-28465bff68e6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:08.546178 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9601eef3-e175-40af-abe7-28465bff68e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:08.547623 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9601eef3-e175-40af-abe7-28465bff68e6 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:08.554559 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:08.581622 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003eb51e-3bf8-4a43-acef-c146ef675989 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:08.588929 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 248/494] 10.222.0.81 () {56 vars in 1133 bytes} [Mon Jul 18 16:28:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:08.588929 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9601eef3-e175-40af-abe7-28465bff68e6 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:08.619520 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b8e61-feab-43d9-96f4-b007ca3254bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:08.620368 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b8e61-feab-43d9-96f4-b007ca3254bd None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:08.620646 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b8e61-feab-43d9-96f4-b007ca3254bd None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:08.620946 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b8e61-feab-43d9-96f4-b007ca3254bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:08.633693 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65b8e61-feab-43d9-96f4-b007ca3254bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:08.635091 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65b8e61-feab-43d9-96f4-b007ca3254bd None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:08.655300 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-c65b8e61-feab-43d9-96f4-b007ca3254bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:08.655300 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:08.655300 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:08.655300 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:08.655300 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:08.655300 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:08.655300 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:08.655300 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:08.655300 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:08.655300 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:08.655300 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:08.655300 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:08.655300 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:28:08.655300 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:28:08.655300 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:28:08.657003 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:28:08.657003 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:08.657003 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:08.657003 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:08.657003 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:08.657003 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:08.657003 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:08.657003 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:08.657003 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:08.657003 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:08.657003 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:08.657003 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:08.657003 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:08.657003 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:08.657003 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:08.657003 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:08.657003 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:08.658060 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:28:08.658060 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:28:08.658060 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:08.658060 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:08.658060 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 247/495] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:28:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:08.658421 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9d997-3e6a-4328-b53a-bfcb051b664e None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:08.658714 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9d997-3e6a-4328-b53a-bfcb051b664e None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:08.659114 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9d997-3e6a-4328-b53a-bfcb051b664e None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:08.661096 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 248/496] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:28:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:08.662376 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193b5cc-49e4-4783-b8c4-1a4cb5382f42 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:08.662658 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193b5cc-49e4-4783-b8c4-1a4cb5382f42 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:08.662932 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193b5cc-49e4-4783-b8c4-1a4cb5382f42 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:08.664871 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 249/497] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:28:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:08.665179 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e193b5cc-49e4-4783-b8c4-1a4cb5382f42 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:08.704313 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9601eef3-e175-40af-abe7-28465bff68e6 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:08.714115 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:08.739514 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc963a2-3207-4884-9176-28a4311e9fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:08.740348 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc963a2-3207-4884-9176-28a4311e9fc8 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:08.740629 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc963a2-3207-4884-9176-28a4311e9fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:08.740964 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc963a2-3207-4884-9176-28a4311e9fc8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:08.753089 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc963a2-3207-4884-9176-28a4311e9fc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:28:08.761494 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-1bc963a2-3207-4884-9176-28a4311e9fc8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:28:08.761494 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:08.761494 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:08.761494 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:08.761494 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:08.761494 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:08.761494 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:08.761494 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:08.761494 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:08.761494 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:08.761494 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:08.761494 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:08.761494 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:28:08.761494 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:28:08.761494 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:28:08.761494 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:28:08.762599 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:28:08.762599 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:28:08.762599 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:28:08.762599 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:28:08.762599 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:08.762599 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:08.762599 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:08.762599 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:08.762599 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:08.762599 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:08.762599 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:08.762599 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:08.762599 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:08.762599 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:08.762599 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:08.762599 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:08.763413 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:08.763413 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:08.763413 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:08.763413 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:08.763413 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:28:08.763413 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:28:08.763413 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:28:08.763413 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:28:08.763413 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:28:08.763413 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:28:08.763413 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:28:08.763413 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:08.763413 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 249/498] 10.222.0.81 () {56 vars in 1102 bytes} [Mon Jul 18 16:28:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:08.764348 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc963a2-3207-4884-9176-28a4311e9fc8 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:08.795960 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e193b5cc-49e4-4783-b8c4-1a4cb5382f42 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:08.825082 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:08.834294 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e031a-3ae7-4a56-baba-8da6d8f99e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:08.835123 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e031a-3ae7-4a56-baba-8da6d8f99e5a None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:08.835407 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e031a-3ae7-4a56-baba-8da6d8f99e5a None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:08.835682 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e031a-3ae7-4a56-baba-8da6d8f99e5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:08.870780 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc963a2-3207-4884-9176-28a4311e9fc8 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:08.907165 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6c941c-5754-499e-82a1-7e39e6ee88aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:08.907678 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8e031a-3ae7-4a56-baba-8da6d8f99e5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:08.907800 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c941c-5754-499e-82a1-7e39e6ee88aa None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:08.908086 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c941c-5754-499e-82a1-7e39e6ee88aa None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:08.908354 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c941c-5754-499e-82a1-7e39e6ee88aa None admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:08.909136 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6c941c-5754-499e-82a1-7e39e6ee88aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:08.909240 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8e031a-3ae7-4a56-baba-8da6d8f99e5a None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:08.909439 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6c941c-5754-499e-82a1-7e39e6ee88aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:08.910834 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6c941c-5754-499e-82a1-7e39e6ee88aa None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:08.923895 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 250/499] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:28:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:08.925189 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ebdb4-14aa-4fda-b92c-596b6edb07d7 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:08.925472 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ebdb4-14aa-4fda-b92c-596b6edb07d7 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:08.925746 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ebdb4-14aa-4fda-b92c-596b6edb07d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:08.942331 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-4a4ebdb4-14aa-4fda-b92c-596b6edb07d7 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:08.943539 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-4a4ebdb4-14aa-4fda-b92c-596b6edb07d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:08.968288 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:09.019372 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 251/500] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:28:09.020713 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff513f9c-d729-4f24-bb77-3db929bc60ae None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:09.021003 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff513f9c-d729-4f24-bb77-3db929bc60ae None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:09.021264 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff513f9c-d729-4f24-bb77-3db929bc60ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:09.030446 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 250/501] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Jul 18 16:28:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:28:09.031942 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e031a-3ae7-4a56-baba-8da6d8f99e5a None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:09.041461 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-ff513f9c-d729-4f24-bb77-3db929bc60ae None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:09.042647 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-ff513f9c-d729-4f24-bb77-3db929bc60ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:09.062324 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:09.112129 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 252/502] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:28:09.112992 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff513f9c-d729-4f24-bb77-3db929bc60ae None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:09.146186 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e031a-3ae7-4a56-baba-8da6d8f99e5a None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:09.182408 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068abc85-e016-4f28-aafb-32bde62136c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:09.182408 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068abc85-e016-4f28-aafb-32bde62136c3 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:09.182791 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068abc85-e016-4f28-aafb-32bde62136c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:09.182881 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068abc85-e016-4f28-aafb-32bde62136c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:09.183566 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068abc85-e016-4f28-aafb-32bde62136c3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:09.183907 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068abc85-e016-4f28-aafb-32bde62136c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:09.185314 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068abc85-e016-4f28-aafb-32bde62136c3 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:09.193825 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 251/503] 10.222.0.81 () {56 vars in 1103 bytes} [Mon Jul 18 16:28:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:09.194659 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068abc85-e016-4f28-aafb-32bde62136c3 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:09.219580 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:09.231891 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff513f9c-d729-4f24-bb77-3db929bc60ae None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:09.267528 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc3732-89f1-44c5-91c4-788ec4651d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:09.268595 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc3732-89f1-44c5-91c4-788ec4651d1a None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:09.268873 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc3732-89f1-44c5-91c4-788ec4651d1a None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:09.269145 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc3732-89f1-44c5-91c4-788ec4651d1a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:09.276605 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cc3732-89f1-44c5-91c4-788ec4651d1a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:09.278059 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cc3732-89f1-44c5-91c4-788ec4651d1a None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:09.286700 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:09.294087 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-78cc3732-89f1-44c5-91c4-788ec4651d1a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 18 16:28:09.294087 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:09.294087 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:09.294087 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:09.294087 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:09.294087 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:09.294087 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:09.294087 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:09.294087 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:09.294087 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:09.294087 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:09.294087 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:09.294087 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:28:09.294087 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:28:09.294087 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:28:09.294087 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:28:09.298446 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:09.298446 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:09.298446 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:28:09.298446 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:28:09.298446 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:28:09.298446 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:28:09.298446 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:09.298446 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:09.298446 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:09.298446 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:09.298446 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:09.298446 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:09.298446 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:09.298446 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:09.298446 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:09.298446 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:09.298446 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:09.298446 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:09.299663 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:09.299663 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:09.299663 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:28:09.299663 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:28:09.299663 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:28:09.299663 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:28:09.299663 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:28:09.299663 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:28:09.299663 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 18 16:28:09.299663 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:09.299663 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 253/504] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Jul 18 16:28:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:09.299663 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc3732-89f1-44c5-91c4-788ec4651d1a None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:09.300406 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068abc85-e016-4f28-aafb-32bde62136c3 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:09.341248 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be5bfa7-a700-4aa4-8d20-460d2db2ea16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:09.343164 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5bfa7-a700-4aa4-8d20-460d2db2ea16 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:09.343684 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5bfa7-a700-4aa4-8d20-460d2db2ea16 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:09.344230 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5bfa7-a700-4aa4-8d20-460d2db2ea16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:09.362434 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be5bfa7-a700-4aa4-8d20-460d2db2ea16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:09.365246 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be5bfa7-a700-4aa4-8d20-460d2db2ea16 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:09.398303 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-3be5bfa7-a700-4aa4-8d20-460d2db2ea16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:09.398303 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:09.398303 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:09.398303 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:09.398303 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:09.398303 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:09.398303 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:09.398303 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:09.398303 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:09.398303 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:09.398303 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:09.398303 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:09.398303 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:28:09.398303 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:28:09.398303 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:28:09.399435 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:28:09.399435 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:09.399435 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:09.399435 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:09.399435 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:09.399435 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:09.399435 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:09.399435 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:09.399435 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:09.399435 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:09.399435 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:09.399435 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:09.399435 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:09.399435 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:09.399435 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:09.399435 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:09.399435 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:09.400533 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:28:09.400533 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:28:09.400533 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:09.400533 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:09.401021 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 252/505] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:28:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:09.402480 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be5bfa7-a700-4aa4-8d20-460d2db2ea16 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:09.409317 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc3732-89f1-44c5-91c4-788ec4651d1a None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:09.444193 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a871106-2e0c-4bd1-bbbd-b09b2803d193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:09.444958 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a871106-2e0c-4bd1-bbbd-b09b2803d193 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:09.445235 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a871106-2e0c-4bd1-bbbd-b09b2803d193 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:09.445503 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a871106-2e0c-4bd1-bbbd-b09b2803d193 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:09.457478 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a871106-2e0c-4bd1-bbbd-b09b2803d193 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:28:09.465361 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-4a871106-2e0c-4bd1-bbbd-b09b2803d193 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:28:09.465361 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:09.465361 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:09.465361 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:09.465361 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:09.465361 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:09.465361 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:09.465361 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:09.465361 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:09.465361 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:09.465361 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:09.465361 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:09.465361 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:28:09.465361 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:28:09.465361 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:28:09.465361 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:28:09.467036 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:28:09.467036 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:28:09.467036 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:28:09.467036 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:28:09.467036 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:09.467036 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:09.467036 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:09.467036 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:09.467036 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:09.467036 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:09.467036 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:09.467036 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:09.467036 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:09.467036 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:09.467036 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:09.467036 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:09.468008 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:09.468008 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:09.468008 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:09.468008 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:09.468008 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:28:09.468008 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:28:09.468008 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:28:09.468008 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:28:09.468008 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:28:09.468008 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:28:09.468008 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:28:09.468008 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:09.468008 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 254/506] 10.222.0.81 () {56 vars in 1102 bytes} [Mon Jul 18 16:28:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:09.468008 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a871106-2e0c-4bd1-bbbd-b09b2803d193 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:09.483087 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:09.523741 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be5bfa7-a700-4aa4-8d20-460d2db2ea16 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:09.558931 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382a107c-ac12-498e-9f0c-b0b72d30f631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:09.559733 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a107c-ac12-498e-9f0c-b0b72d30f631 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:09.560025 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a107c-ac12-498e-9f0c-b0b72d30f631 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:09.560306 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a107c-ac12-498e-9f0c-b0b72d30f631 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:09.568398 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:09.570609 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382a107c-ac12-498e-9f0c-b0b72d30f631 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:09.572079 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382a107c-ac12-498e-9f0c-b0b72d30f631 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:09.574839 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a871106-2e0c-4bd1-bbbd-b09b2803d193 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:09.589459 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-382a107c-ac12-498e-9f0c-b0b72d30f631 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:09.589459 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:09.589459 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:09.589459 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:09.589459 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:09.589459 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:09.589459 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:09.589459 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:09.589459 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:09.589459 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:09.589459 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:09.589459 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:09.589459 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:28:09.589459 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:28:09.589459 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:28:09.590441 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:28:09.590441 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:09.590441 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:09.590441 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:09.590441 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:09.590441 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:09.590441 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:09.590441 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:09.590441 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:09.590441 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:09.590441 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:09.590441 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:09.590441 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:09.590441 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:09.590441 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:09.590441 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:09.590441 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:09.592091 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:28:09.592091 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:28:09.592091 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:09.592091 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:09.592091 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 253/507] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:28:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:09.592091 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382a107c-ac12-498e-9f0c-b0b72d30f631 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:09.617390 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209110f5-be18-4cca-89c8-4d711f1d2afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:09.618180 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209110f5-be18-4cca-89c8-4d711f1d2afe None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:09.618598 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209110f5-be18-4cca-89c8-4d711f1d2afe None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:09.618865 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209110f5-be18-4cca-89c8-4d711f1d2afe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:09.630709 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209110f5-be18-4cca-89c8-4d711f1d2afe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:09.632222 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209110f5-be18-4cca-89c8-4d711f1d2afe None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:09.651762 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-209110f5-be18-4cca-89c8-4d711f1d2afe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:09.651762 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:09.651762 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:09.651762 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:09.651762 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:09.651762 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:09.651762 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:09.651762 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:09.651762 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:09.651762 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:09.651762 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:09.651762 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:09.651762 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:28:09.651762 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:28:09.651762 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:28:09.652957 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:28:09.652957 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:09.652957 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:09.652957 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:09.652957 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:09.652957 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:09.652957 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:09.652957 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:09.652957 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:09.652957 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:09.652957 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:09.652957 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:09.652957 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:09.652957 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:09.652957 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:09.652957 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:09.652957 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:09.654061 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:28:09.654061 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:28:09.654061 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:09.654061 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:09.654061 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 255/508] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:28:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:09.654061 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209110f5-be18-4cca-89c8-4d711f1d2afe None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:09.705901 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382a107c-ac12-498e-9f0c-b0b72d30f631 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:09.721065 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:09.741757 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9171d6-9c35-4db1-af4d-9751fe81a24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:09.742645 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9171d6-9c35-4db1-af4d-9751fe81a24e None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:09.743511 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9171d6-9c35-4db1-af4d-9751fe81a24e None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:09.744345 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9171d6-9c35-4db1-af4d-9751fe81a24e None admin] PATH_INFO: `/v3/users` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:09.745189 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9171d6-9c35-4db1-af4d-9751fe81a24e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:09.745502 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9171d6-9c35-4db1-af4d-9751fe81a24e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:09.746965 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9171d6-9c35-4db1-af4d-9751fe81a24e None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:09.780092 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209110f5-be18-4cca-89c8-4d711f1d2afe None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:09.793681 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 254/509] 10.222.0.81 () {56 vars in 1137 bytes} [Mon Jul 18 16:28:09 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:09.794576 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9171d6-9c35-4db1-af4d-9751fe81a24e None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:09.820078 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83486c4e-a730-444c-9908-624ab00a02f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:09.820741 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83486c4e-a730-444c-9908-624ab00a02f6 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:09.821024 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83486c4e-a730-444c-9908-624ab00a02f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:09.821300 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83486c4e-a730-444c-9908-624ab00a02f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:09.822026 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83486c4e-a730-444c-9908-624ab00a02f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:09.822346 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83486c4e-a730-444c-9908-624ab00a02f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:09.823807 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83486c4e-a730-444c-9908-624ab00a02f6 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:09.836709 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 256/510] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:28:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:09.837564 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83486c4e-a730-444c-9908-624ab00a02f6 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:09.877739 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:09.932162 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9171d6-9c35-4db1-af4d-9751fe81a24e None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:09.966965 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83486c4e-a730-444c-9908-624ab00a02f6 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:09.968682 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94bab59-c119-4100-82b6-fefe2a593e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:09.969359 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94bab59-c119-4100-82b6-fefe2a593e2d None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:09.969636 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94bab59-c119-4100-82b6-fefe2a593e2d None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:09.969898 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94bab59-c119-4100-82b6-fefe2a593e2d None admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:09.970640 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94bab59-c119-4100-82b6-fefe2a593e2d None admin] RBAC: Adding query filter params (name=service) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:09.970941 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94bab59-c119-4100-82b6-fefe2a593e2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:09.972373 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94bab59-c119-4100-82b6-fefe2a593e2d None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:09.980997 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 255/511] 10.222.0.81 () {56 vars in 1103 bytes} [Mon Jul 18 16:28:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:09.982461 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94bab59-c119-4100-82b6-fefe2a593e2d None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:09.991416 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:10.007998 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d9ab9-3db3-4038-806a-94bccefc4a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:10.008675 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d9ab9-3db3-4038-806a-94bccefc4a60 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:10.008980 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d9ab9-3db3-4038-806a-94bccefc4a60 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:10.009256 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d9ab9-3db3-4038-806a-94bccefc4a60 None admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:10.009978 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95d9ab9-3db3-4038-806a-94bccefc4a60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:10.010281 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95d9ab9-3db3-4038-806a-94bccefc4a60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:10.011787 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95d9ab9-3db3-4038-806a-94bccefc4a60 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:10.023871 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 257/512] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:28:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:10.025794 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d9ab9-3db3-4038-806a-94bccefc4a60 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:10.090431 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94bab59-c119-4100-82b6-fefe2a593e2d None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:10.104107 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:10.128843 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f36d634-e807-4e9b-94ed-239a7c7a2848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:10.129525 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36d634-e807-4e9b-94ed-239a7c7a2848 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:10.129813 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36d634-e807-4e9b-94ed-239a7c7a2848 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:10.130080 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36d634-e807-4e9b-94ed-239a7c7a2848 None admin] PATH_INFO: `/v3/domains` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:10.130805 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f36d634-e807-4e9b-94ed-239a7c7a2848 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:10.131111 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f36d634-e807-4e9b-94ed-239a7c7a2848 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:10.132584 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f36d634-e807-4e9b-94ed-239a7c7a2848 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:10.149381 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 256/513] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:28:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:10.150073 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f36d634-e807-4e9b-94ed-239a7c7a2848 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:10.154760 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d9ab9-3db3-4038-806a-94bccefc4a60 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:10.189584 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dc1129-9e91-496f-aa2d-d30352670689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:10.190233 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc1129-9e91-496f-aa2d-d30352670689 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:10.190511 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc1129-9e91-496f-aa2d-d30352670689 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:10.190786 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc1129-9e91-496f-aa2d-d30352670689 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:10.252360 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:10.261036 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f36d634-e807-4e9b-94ed-239a7c7a2848 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:10.287605 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dc1129-9e91-496f-aa2d-d30352670689 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:10.289132 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dc1129-9e91-496f-aa2d-d30352670689 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:10.299765 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d17ef5-f14d-46c7-b383-e4890a1ed916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:10.300601 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d17ef5-f14d-46c7-b383-e4890a1ed916 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:10.300875 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d17ef5-f14d-46c7-b383-e4890a1ed916 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:10.301152 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d17ef5-f14d-46c7-b383-e4890a1ed916 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:10.309179 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d17ef5-f14d-46c7-b383-e4890a1ed916 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:10.310677 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d17ef5-f14d-46c7-b383-e4890a1ed916 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:10.327357 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-18d17ef5-f14d-46c7-b383-e4890a1ed916 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:28:10.327357 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:10.327357 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:10.327357 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:10.327357 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:10.327357 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:10.327357 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:10.327357 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:10.327357 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:10.327357 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:10.327357 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:10.327357 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:10.327357 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:28:10.327357 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:28:10.327357 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:28:10.328527 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:28:10.328527 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:10.328527 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:10.328527 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:10.328527 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:10.328527 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:10.328527 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:10.328527 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:10.328527 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:10.328527 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:10.328527 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:10.328527 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:10.328527 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:10.328527 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:10.328527 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:10.328527 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:10.328527 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:10.329544 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:28:10.329544 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:28:10.329544 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:28:10.329544 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:28:10.329544 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:28:10.329544 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:28:10.329544 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:28:10.329544 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:10.329544 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 257/514] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Jul 18 16:28:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:10.329544 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d17ef5-f14d-46c7-b383-e4890a1ed916 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:10.363359 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:10.413298 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 258/515] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Jul 18 16:28:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:28:10.414160 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dc1129-9e91-496f-aa2d-d30352670689 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:10.454319 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d17ef5-f14d-46c7-b383-e4890a1ed916 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:10.498369 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d67241-eba4-47a7-a9e7-011aa4021df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:10.499648 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d67241-eba4-47a7-a9e7-011aa4021df9 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:10.500130 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d67241-eba4-47a7-a9e7-011aa4021df9 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:10.500582 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d67241-eba4-47a7-a9e7-011aa4021df9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:10.513688 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d67241-eba4-47a7-a9e7-011aa4021df9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:10.516105 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d67241-eba4-47a7-a9e7-011aa4021df9 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:10.524758 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:10.537314 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-00d67241-eba4-47a7-a9e7-011aa4021df9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:10.537314 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:10.537314 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:10.537314 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:10.537314 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:10.537314 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:10.537314 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:10.537314 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:10.537314 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:10.537314 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:10.537314 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:10.537314 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:10.537314 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:28:10.537314 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:28:10.537314 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:28:10.544053 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:28:10.544053 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:10.544053 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:10.544053 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:10.544053 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:10.544053 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:10.544053 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:10.544053 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:10.544053 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:10.544053 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:10.544053 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:10.544053 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:10.544053 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:10.544053 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:10.544053 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:10.544053 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:10.544053 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:10.546140 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:28:10.546140 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:28:10.546140 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:10.546140 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:10.546140 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 258/516] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:28:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:10.546140 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d67241-eba4-47a7-a9e7-011aa4021df9 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:10.552169 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dc1129-9e91-496f-aa2d-d30352670689 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:10.592673 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b589f5-e540-4e23-9ccf-4ad3bd4aad28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:10.593341 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b589f5-e540-4e23-9ccf-4ad3bd4aad28 None admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:10.593613 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b589f5-e540-4e23-9ccf-4ad3bd4aad28 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:10.593880 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b589f5-e540-4e23-9ccf-4ad3bd4aad28 None admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:10.594623 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b589f5-e540-4e23-9ccf-4ad3bd4aad28 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:10.596116 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b589f5-e540-4e23-9ccf-4ad3bd4aad28 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:10.638724 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:10.655366 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d67241-eba4-47a7-a9e7-011aa4021df9 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:10.685976 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 259/517] 10.222.0.81 () {60 vars in 1132 bytes} [Mon Jul 18 16:28:10 2022] POST /identity/v3/users => generated 247 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:28:10.686925 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b589f5-e540-4e23-9ccf-4ad3bd4aad28 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:10.690749 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ef4446-fd15-4976-8d28-8221237fa219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:10.691579 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef4446-fd15-4976-8d28-8221237fa219 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:10.691898 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef4446-fd15-4976-8d28-8221237fa219 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:10.692172 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef4446-fd15-4976-8d28-8221237fa219 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:10.702430 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ef4446-fd15-4976-8d28-8221237fa219 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:10.704017 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ef4446-fd15-4976-8d28-8221237fa219 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:10.720649 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-c1ef4446-fd15-4976-8d28-8221237fa219 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 18 16:28:10.720649 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:10.720649 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:10.720649 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:10.720649 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:10.720649 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:10.720649 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:10.720649 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:10.720649 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:10.720649 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:10.720649 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:10.720649 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:10.720649 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:28:10.720649 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:28:10.720649 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:28:10.720649 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:28:10.721876 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:10.721876 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:10.721876 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:28:10.721876 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:28:10.721876 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:28:10.721876 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:28:10.721876 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:10.721876 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:10.721876 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:10.721876 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:10.721876 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:10.721876 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:10.721876 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:10.721876 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:10.721876 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:10.721876 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:10.721876 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:10.721876 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:10.722958 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:10.722958 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:10.722958 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:28:10.722958 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:28:10.722958 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:28:10.722958 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:28:10.722958 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:28:10.722958 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:28:10.722958 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 18 16:28:10.722958 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:10.730566 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 259/518] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Jul 18 16:28:10 2022] GET /identity/v3/users/glance => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:10.731266 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ef4446-fd15-4976-8d28-8221237fa219 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:10.845603 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b589f5-e540-4e23-9ccf-4ad3bd4aad28 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:10.869856 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ef4446-fd15-4976-8d28-8221237fa219 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:10.901434 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7168664c-8b11-4743-8342-32352f52aaa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:10.902482 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168664c-8b11-4743-8342-32352f52aaa7 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:10.902940 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168664c-8b11-4743-8342-32352f52aaa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:10.903381 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168664c-8b11-4743-8342-32352f52aaa7 None admin] PATH_INFO: `/v3/projects` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:10.905478 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7168664c-8b11-4743-8342-32352f52aaa7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:10.905996 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7168664c-8b11-4743-8342-32352f52aaa7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:10.908797 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7168664c-8b11-4743-8342-32352f52aaa7 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:10.915622 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:10.923670 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69a91cd-28f3-4f45-9533-7497fb1c2b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:10.923670 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a91cd-28f3-4f45-9533-7497fb1c2b13 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:10.923670 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a91cd-28f3-4f45-9533-7497fb1c2b13 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:10.923670 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a91cd-28f3-4f45-9533-7497fb1c2b13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:10.934279 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69a91cd-28f3-4f45-9533-7497fb1c2b13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:10.935860 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69a91cd-28f3-4f45-9533-7497fb1c2b13 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:10.939749 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:10.943857 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 260/519] 10.222.0.81 () {56 vars in 1148 bytes} [Mon Jul 18 16:28:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:10.945112 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7168664c-8b11-4743-8342-32352f52aaa7 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:10.971345 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-d69a91cd-28f3-4f45-9533-7497fb1c2b13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:10.971345 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:10.971345 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:10.971345 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:10.971345 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:10.971345 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:10.971345 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:10.971345 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:10.971345 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:10.971345 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:10.971345 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:10.971345 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:10.971345 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:28:10.971345 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:28:10.971345 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:28:10.972335 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:28:10.972335 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:10.972335 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:10.972335 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:10.972335 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:10.972335 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:10.972335 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:10.972335 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:10.972335 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:10.972335 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:10.972335 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:10.972335 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:10.972335 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:10.972335 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:10.972335 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:10.972335 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:10.972335 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:10.973209 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:28:10.973209 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:28:10.973209 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:10.973209 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:10.974156 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 260/520] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:28:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:10.975626 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69a91cd-28f3-4f45-9533-7497fb1c2b13 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:11.097042 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69a91cd-28f3-4f45-9533-7497fb1c2b13 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:11.106237 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7168664c-8b11-4743-8342-32352f52aaa7 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:11.137060 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7414b7-7965-46c4-b125-edb5f14a1347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:11.137750 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7414b7-7965-46c4-b125-edb5f14a1347 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:11.138052 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7414b7-7965-46c4-b125-edb5f14a1347 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:11.138325 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7414b7-7965-46c4-b125-edb5f14a1347 None admin] PATH_INFO: `/v3/users` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:11.139167 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7414b7-7965-46c4-b125-edb5f14a1347 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:11.139825 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7414b7-7965-46c4-b125-edb5f14a1347 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:11.142907 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7414b7-7965-46c4-b125-edb5f14a1347 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:11.153294 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fcfee4-1641-428b-af35-f5b76fae9605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:11.154747 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fcfee4-1641-428b-af35-f5b76fae9605 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:11.155027 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fcfee4-1641-428b-af35-f5b76fae9605 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:11.155301 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fcfee4-1641-428b-af35-f5b76fae9605 None admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:11.156074 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fcfee4-1641-428b-af35-f5b76fae9605 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:11.156379 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fcfee4-1641-428b-af35-f5b76fae9605 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:11.157783 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fcfee4-1641-428b-af35-f5b76fae9605 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:11.170433 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 261/521] 10.222.0.81 () {56 vars in 1137 bytes} [Mon Jul 18 16:28:10 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:11.170433 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7414b7-7965-46c4-b125-edb5f14a1347 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:11.170730 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 261/522] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:28:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:11.171667 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fcfee4-1641-428b-af35-f5b76fae9605 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:11.234467 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:11.246800 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:11.299302 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7414b7-7965-46c4-b125-edb5f14a1347 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:11.317567 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fcfee4-1641-428b-af35-f5b76fae9605 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:11.337135 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb1f56-727b-46f2-8b16-b96bcbd4afa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:11.337488 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb1f56-727b-46f2-8b16-b96bcbd4afa5 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:11.337776 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb1f56-727b-46f2-8b16-b96bcbd4afa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:11.338049 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb1f56-727b-46f2-8b16-b96bcbd4afa5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:11.338878 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fb1f56-727b-46f2-8b16-b96bcbd4afa5 None admin] RBAC: Adding query filter params (role.id=a716f51ae5b44c918918ed808ad2b2b0, scope.project.id=9d1d84bf334d47e6bfba1141c1fc6f59, user.id=07f0c5bf1bee48a0bafdf7a9e4537c70) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:11.339185 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fb1f56-727b-46f2-8b16-b96bcbd4afa5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:11.340839 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fb1f56-727b-46f2-8b16-b96bcbd4afa5 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:11.356062 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 262/523] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Jul 18 16:28:11 2022] GET /identity/v3/role_assignments?user.id=07f0c5bf1bee48a0bafdf7a9e4537c70&scope.project.id=9d1d84bf334d47e6bfba1141c1fc6f59&role.id=a716f51ae5b44c918918ed808ad2b2b0 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:11.356062 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb1f56-727b-46f2-8b16-b96bcbd4afa5 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:11.370409 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e235a4e-3892-4f44-b41b-7c2f520b279f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:11.371282 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e235a4e-3892-4f44-b41b-7c2f520b279f None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:11.371673 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e235a4e-3892-4f44-b41b-7c2f520b279f None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:11.372087 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e235a4e-3892-4f44-b41b-7c2f520b279f None admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:11.372973 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e235a4e-3892-4f44-b41b-7c2f520b279f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:11.373401 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e235a4e-3892-4f44-b41b-7c2f520b279f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:11.375005 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e235a4e-3892-4f44-b41b-7c2f520b279f None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:11.389503 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 262/524] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:28:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:11.390528 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e235a4e-3892-4f44-b41b-7c2f520b279f None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:11.484516 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb1f56-727b-46f2-8b16-b96bcbd4afa5 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:11.504935 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:11.517822 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e235a4e-3892-4f44-b41b-7c2f520b279f None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:11.526808 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc4f2db-6e32-45b4-950a-b9b9791a956f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:11.527536 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4f2db-6e32-45b4-950a-b9b9791a956f None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:11.527878 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4f2db-6e32-45b4-950a-b9b9791a956f None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:11.529295 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4f2db-6e32-45b4-950a-b9b9791a956f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:11.541036 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:11.574367 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24df187-0044-4246-97ac-c44a5ea8c7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:11.575170 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24df187-0044-4246-97ac-c44a5ea8c7af None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:11.575969 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24df187-0044-4246-97ac-c44a5ea8c7af None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:11.576278 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24df187-0044-4246-97ac-c44a5ea8c7af None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:11.586745 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24df187-0044-4246-97ac-c44a5ea8c7af None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:11.588912 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24df187-0044-4246-97ac-c44a5ea8c7af None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:11.609273 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc4f2db-6e32-45b4-950a-b9b9791a956f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:11.609444 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-a24df187-0044-4246-97ac-c44a5ea8c7af None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 18 16:28:11.609444 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:11.609444 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:11.609444 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:11.609444 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:11.609444 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:11.609444 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:11.609444 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:11.609444 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:11.609444 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:11.609444 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:11.609444 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:11.609444 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:28:11.609444 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:28:11.609444 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:28:11.609444 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:28:11.610283 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:11.610283 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:11.610283 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:28:11.610283 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:28:11.610283 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:28:11.610283 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:28:11.610283 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:11.610283 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:11.610283 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:11.610283 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:11.610283 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:11.610283 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:11.610283 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:11.610283 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:11.610283 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:11.610283 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:11.610283 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:11.610283 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:11.611180 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:11.611180 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:11.611180 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:28:11.611180 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:28:11.611180 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:28:11.611180 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:28:11.611180 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:28:11.611180 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:28:11.611180 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 18 16:28:11.611180 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:11.611180 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 263/525] 10.222.0.81 () {56 vars in 1102 bytes} [Mon Jul 18 16:28:11 2022] GET /identity/v3/users/neutron => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:11.611769 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24df187-0044-4246-97ac-c44a5ea8c7af None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:11.614348 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc4f2db-6e32-45b4-950a-b9b9791a956f None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:11.747270 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 263/526] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Jul 18 16:28:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:28:11.748853 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc4f2db-6e32-45b4-950a-b9b9791a956f None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:11.762332 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24df187-0044-4246-97ac-c44a5ea8c7af None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:11.768098 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:11.810867 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b7ac66-63bb-4ae1-8380-307a84926f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:11.812725 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7ac66-63bb-4ae1-8380-307a84926f50 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:11.813214 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7ac66-63bb-4ae1-8380-307a84926f50 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:11.813984 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7ac66-63bb-4ae1-8380-307a84926f50 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:11.824555 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b7ac66-63bb-4ae1-8380-307a84926f50 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:11.826384 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b7ac66-63bb-4ae1-8380-307a84926f50 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:11.849384 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-38b7ac66-63bb-4ae1-8380-307a84926f50 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:28:11.849384 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:11.849384 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:11.849384 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:11.849384 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:11.849384 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:11.849384 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:11.849384 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:11.849384 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:11.849384 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:11.849384 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:11.849384 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:11.849384 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:28:11.849384 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:28:11.849384 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:28:11.850576 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:28:11.850576 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:11.850576 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:11.850576 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:11.850576 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:11.850576 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:11.850576 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:11.850576 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:11.850576 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:11.850576 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:11.850576 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:11.850576 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:11.850576 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:11.850576 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:11.850576 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:11.850576 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:11.850576 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:11.851444 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:28:11.851444 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:28:11.851444 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:28:11.851444 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:28:11.851444 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:28:11.851444 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:28:11.851444 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:28:11.851444 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:11.851444 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 264/527] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Jul 18 16:28:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:11.852613 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b7ac66-63bb-4ae1-8380-307a84926f50 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:11.855860 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc4f2db-6e32-45b4-950a-b9b9791a956f None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:11.897221 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a5e79e-812e-41f7-a745-2b047899939d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:11.897800 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5e79e-812e-41f7-a745-2b047899939d None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:11.898075 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5e79e-812e-41f7-a745-2b047899939d None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:11.898341 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5e79e-812e-41f7-a745-2b047899939d None admin] PATH_INFO: `/v3/users` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:11.899166 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a5e79e-812e-41f7-a745-2b047899939d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:11.899470 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a5e79e-812e-41f7-a745-2b047899939d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:11.900943 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a5e79e-812e-41f7-a745-2b047899939d None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:11.904115 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:11.921673 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 264/528] 10.222.0.81 () {56 vars in 1139 bytes} [Mon Jul 18 16:28:11 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:11.922679 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a5e79e-812e-41f7-a745-2b047899939d None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:11.979560 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b7ac66-63bb-4ae1-8380-307a84926f50 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:12.010654 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:12.019821 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0faac-4e4d-4c90-8f4b-707076ebd5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:12.020901 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0faac-4e4d-4c90-8f4b-707076ebd5bf None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:12.021340 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0faac-4e4d-4c90-8f4b-707076ebd5bf None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:12.021824 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0faac-4e4d-4c90-8f4b-707076ebd5bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:12.032783 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed0faac-4e4d-4c90-8f4b-707076ebd5bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:12.034558 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed0faac-4e4d-4c90-8f4b-707076ebd5bf None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:12.034821 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a5e79e-812e-41f7-a745-2b047899939d None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:12.054762 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-7ed0faac-4e4d-4c90-8f4b-707076ebd5bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:12.054762 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:12.054762 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:12.054762 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:12.054762 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:12.054762 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:12.054762 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:12.054762 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:12.054762 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:12.054762 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:12.054762 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:12.054762 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:12.054762 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:28:12.054762 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:28:12.054762 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:28:12.055733 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:28:12.055733 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:12.055733 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:12.055733 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:12.055733 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:12.055733 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:12.055733 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:12.055733 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:12.055733 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:12.055733 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:12.055733 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:12.055733 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:12.055733 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:12.055733 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:12.055733 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:12.055733 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:12.055733 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:12.056609 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:28:12.056609 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:28:12.056609 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:12.056609 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:12.058928 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 265/529] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:28:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:12.060685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0faac-4e4d-4c90-8f4b-707076ebd5bf None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:12.071967 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e5574-5aa6-4e15-beee-76bf53b3a85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:12.072660 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e5574-5aa6-4e15-beee-76bf53b3a85d None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:12.072983 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e5574-5aa6-4e15-beee-76bf53b3a85d None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:12.073265 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e5574-5aa6-4e15-beee-76bf53b3a85d None admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:12.074295 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059e5574-5aa6-4e15-beee-76bf53b3a85d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:12.074471 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059e5574-5aa6-4e15-beee-76bf53b3a85d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:12.076708 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059e5574-5aa6-4e15-beee-76bf53b3a85d None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:12.096417 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 265/530] 10.222.0.81 () {56 vars in 1148 bytes} [Mon Jul 18 16:28:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:12.097452 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e5574-5aa6-4e15-beee-76bf53b3a85d None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:12.164726 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:12.177002 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0faac-4e4d-4c90-8f4b-707076ebd5bf None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:12.206653 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e5574-5aa6-4e15-beee-76bf53b3a85d None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:12.214685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58115713-a4fd-40db-91b9-969232e38971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:12.215336 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58115713-a4fd-40db-91b9-969232e38971 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:12.215612 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58115713-a4fd-40db-91b9-969232e38971 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:12.215913 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58115713-a4fd-40db-91b9-969232e38971 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:12.245307 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1fec76-18ef-4762-9942-182901b4683b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:12.246420 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1fec76-18ef-4762-9942-182901b4683b None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:12.246998 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1fec76-18ef-4762-9942-182901b4683b None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:12.248078 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1fec76-18ef-4762-9942-182901b4683b None admin] PATH_INFO: `/v3/domains` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:12.249001 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1fec76-18ef-4762-9942-182901b4683b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:12.249621 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1fec76-18ef-4762-9942-182901b4683b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:12.251325 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1fec76-18ef-4762-9942-182901b4683b None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:12.254199 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:12.264526 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 266/531] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:28:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:12.265642 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1fec76-18ef-4762-9942-182901b4683b None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:12.289682 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58115713-a4fd-40db-91b9-969232e38971 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:12.290996 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58115713-a4fd-40db-91b9-969232e38971 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:12.374654 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1fec76-18ef-4762-9942-182901b4683b None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:12.386115 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:12.406069 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 266/532] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Jul 18 16:28:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:28:12.406069 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58115713-a4fd-40db-91b9-969232e38971 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:12.420073 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824570d-a2b0-484f-9976-3e127397feba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:12.421049 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824570d-a2b0-484f-9976-3e127397feba None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:12.421535 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824570d-a2b0-484f-9976-3e127397feba None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:12.422015 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824570d-a2b0-484f-9976-3e127397feba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:12.423049 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6824570d-a2b0-484f-9976-3e127397feba None admin] RBAC: Adding query filter params (role.id=a716f51ae5b44c918918ed808ad2b2b0, scope.project.id=9d1d84bf334d47e6bfba1141c1fc6f59, user.id=baaee55accfa458a9832127c5ab77656) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:12.423605 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6824570d-a2b0-484f-9976-3e127397feba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:12.425276 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6824570d-a2b0-484f-9976-3e127397feba None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:12.431647 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 267/533] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Jul 18 16:28:12 2022] GET /identity/v3/role_assignments?user.id=baaee55accfa458a9832127c5ab77656&scope.project.id=9d1d84bf334d47e6bfba1141c1fc6f59&role.id=a716f51ae5b44c918918ed808ad2b2b0 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:12.432843 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824570d-a2b0-484f-9976-3e127397feba None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:12.504609 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:12.519297 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58115713-a4fd-40db-91b9-969232e38971 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:12.557927 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824570d-a2b0-484f-9976-3e127397feba None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:12.558771 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef0b577-4960-4f40-8298-466da6eddafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:12.559747 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef0b577-4960-4f40-8298-466da6eddafb None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:12.560082 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef0b577-4960-4f40-8298-466da6eddafb None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:12.560356 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef0b577-4960-4f40-8298-466da6eddafb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:12.568458 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef0b577-4960-4f40-8298-466da6eddafb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:12.570014 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef0b577-4960-4f40-8298-466da6eddafb None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:12.585940 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-0ef0b577-4960-4f40-8298-466da6eddafb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:28:12.585940 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:12.585940 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:12.585940 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:12.585940 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:12.585940 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:12.585940 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:12.585940 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:12.585940 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:12.585940 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:12.585940 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:12.585940 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:12.585940 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:28:12.585940 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:28:12.585940 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:28:12.586884 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:28:12.586884 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:12.586884 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:12.586884 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:12.586884 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:12.586884 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:12.586884 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:12.586884 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:12.586884 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:12.586884 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:12.586884 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:12.586884 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:12.586884 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:12.586884 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:12.586884 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:12.586884 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:12.586884 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:12.588255 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:28:12.588255 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:28:12.588255 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:28:12.588255 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:28:12.588255 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:28:12.588255 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:28:12.588255 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:28:12.588255 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:12.588255 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 267/534] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Jul 18 16:28:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:12.605731 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef0b577-4960-4f40-8298-466da6eddafb None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:12.623528 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3509e415-3f25-4a96-a85b-2cd93feef4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:12.624385 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509e415-3f25-4a96-a85b-2cd93feef4a9 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:12.624674 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509e415-3f25-4a96-a85b-2cd93feef4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:12.624946 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509e415-3f25-4a96-a85b-2cd93feef4a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:12.639814 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3509e415-3f25-4a96-a85b-2cd93feef4a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:12.641322 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3509e415-3f25-4a96-a85b-2cd93feef4a9 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:12.664115 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-3509e415-3f25-4a96-a85b-2cd93feef4a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:12.664115 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:12.664115 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:12.664115 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:12.664115 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:12.664115 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:12.664115 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:12.664115 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:12.664115 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:12.664115 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:12.664115 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:12.664115 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:12.664115 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:28:12.664115 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:28:12.664115 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:28:12.665115 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:28:12.665115 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:12.665115 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:12.665115 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:12.665115 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:12.665115 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:12.665115 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:12.665115 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:12.665115 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:12.665115 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:12.665115 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:12.665115 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:12.665115 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:12.665115 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:12.665115 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:12.665115 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:12.665115 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:12.666634 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:28:12.666634 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:28:12.666634 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:12.666634 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:12.666634 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 268/535] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:28:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:12.671238 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3509e415-3f25-4a96-a85b-2cd93feef4a9 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:12.720092 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:12.819370 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef0b577-4960-4f40-8298-466da6eddafb None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:12.845736 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3509e415-3f25-4a96-a85b-2cd93feef4a9 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:12.865248 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc1618-7668-456d-bfe1-90a2e8634ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:12.865914 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc1618-7668-456d-bfe1-90a2e8634ac8 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:12.866202 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc1618-7668-456d-bfe1-90a2e8634ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:12.866482 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc1618-7668-456d-bfe1-90a2e8634ac8 None admin] PATH_INFO: `/v3/projects` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:12.867268 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bc1618-7668-456d-bfe1-90a2e8634ac8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:12.867579 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bc1618-7668-456d-bfe1-90a2e8634ac8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:12.869185 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bc1618-7668-456d-bfe1-90a2e8634ac8 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:12.869385 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:12.887636 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 268/536] 10.222.0.81 () {56 vars in 1148 bytes} [Mon Jul 18 16:28:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:12.889437 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc1618-7668-456d-bfe1-90a2e8634ac8 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:12.923852 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80008fb3-7e82-43a4-aba6-f7664dec0572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:12.924446 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80008fb3-7e82-43a4-aba6-f7664dec0572 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:12.924726 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80008fb3-7e82-43a4-aba6-f7664dec0572 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:12.924997 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80008fb3-7e82-43a4-aba6-f7664dec0572 None admin] PATH_INFO: `/v3/domains` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:12.925842 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80008fb3-7e82-43a4-aba6-f7664dec0572 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:12.926145 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80008fb3-7e82-43a4-aba6-f7664dec0572 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:12.927523 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80008fb3-7e82-43a4-aba6-f7664dec0572 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:12.962226 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 269/537] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:28:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:12.963591 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa92d3-a62c-4f54-8c03-b77c5ff93300 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:12.963904 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa92d3-a62c-4f54-8c03-b77c5ff93300 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:12.964178 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa92d3-a62c-4f54-8c03-b77c5ff93300 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:12.965552 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 270/538] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:28:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:12.969967 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa92d3-a62c-4f54-8c03-b77c5ff93300 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:12.993949 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc1618-7668-456d-bfe1-90a2e8634ac8 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:13.004742 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:13.030541 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332414e0-211a-44e6-9fee-a5da3783ee46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:13.031353 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332414e0-211a-44e6-9fee-a5da3783ee46 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:13.031799 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332414e0-211a-44e6-9fee-a5da3783ee46 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:13.032176 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332414e0-211a-44e6-9fee-a5da3783ee46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:13.033109 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332414e0-211a-44e6-9fee-a5da3783ee46 None admin] RBAC: Adding query filter params (role.id=a716f51ae5b44c918918ed808ad2b2b0, scope.project.id=9d1d84bf334d47e6bfba1141c1fc6f59, user.id=e638fbc5f1f3447c8e189c228bbae530) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:13.033555 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332414e0-211a-44e6-9fee-a5da3783ee46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:13.035215 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332414e0-211a-44e6-9fee-a5da3783ee46 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:13.041954 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 269/539] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Jul 18 16:28:12 2022] GET /identity/v3/role_assignments?user.id=e638fbc5f1f3447c8e189c228bbae530&scope.project.id=9d1d84bf334d47e6bfba1141c1fc6f59&role.id=a716f51ae5b44c918918ed808ad2b2b0 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:13.043378 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e4665-a617-426f-b575-f350c1e9ca10 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:13.045335 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e4665-a617-426f-b575-f350c1e9ca10 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:13.052152 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e4665-a617-426f-b575-f350c1e9ca10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:13.092818 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-891e4665-a617-426f-b575-f350c1e9ca10 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:13.093054 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa92d3-a62c-4f54-8c03-b77c5ff93300 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:13.094266 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-891e4665-a617-426f-b575-f350c1e9ca10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:13.131336 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4279e2be-edb9-4aaf-929b-87848b88ab06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:13.132198 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4279e2be-edb9-4aaf-929b-87848b88ab06 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:13.132483 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4279e2be-edb9-4aaf-929b-87848b88ab06 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:13.133018 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4279e2be-edb9-4aaf-929b-87848b88ab06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:13.141123 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4279e2be-edb9-4aaf-929b-87848b88ab06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:13.142644 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4279e2be-edb9-4aaf-929b-87848b88ab06 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:13.161031 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-4279e2be-edb9-4aaf-929b-87848b88ab06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:28:13.161031 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:13.161031 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:13.161031 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:13.161031 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:13.161031 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:13.161031 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:13.161031 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:13.161031 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:13.161031 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:13.161031 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:13.161031 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:13.161031 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:28:13.161031 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:28:13.161031 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:28:13.162115 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:28:13.162115 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:13.162115 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:13.162115 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:13.162115 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:13.162115 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:13.162115 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:13.162115 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:13.162115 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:13.162115 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:13.162115 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:13.162115 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:13.162115 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:13.162115 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:13.162115 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:13.162115 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:13.162115 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:13.163171 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:28:13.163171 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:28:13.163171 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:28:13.163171 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:28:13.163171 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:28:13.163171 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:28:13.163171 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:28:13.163171 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:13.163171 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 271/540] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Jul 18 16:28:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:13.168849 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4279e2be-edb9-4aaf-929b-87848b88ab06 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:13.208325 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:13.313563 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 270/541] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:28:13.327802 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4279e2be-edb9-4aaf-929b-87848b88ab06 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:13.350267 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e4665-a617-426f-b575-f350c1e9ca10 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:13.415489 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deeddcf-320c-4234-9568-870b81752d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:13.416197 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deeddcf-320c-4234-9568-870b81752d39 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:13.416483 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deeddcf-320c-4234-9568-870b81752d39 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:13.416761 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deeddcf-320c-4234-9568-870b81752d39 None admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:13.417555 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deeddcf-320c-4234-9568-870b81752d39 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:13.417863 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deeddcf-320c-4234-9568-870b81752d39 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:13.419384 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deeddcf-320c-4234-9568-870b81752d39 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:13.459737 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 272/542] 10.222.0.81 () {56 vars in 1148 bytes} [Mon Jul 18 16:28:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:13.468827 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deeddcf-320c-4234-9568-870b81752d39 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:13.562153 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e4665-a617-426f-b575-f350c1e9ca10 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:13.563940 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:13.614011 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed4d935-92cd-4a7f-878d-a3fe45844848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:13.615921 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4d935-92cd-4a7f-878d-a3fe45844848 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:13.616210 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4d935-92cd-4a7f-878d-a3fe45844848 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:13.616485 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4d935-92cd-4a7f-878d-a3fe45844848 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:13.635203 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed4d935-92cd-4a7f-878d-a3fe45844848 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:28:13.646748 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-fed4d935-92cd-4a7f-878d-a3fe45844848 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:28:13.646748 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:13.646748 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:13.646748 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:13.646748 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:13.646748 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:13.646748 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:13.646748 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:13.646748 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:13.646748 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:13.646748 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:13.646748 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:13.646748 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:28:13.646748 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:28:13.646748 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:28:13.646748 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:28:13.648184 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:28:13.648184 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:28:13.648184 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:28:13.648184 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:28:13.648184 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:13.648184 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:13.648184 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:13.648184 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:13.648184 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:13.648184 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:13.648184 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:13.648184 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:13.648184 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:13.648184 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:13.648184 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:13.648184 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:13.648993 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:13.648993 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:13.648993 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:13.648993 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:13.648993 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:28:13.648993 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:28:13.648993 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:28:13.648993 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:28:13.648993 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:28:13.648993 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:28:13.648993 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:28:13.648993 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:13.649602 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 271/543] 10.222.0.81 () {56 vars in 1102 bytes} [Mon Jul 18 16:28:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:28:13.665425 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed4d935-92cd-4a7f-878d-a3fe45844848 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:13.780429 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:13.817929 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deeddcf-320c-4234-9568-870b81752d39 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:13.840734 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed4d935-92cd-4a7f-878d-a3fe45844848 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:13.892956 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60847a9-2647-486d-b866-1c2089bb6af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:13.893854 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60847a9-2647-486d-b866-1c2089bb6af7 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:13.895402 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60847a9-2647-486d-b866-1c2089bb6af7 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:13.896424 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60847a9-2647-486d-b866-1c2089bb6af7 None admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:13.897749 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60847a9-2647-486d-b866-1c2089bb6af7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:13.898228 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60847a9-2647-486d-b866-1c2089bb6af7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:13.903407 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e524ef32-eb4f-46f7-8996-d480f57ddfa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:13.904298 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524ef32-eb4f-46f7-8996-d480f57ddfa0 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:13.904626 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524ef32-eb4f-46f7-8996-d480f57ddfa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:13.905053 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524ef32-eb4f-46f7-8996-d480f57ddfa0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:13.906146 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e524ef32-eb4f-46f7-8996-d480f57ddfa0 None admin] RBAC: Adding query filter params (role.id=a716f51ae5b44c918918ed808ad2b2b0, scope.project.id=9d1d84bf334d47e6bfba1141c1fc6f59, user.id=b742c540de6545249fe3245047d00c81) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:13.906539 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e524ef32-eb4f-46f7-8996-d480f57ddfa0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:13.908962 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60847a9-2647-486d-b866-1c2089bb6af7 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:13.910111 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e524ef32-eb4f-46f7-8996-d480f57ddfa0 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:13.918668 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 273/544] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Jul 18 16:28:13 2022] GET /identity/v3/role_assignments?user.id=b742c540de6545249fe3245047d00c81&scope.project.id=9d1d84bf334d47e6bfba1141c1fc6f59&role.id=a716f51ae5b44c918918ed808ad2b2b0 => generated 259 bytes in 450 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:13.921059 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56bf76d-613c-4541-ac83-4c329a4260f7 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:13.921350 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56bf76d-613c-4541-ac83-4c329a4260f7 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:13.921628 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56bf76d-613c-4541-ac83-4c329a4260f7 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:13.923277 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 274/545] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:28:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:13.927193 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 272/546] 10.222.0.81 () {56 vars in 1103 bytes} [Mon Jul 18 16:28:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:13.932891 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56bf76d-613c-4541-ac83-4c329a4260f7 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:13.941754 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be08e1a-17bf-4104-a4d6-6592fb6e0c1c None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:13.942049 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be08e1a-17bf-4104-a4d6-6592fb6e0c1c None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:13.942310 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be08e1a-17bf-4104-a4d6-6592fb6e0c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:13.975450 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-6be08e1a-17bf-4104-a4d6-6592fb6e0c1c None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:13.978511 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-6be08e1a-17bf-4104-a4d6-6592fb6e0c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:14.026294 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:14.115165 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 273/547] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 16:28:14.140752 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be08e1a-17bf-4104-a4d6-6592fb6e0c1c None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:14.148745 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56bf76d-613c-4541-ac83-4c329a4260f7 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:14.195049 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1bc27a-fc25-4af2-a02a-0bd77546e797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:14.195897 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1bc27a-fc25-4af2-a02a-0bd77546e797 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:14.196180 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1bc27a-fc25-4af2-a02a-0bd77546e797 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:14.196456 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1bc27a-fc25-4af2-a02a-0bd77546e797 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:14.217431 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1bc27a-fc25-4af2-a02a-0bd77546e797 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:14.218907 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1bc27a-fc25-4af2-a02a-0bd77546e797 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:14.263061 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-0c1bc27a-fc25-4af2-a02a-0bd77546e797 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:14.263061 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:14.263061 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:14.263061 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:14.263061 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:14.263061 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:14.263061 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:14.263061 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:14.263061 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:14.263061 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:14.263061 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:14.263061 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:14.263061 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:28:14.263061 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:28:14.263061 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:28:14.264586 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:28:14.264586 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:14.264586 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:14.264586 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:14.264586 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:14.264586 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:14.264586 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:14.264586 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:14.264586 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:14.264586 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:14.264586 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:14.264586 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:14.264586 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:14.264586 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:14.264586 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:14.264586 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:14.264586 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:14.266813 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:28:14.266813 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:28:14.266813 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:14.266813 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:14.266813 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 275/548] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:28:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:28:14.270257 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1bc27a-fc25-4af2-a02a-0bd77546e797 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:14.291880 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:14.303388 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be08e1a-17bf-4104-a4d6-6592fb6e0c1c None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:14.398294 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1bc27a-fc25-4af2-a02a-0bd77546e797 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:14.429173 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cce498-495b-4d49-b0aa-6e25f3d27e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:14.429986 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cce498-495b-4d49-b0aa-6e25f3d27e97 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:14.430263 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cce498-495b-4d49-b0aa-6e25f3d27e97 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:14.430523 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cce498-495b-4d49-b0aa-6e25f3d27e97 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:14.438052 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a1db6-c56c-4b2a-a890-dc5abcfff6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:14.438729 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a1db6-c56c-4b2a-a890-dc5abcfff6ed None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:14.439183 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a1db6-c56c-4b2a-a890-dc5abcfff6ed None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:14.439474 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a1db6-c56c-4b2a-a890-dc5abcfff6ed None admin] PATH_INFO: `/v3/domains` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:14.440243 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a1db6-c56c-4b2a-a890-dc5abcfff6ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:14.440558 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a1db6-c56c-4b2a-a890-dc5abcfff6ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:14.442044 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a1db6-c56c-4b2a-a890-dc5abcfff6ed None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:14.456298 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 276/549] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:28:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:14.467472 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a1db6-c56c-4b2a-a890-dc5abcfff6ed None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:14.472387 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cce498-495b-4d49-b0aa-6e25f3d27e97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:28:14.480281 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-c4cce498-495b-4d49-b0aa-6e25f3d27e97 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:28:14.480281 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:14.480281 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:14.480281 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:14.480281 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:14.480281 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:14.480281 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:14.480281 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:14.480281 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:14.480281 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:14.480281 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:14.480281 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:14.480281 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:28:14.480281 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:28:14.480281 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:28:14.480281 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:28:14.481292 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:28:14.481292 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:28:14.481292 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:28:14.481292 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:28:14.481292 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:14.481292 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:14.481292 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:14.481292 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:14.481292 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:14.481292 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:14.481292 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:14.481292 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:14.481292 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:14.481292 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:14.481292 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:14.481292 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:14.482700 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:14.482700 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:14.482700 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:14.482700 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:14.482700 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:28:14.482700 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:28:14.482700 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:28:14.482700 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:28:14.482700 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:28:14.482700 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:28:14.482700 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:28:14.482700 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:14.488226 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 274/550] 10.222.0.81 () {56 vars in 1102 bytes} [Mon Jul 18 16:28:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:14.495590 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cce498-495b-4d49-b0aa-6e25f3d27e97 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:14.554184 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:14.561878 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:14.590556 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a1db6-c56c-4b2a-a890-dc5abcfff6ed None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:14.634772 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deecdc3-2f91-4128-bab0-ca1c2ecc42ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:14.635551 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deecdc3-2f91-4128-bab0-ca1c2ecc42ca None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:14.635865 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deecdc3-2f91-4128-bab0-ca1c2ecc42ca None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:14.636148 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deecdc3-2f91-4128-bab0-ca1c2ecc42ca None admin] PATH_INFO: `/v3/users/swift` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:14.650506 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deecdc3-2f91-4128-bab0-ca1c2ecc42ca None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:14.651929 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deecdc3-2f91-4128-bab0-ca1c2ecc42ca None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:14.689871 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-0deecdc3-2f91-4128-bab0-ca1c2ecc42ca None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 18 16:28:14.689871 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:14.689871 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:14.689871 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:14.689871 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:14.689871 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:14.689871 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:14.689871 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:14.689871 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:14.689871 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:14.689871 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:14.689871 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:14.689871 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:28:14.689871 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:28:14.689871 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:28:14.689871 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:28:14.690896 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:14.690896 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:14.690896 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:28:14.690896 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:28:14.690896 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:28:14.690896 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:28:14.690896 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:14.690896 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:14.690896 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:14.690896 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:14.690896 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:14.690896 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:14.690896 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:14.690896 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:14.690896 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:14.690896 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:14.690896 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:14.690896 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:14.692499 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:14.692499 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:14.692499 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:28:14.692499 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:28:14.692499 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:28:14.692499 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:28:14.692499 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:28:14.692499 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:28:14.692499 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 18 16:28:14.692499 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:14.692499 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 277/551] 10.222.0.81 () {56 vars in 1096 bytes} [Mon Jul 18 16:28:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:14.696861 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deecdc3-2f91-4128-bab0-ca1c2ecc42ca None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:14.750686 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cce498-495b-4d49-b0aa-6e25f3d27e97 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:14.822976 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98829a82-59f7-466b-8549-65ffb272b865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:14.824477 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98829a82-59f7-466b-8549-65ffb272b865 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:14.828712 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98829a82-59f7-466b-8549-65ffb272b865 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:14.829342 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98829a82-59f7-466b-8549-65ffb272b865 None admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:14.830384 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98829a82-59f7-466b-8549-65ffb272b865 None admin] RBAC: Adding query filter params (name=service) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:14.830934 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98829a82-59f7-466b-8549-65ffb272b865 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:14.832842 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98829a82-59f7-466b-8549-65ffb272b865 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:14.857758 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 275/552] 10.222.0.81 () {56 vars in 1103 bytes} [Mon Jul 18 16:28:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:14.864067 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98829a82-59f7-466b-8549-65ffb272b865 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:14.876896 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deecdc3-2f91-4128-bab0-ca1c2ecc42ca None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:14.916548 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:14.926787 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8a0862-e529-4a6b-9324-4e6445c541d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:14.927464 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a0862-e529-4a6b-9324-4e6445c541d6 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:14.927762 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a0862-e529-4a6b-9324-4e6445c541d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:14.928041 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a0862-e529-4a6b-9324-4e6445c541d6 None admin] PATH_INFO: `/v3/users` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:14.929155 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8a0862-e529-4a6b-9324-4e6445c541d6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:14.929463 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8a0862-e529-4a6b-9324-4e6445c541d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:14.931687 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8a0862-e529-4a6b-9324-4e6445c541d6 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:14.959802 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 278/553] 10.222.0.81 () {56 vars in 1135 bytes} [Mon Jul 18 16:28:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:14.961680 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a4b554-0aef-44c5-b1ec-fbba7cf15537 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:14.961978 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a4b554-0aef-44c5-b1ec-fbba7cf15537 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:14.962257 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a4b554-0aef-44c5-b1ec-fbba7cf15537 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:14.963809 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 279/554] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:28:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:14.969958 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a4b554-0aef-44c5-b1ec-fbba7cf15537 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:14.972571 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:15.003761 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98829a82-59f7-466b-8549-65ffb272b865 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:15.040644 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416c7ad8-5c15-4651-b5a7-db0226fce991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:15.042112 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c7ad8-5c15-4651-b5a7-db0226fce991 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:15.042423 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c7ad8-5c15-4651-b5a7-db0226fce991 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:15.042844 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c7ad8-5c15-4651-b5a7-db0226fce991 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:15.057718 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416c7ad8-5c15-4651-b5a7-db0226fce991 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:15.060328 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416c7ad8-5c15-4651-b5a7-db0226fce991 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:15.087072 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-416c7ad8-5c15-4651-b5a7-db0226fce991 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:15.087072 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:15.087072 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:15.087072 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:15.087072 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:15.087072 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:15.087072 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:15.087072 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:15.087072 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:15.087072 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:15.087072 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:15.087072 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:15.087072 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:28:15.087072 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:28:15.087072 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:28:15.088054 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:28:15.088054 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:15.088054 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:15.088054 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:15.088054 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:15.088054 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:15.088054 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:15.088054 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:15.088054 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:15.088054 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:15.088054 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:15.088054 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:15.088054 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:15.088054 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:15.088054 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:15.088054 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:15.088054 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:15.089042 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:28:15.089042 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:28:15.089042 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:15.089042 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:15.089274 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a4b554-0aef-44c5-b1ec-fbba7cf15537 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:15.092068 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 276/555] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:28:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:15.093613 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6bfd6-f455-4327-be71-d7b6376e271e None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:15.093905 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6bfd6-f455-4327-be71-d7b6376e271e None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:15.094180 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6bfd6-f455-4327-be71-d7b6376e271e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:15.120580 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-b5f6bfd6-f455-4327-be71-d7b6376e271e None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:15.123008 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-b5f6bfd6-f455-4327-be71-d7b6376e271e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:15.137072 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa22fa-6e08-4d3c-a646-5ae6197c3d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:15.140019 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa22fa-6e08-4d3c-a646-5ae6197c3d45 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:15.140019 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa22fa-6e08-4d3c-a646-5ae6197c3d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:15.140019 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa22fa-6e08-4d3c-a646-5ae6197c3d45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:15.204517 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:15.220873 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaa22fa-6e08-4d3c-a646-5ae6197c3d45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:15.222142 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 277/556] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:28:15.222802 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaa22fa-6e08-4d3c-a646-5ae6197c3d45 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:15.223470 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f6bfd6-f455-4327-be71-d7b6376e271e None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:15.298309 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:15.343705 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f6bfd6-f455-4327-be71-d7b6376e271e None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:15.361317 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 280/557] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Jul 18 16:28:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:28:15.362829 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa22fa-6e08-4d3c-a646-5ae6197c3d45 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:15.382564 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e3952d-42a8-4ba3-95f0-10cd2c6f2e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:15.383610 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3952d-42a8-4ba3-95f0-10cd2c6f2e1d None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:15.384003 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3952d-42a8-4ba3-95f0-10cd2c6f2e1d None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:15.384355 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3952d-42a8-4ba3-95f0-10cd2c6f2e1d None admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:15.385140 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e3952d-42a8-4ba3-95f0-10cd2c6f2e1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:15.385513 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e3952d-42a8-4ba3-95f0-10cd2c6f2e1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:15.386945 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e3952d-42a8-4ba3-95f0-10cd2c6f2e1d None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:15.404877 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 278/558] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:28:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:15.404877 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e3952d-42a8-4ba3-95f0-10cd2c6f2e1d None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:15.491945 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:15.509290 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa22fa-6e08-4d3c-a646-5ae6197c3d45 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:15.525227 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e3952d-42a8-4ba3-95f0-10cd2c6f2e1d None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:15.548608 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351af0a4-50e5-4a91-a92d-7f9cd4d6d045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:15.549430 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351af0a4-50e5-4a91-a92d-7f9cd4d6d045 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:15.549714 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351af0a4-50e5-4a91-a92d-7f9cd4d6d045 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:15.550002 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351af0a4-50e5-4a91-a92d-7f9cd4d6d045 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:15.551804 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:15.562086 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351af0a4-50e5-4a91-a92d-7f9cd4d6d045 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:28:15.569923 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-351af0a4-50e5-4a91-a92d-7f9cd4d6d045 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:28:15.569923 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:15.569923 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:15.569923 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:15.569923 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:15.569923 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:15.569923 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:15.569923 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:15.569923 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:15.569923 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:15.569923 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:15.569923 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:15.569923 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:28:15.569923 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:28:15.569923 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:28:15.569923 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:28:15.571152 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:28:15.571152 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:28:15.571152 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:28:15.571152 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:28:15.571152 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:15.571152 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:15.571152 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:15.571152 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:15.571152 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:15.571152 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:15.571152 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:15.571152 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:15.571152 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:15.571152 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:15.571152 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:15.571152 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:15.572213 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:15.572213 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:15.572213 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:15.572213 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:15.572213 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:28:15.572213 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:28:15.572213 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:28:15.572213 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:28:15.572213 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:28:15.572213 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:28:15.572213 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:28:15.572213 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:15.572213 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 281/559] 10.222.0.81 () {56 vars in 1102 bytes} [Mon Jul 18 16:28:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:15.572927 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351af0a4-50e5-4a91-a92d-7f9cd4d6d045 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:15.576666 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bab3d7-a8a8-44d0-bd96-6beecd9c0646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:15.577734 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bab3d7-a8a8-44d0-bd96-6beecd9c0646 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:15.578162 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bab3d7-a8a8-44d0-bd96-6beecd9c0646 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:15.578592 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bab3d7-a8a8-44d0-bd96-6beecd9c0646 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:15.591982 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bab3d7-a8a8-44d0-bd96-6beecd9c0646 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:15.593529 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bab3d7-a8a8-44d0-bd96-6beecd9c0646 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:15.611518 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-44bab3d7-a8a8-44d0-bd96-6beecd9c0646 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:15.611518 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:15.611518 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:15.611518 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:15.611518 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:15.611518 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:15.611518 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:15.611518 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:15.611518 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:15.611518 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:15.611518 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:15.611518 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:15.611518 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:28:15.611518 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:28:15.611518 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:28:15.612590 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:28:15.612590 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:15.612590 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:15.612590 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:15.612590 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:15.612590 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:15.612590 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:15.612590 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:15.612590 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:15.612590 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:15.612590 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:15.612590 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:15.612590 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:15.612590 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:15.612590 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:15.612590 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:15.612590 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:15.613765 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:28:15.613765 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:28:15.613765 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:15.613765 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:15.620053 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 279/560] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:28:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:15.621660 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085712d-eab2-4fe1-b597-0a9b74fd4502 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:15.622089 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085712d-eab2-4fe1-b597-0a9b74fd4502 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:15.623021 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085712d-eab2-4fe1-b597-0a9b74fd4502 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:15.624798 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 280/561] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:28:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:15.625512 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4085712d-eab2-4fe1-b597-0a9b74fd4502 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:15.692439 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351af0a4-50e5-4a91-a92d-7f9cd4d6d045 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:15.729644 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928e70a0-0d87-45d5-8de1-c1e2b2d789c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:15.730551 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e70a0-0d87-45d5-8de1-c1e2b2d789c6 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:15.730946 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e70a0-0d87-45d5-8de1-c1e2b2d789c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:15.731296 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e70a0-0d87-45d5-8de1-c1e2b2d789c6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:15.734681 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4085712d-eab2-4fe1-b597-0a9b74fd4502 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:15.739536 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928e70a0-0d87-45d5-8de1-c1e2b2d789c6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:15.741088 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928e70a0-0d87-45d5-8de1-c1e2b2d789c6 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:15.756810 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-928e70a0-0d87-45d5-8de1-c1e2b2d789c6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 16:28:15.756810 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:15.756810 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:15.756810 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:15.756810 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:15.756810 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:15.756810 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:15.756810 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:15.756810 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:15.756810 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:15.756810 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:15.756810 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:15.756810 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:28:15.756810 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:28:15.756810 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:28:15.756810 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:28:15.758084 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:15.758084 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:15.758084 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:28:15.758084 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:28:15.758084 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:28:15.758084 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:28:15.758084 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:15.758084 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:15.758084 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:15.758084 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:15.758084 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:15.758084 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:15.758084 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:15.758084 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:15.758084 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:15.758084 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:15.758084 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:15.758084 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:15.759156 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:15.759156 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:15.759156 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:28:15.759156 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:28:15.759156 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:28:15.759156 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:28:15.759156 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:28:15.759156 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:28:15.759156 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 16:28:15.759156 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:15.759156 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 282/562] 10.222.0.81 () {56 vars in 1093 bytes} [Mon Jul 18 16:28:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:15.759156 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928e70a0-0d87-45d5-8de1-c1e2b2d789c6 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:15.769886 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:15.776817 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421f21f-56ff-4369-b5f0-4cfabf6f9c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:15.783049 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421f21f-56ff-4369-b5f0-4cfabf6f9c09 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:15.783049 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421f21f-56ff-4369-b5f0-4cfabf6f9c09 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:15.783049 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421f21f-56ff-4369-b5f0-4cfabf6f9c09 None admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:15.783049 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4421f21f-56ff-4369-b5f0-4cfabf6f9c09 None admin] RBAC: Adding query filter params (name=service) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:15.783049 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4421f21f-56ff-4369-b5f0-4cfabf6f9c09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:15.783049 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4421f21f-56ff-4369-b5f0-4cfabf6f9c09 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:15.793220 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 281/563] 10.222.0.81 () {56 vars in 1103 bytes} [Mon Jul 18 16:28:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:15.793220 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e205f25-2930-4c8d-8e20-10e0c735bb0f None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:15.793220 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e205f25-2930-4c8d-8e20-10e0c735bb0f None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:15.793220 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e205f25-2930-4c8d-8e20-10e0c735bb0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:15.807186 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-7e205f25-2930-4c8d-8e20-10e0c735bb0f None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:15.811657 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-7e205f25-2930-4c8d-8e20-10e0c735bb0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:15.837978 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:15.918439 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928e70a0-0d87-45d5-8de1-c1e2b2d789c6 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:15.927742 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 282/564] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:28:15.927742 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e205f25-2930-4c8d-8e20-10e0c735bb0f None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:15.968331 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fea90f-c70d-40e9-aa1c-151512605b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:15.969700 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fea90f-c70d-40e9-aa1c-151512605b80 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:15.970135 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fea90f-c70d-40e9-aa1c-151512605b80 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:15.970573 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fea90f-c70d-40e9-aa1c-151512605b80 None admin] PATH_INFO: `/v3/domains` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:15.971841 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fea90f-c70d-40e9-aa1c-151512605b80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:15.972317 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fea90f-c70d-40e9-aa1c-151512605b80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:15.974413 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fea90f-c70d-40e9-aa1c-151512605b80 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:15.991501 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 283/565] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:28:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:15.992831 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fea90f-c70d-40e9-aa1c-151512605b80 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:16.030381 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e205f25-2930-4c8d-8e20-10e0c735bb0f None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:16.065940 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3896b0-8fe1-4a41-969f-eae02a2f48ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:16.066560 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:16.066672 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3896b0-8fe1-4a41-969f-eae02a2f48ee None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:16.066913 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3896b0-8fe1-4a41-969f-eae02a2f48ee None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:16.067180 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3896b0-8fe1-4a41-969f-eae02a2f48ee None admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:16.068061 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3896b0-8fe1-4a41-969f-eae02a2f48ee None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:16.068372 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3896b0-8fe1-4a41-969f-eae02a2f48ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:16.069831 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3896b0-8fe1-4a41-969f-eae02a2f48ee None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:16.088144 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 283/566] 10.222.0.81 () {56 vars in 1133 bytes} [Mon Jul 18 16:28:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:16.088992 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3896b0-8fe1-4a41-969f-eae02a2f48ee None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:16.104058 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fea90f-c70d-40e9-aa1c-151512605b80 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:16.116204 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:16.140564 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c7915-abe3-48e1-b919-a08d3121fffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:16.141457 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c7915-abe3-48e1-b919-a08d3121fffd None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:16.141742 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c7915-abe3-48e1-b919-a08d3121fffd None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:16.142021 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c7915-abe3-48e1-b919-a08d3121fffd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:16.153542 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618c7915-abe3-48e1-b919-a08d3121fffd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:16.154995 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618c7915-abe3-48e1-b919-a08d3121fffd None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:16.173216 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-618c7915-abe3-48e1-b919-a08d3121fffd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:16.173216 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:16.173216 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:16.173216 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:16.173216 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:16.173216 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:16.173216 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:16.173216 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:16.173216 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:16.173216 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:16.173216 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:16.173216 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:16.173216 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:28:16.173216 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:28:16.173216 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:28:16.174208 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:28:16.174208 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:16.174208 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:16.174208 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:16.174208 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:16.174208 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:16.174208 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:16.174208 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:16.174208 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:16.174208 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:16.174208 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:16.174208 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:16.174208 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:16.174208 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:16.174208 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:16.174208 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:16.174208 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:16.175116 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:28:16.175116 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:28:16.175116 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:16.175116 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:16.175116 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 284/567] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:28:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:16.176159 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c7915-abe3-48e1-b919-a08d3121fffd None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:16.213936 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3896b0-8fe1-4a41-969f-eae02a2f48ee None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:16.247003 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1024290e-6b72-48d0-9bdf-68d1c145a543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:16.248348 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1024290e-6b72-48d0-9bdf-68d1c145a543 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:16.248629 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1024290e-6b72-48d0-9bdf-68d1c145a543 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:16.248903 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1024290e-6b72-48d0-9bdf-68d1c145a543 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:16.259355 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1024290e-6b72-48d0-9bdf-68d1c145a543 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:28:16.267419 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-1024290e-6b72-48d0-9bdf-68d1c145a543 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:28:16.267419 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:16.267419 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:16.267419 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:16.267419 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:16.267419 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:16.267419 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:16.267419 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:16.267419 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:16.267419 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:16.267419 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:16.267419 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:16.267419 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:28:16.267419 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:28:16.267419 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:28:16.267419 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:28:16.268400 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:28:16.268400 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:28:16.268400 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:28:16.268400 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:28:16.268400 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:16.268400 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:16.268400 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:16.268400 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:16.268400 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:16.268400 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:16.268400 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:16.268400 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:16.268400 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:16.268400 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:16.268400 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:16.268400 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:16.269246 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:16.269246 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:16.269246 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:16.269246 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:16.269246 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:28:16.269246 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:28:16.269246 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:28:16.269246 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:28:16.269246 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:28:16.269246 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:28:16.269246 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:28:16.269246 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:16.269246 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 284/568] 10.222.0.81 () {56 vars in 1102 bytes} [Mon Jul 18 16:28:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:16.269957 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1024290e-6b72-48d0-9bdf-68d1c145a543 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:16.278162 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c7915-abe3-48e1-b919-a08d3121fffd None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:16.296089 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:16.313384 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feecdd7-a910-4c7d-bd62-a57e71d9eea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:16.314177 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feecdd7-a910-4c7d-bd62-a57e71d9eea8 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:16.314494 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feecdd7-a910-4c7d-bd62-a57e71d9eea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:16.314774 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feecdd7-a910-4c7d-bd62-a57e71d9eea8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:16.321415 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feecdd7-a910-4c7d-bd62-a57e71d9eea8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:16.322886 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feecdd7-a910-4c7d-bd62-a57e71d9eea8 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:16.337271 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-6feecdd7-a910-4c7d-bd62-a57e71d9eea8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:28:16.337271 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:16.337271 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:16.337271 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:16.337271 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:16.337271 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:16.337271 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:16.337271 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:16.337271 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:16.337271 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:16.337271 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:16.337271 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:16.337271 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:28:16.337271 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:28:16.337271 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:28:16.338190 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:28:16.338190 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:16.338190 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:16.338190 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:16.338190 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:16.338190 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:16.338190 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:16.338190 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:16.338190 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:16.338190 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:16.338190 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:16.338190 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:16.338190 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:16.338190 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:16.338190 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:16.338190 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:16.338190 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:16.339534 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:28:16.339534 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:28:16.339534 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:28:16.339534 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:28:16.339534 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:28:16.339534 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:28:16.339534 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:28:16.339534 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:16.339534 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 285/569] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Jul 18 16:28:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:16.340472 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0c383-fb3f-4f4f-a1d9-1a90aebe9aa8 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:16.340556 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0c383-fb3f-4f4f-a1d9-1a90aebe9aa8 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:16.340834 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0c383-fb3f-4f4f-a1d9-1a90aebe9aa8 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:16.342866 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 286/570] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:28:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:16.343565 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a0c383-fb3f-4f4f-a1d9-1a90aebe9aa8 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:16.355381 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:16.375111 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1024290e-6b72-48d0-9bdf-68d1c145a543 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:16.409774 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ef330-2343-43b3-b66f-ade6bf38ce66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:16.410559 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ef330-2343-43b3-b66f-ade6bf38ce66 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:16.410838 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ef330-2343-43b3-b66f-ade6bf38ce66 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:16.411104 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ef330-2343-43b3-b66f-ade6bf38ce66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:16.421598 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69ef330-2343-43b3-b66f-ade6bf38ce66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:16.423072 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69ef330-2343-43b3-b66f-ade6bf38ce66 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:16.440397 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-a69ef330-2343-43b3-b66f-ade6bf38ce66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:16.440397 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:16.440397 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:16.440397 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:16.440397 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:16.440397 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:16.440397 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:16.440397 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:16.440397 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:16.440397 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:16.440397 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:16.440397 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:16.440397 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:28:16.440397 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:28:16.440397 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:28:16.441542 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:28:16.441542 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:16.441542 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:16.441542 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:16.441542 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:16.441542 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:16.441542 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:16.441542 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:16.441542 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:16.441542 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:16.441542 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:16.441542 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:16.441542 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:16.441542 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:16.441542 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:16.441542 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:16.441542 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:16.442654 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:28:16.442654 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:28:16.442654 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:16.442654 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:16.442654 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 285/571] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:28:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:16.443095 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ef330-2343-43b3-b66f-ade6bf38ce66 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:16.448867 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a0c383-fb3f-4f4f-a1d9-1a90aebe9aa8 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:16.489605 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf27a9-5664-4663-b5d7-1f0f051f36c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:16.490270 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf27a9-5664-4663-b5d7-1f0f051f36c3 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:16.490557 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf27a9-5664-4663-b5d7-1f0f051f36c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:16.490832 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf27a9-5664-4663-b5d7-1f0f051f36c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:16.491549 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cf27a9-5664-4663-b5d7-1f0f051f36c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:16.491887 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cf27a9-5664-4663-b5d7-1f0f051f36c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:16.493264 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cf27a9-5664-4663-b5d7-1f0f051f36c3 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:16.504649 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 287/572] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:28:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:16.505481 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf27a9-5664-4663-b5d7-1f0f051f36c3 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:16.545632 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:16.552846 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ef330-2343-43b3-b66f-ade6bf38ce66 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:16.581925 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:16.586832 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a380a3f-4706-4f55-86c0-aae4b0214da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:16.587499 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a380a3f-4706-4f55-86c0-aae4b0214da8 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:16.587810 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a380a3f-4706-4f55-86c0-aae4b0214da8 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:16.588095 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a380a3f-4706-4f55-86c0-aae4b0214da8 None admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:16.588833 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a380a3f-4706-4f55-86c0-aae4b0214da8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:16.589139 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a380a3f-4706-4f55-86c0-aae4b0214da8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:16.590500 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a380a3f-4706-4f55-86c0-aae4b0214da8 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:16.599087 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 286/573] 10.222.0.81 () {56 vars in 1103 bytes} [Mon Jul 18 16:28:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:16.606571 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb8b6a0-6400-4cdc-981b-3fc1bc9a6843 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:16.606571 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb8b6a0-6400-4cdc-981b-3fc1bc9a6843 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:16.606571 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb8b6a0-6400-4cdc-981b-3fc1bc9a6843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:16.607382 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf27a9-5664-4663-b5d7-1f0f051f36c3 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:16.618468 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-dcb8b6a0-6400-4cdc-981b-3fc1bc9a6843 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:16.619651 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-dcb8b6a0-6400-4cdc-981b-3fc1bc9a6843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:16.639861 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c14400-523c-4f84-80e5-238cedfb3bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:16.640533 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c14400-523c-4f84-80e5-238cedfb3bba None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:16.640825 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c14400-523c-4f84-80e5-238cedfb3bba None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:16.641103 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c14400-523c-4f84-80e5-238cedfb3bba None admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:16.641890 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c14400-523c-4f84-80e5-238cedfb3bba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:16.642191 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c14400-523c-4f84-80e5-238cedfb3bba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:16.643615 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c14400-523c-4f84-80e5-238cedfb3bba None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:16.655507 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 288/574] 10.222.0.81 () {56 vars in 1148 bytes} [Mon Jul 18 16:28:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:16.656338 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c14400-523c-4f84-80e5-238cedfb3bba None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:16.693005 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 287/575] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:28:16.694094 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb8b6a0-6400-4cdc-981b-3fc1bc9a6843 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:16.760389 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:16.764299 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c14400-523c-4f84-80e5-238cedfb3bba None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:16.794245 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb8b6a0-6400-4cdc-981b-3fc1bc9a6843 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:16.796576 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d1d66-b0c7-4558-8903-54dec623f1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:16.797229 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d1d66-b0c7-4558-8903-54dec623f1f3 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:16.797536 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d1d66-b0c7-4558-8903-54dec623f1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:16.797807 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d1d66-b0c7-4558-8903-54dec623f1f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:16.798509 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947d1d66-b0c7-4558-8903-54dec623f1f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:16.798808 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947d1d66-b0c7-4558-8903-54dec623f1f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:16.800194 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947d1d66-b0c7-4558-8903-54dec623f1f3 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:16.811027 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 289/576] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:28:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:16.811845 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d1d66-b0c7-4558-8903-54dec623f1f3 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:16.818018 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:16.828783 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23593b78-0b80-4abc-98a0-3e9763ff3f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:16.835328 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23593b78-0b80-4abc-98a0-3e9763ff3f63 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:16.835328 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23593b78-0b80-4abc-98a0-3e9763ff3f63 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:16.835328 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23593b78-0b80-4abc-98a0-3e9763ff3f63 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:16.837316 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23593b78-0b80-4abc-98a0-3e9763ff3f63 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:16.838758 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23593b78-0b80-4abc-98a0-3e9763ff3f63 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:16.853754 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-23593b78-0b80-4abc-98a0-3e9763ff3f63 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 18 16:28:16.853754 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:16.853754 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:16.853754 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:16.853754 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:16.853754 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:16.853754 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:16.853754 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:16.853754 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:16.853754 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:16.853754 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:16.853754 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:16.853754 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:28:16.853754 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:28:16.853754 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:28:16.853754 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:28:16.854897 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:16.854897 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:16.854897 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:28:16.854897 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:28:16.854897 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:28:16.854897 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:28:16.854897 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:16.854897 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:16.854897 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:16.854897 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:16.854897 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:16.854897 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:16.854897 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:16.854897 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:16.854897 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:16.854897 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:16.854897 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:16.854897 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:16.856145 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:16.856145 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:16.856145 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:28:16.856145 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:28:16.856145 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:28:16.856145 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:28:16.856145 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:28:16.856145 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:28:16.856145 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 18 16:28:16.856145 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:16.859689 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 288/577] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Jul 18 16:28:16 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:16.860562 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23593b78-0b80-4abc-98a0-3e9763ff3f63 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:16.914152 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d1d66-b0c7-4558-8903-54dec623f1f3 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:16.946964 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92038550-f02b-45aa-8d8c-34702e76b53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:16.947778 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92038550-f02b-45aa-8d8c-34702e76b53b None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:16.948060 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92038550-f02b-45aa-8d8c-34702e76b53b None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:16.948334 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92038550-f02b-45aa-8d8c-34702e76b53b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:16.959470 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92038550-f02b-45aa-8d8c-34702e76b53b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:16.961070 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92038550-f02b-45aa-8d8c-34702e76b53b None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:16.963788 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23593b78-0b80-4abc-98a0-3e9763ff3f63 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:16.978271 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-92038550-f02b-45aa-8d8c-34702e76b53b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:16.978271 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:16.978271 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:16.978271 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:16.978271 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:16.978271 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:16.978271 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:16.978271 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:16.978271 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:16.978271 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:16.978271 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:16.978271 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:16.978271 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:28:16.978271 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:28:16.978271 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:28:16.979445 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:28:16.979445 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:16.979445 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:16.979445 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:16.979445 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:16.979445 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:16.979445 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:16.979445 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:16.979445 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:16.979445 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:16.979445 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:16.979445 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:16.979445 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:16.979445 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:16.979445 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:16.979445 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:16.979445 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:16.980606 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:28:16.980606 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:28:16.980606 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:16.980606 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:16.983891 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 290/578] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:28:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:16.984908 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92038550-f02b-45aa-8d8c-34702e76b53b None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:16.997205 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:16.999059 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7982fe3-ee11-41cf-9ae5-eefd7d2ccf74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:16.999742 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7982fe3-ee11-41cf-9ae5-eefd7d2ccf74 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:17.000030 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7982fe3-ee11-41cf-9ae5-eefd7d2ccf74 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:17.000309 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7982fe3-ee11-41cf-9ae5-eefd7d2ccf74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:17.001138 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7982fe3-ee11-41cf-9ae5-eefd7d2ccf74 None admin] RBAC: Adding query filter params (role.id=a716f51ae5b44c918918ed808ad2b2b0, scope.project.id=9d1d84bf334d47e6bfba1141c1fc6f59, user.id=251475c53ac64cd48ae84567d8c2ee87) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:17.001450 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7982fe3-ee11-41cf-9ae5-eefd7d2ccf74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:17.002887 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7982fe3-ee11-41cf-9ae5-eefd7d2ccf74 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:17.008802 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 289/579] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Jul 18 16:28:16 2022] GET /identity/v3/role_assignments?user.id=251475c53ac64cd48ae84567d8c2ee87&scope.project.id=9d1d84bf334d47e6bfba1141c1fc6f59&role.id=a716f51ae5b44c918918ed808ad2b2b0 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:17.010832 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7982fe3-ee11-41cf-9ae5-eefd7d2ccf74 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:17.066095 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:17.101730 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92038550-f02b-45aa-8d8c-34702e76b53b None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:17.124167 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7982fe3-ee11-41cf-9ae5-eefd7d2ccf74 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:17.141481 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d063d-9597-416e-833d-6bdc746e0d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:17.142296 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d063d-9597-416e-833d-6bdc746e0d3d None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:17.142575 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d063d-9597-416e-833d-6bdc746e0d3d None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:17.142848 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d063d-9597-416e-833d-6bdc746e0d3d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:17.154773 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258d063d-9597-416e-833d-6bdc746e0d3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:28:17.162972 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-258d063d-9597-416e-833d-6bdc746e0d3d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:28:17.162972 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:17.162972 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:17.162972 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:17.162972 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:17.162972 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:17.162972 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:17.162972 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:17.162972 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:17.162972 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:17.162972 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:17.162972 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:17.162972 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:28:17.162972 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:28:17.162972 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:28:17.162972 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:28:17.164131 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:28:17.164131 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:28:17.164131 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:28:17.164131 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:28:17.164131 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:17.164131 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:17.164131 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:17.164131 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:17.164131 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:17.164131 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:17.164131 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:17.164131 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:17.164131 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:17.164131 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:17.164131 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:17.164131 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:17.165041 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:17.165041 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:17.165041 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:17.165041 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:17.165041 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:28:17.165041 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:28:17.165041 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:28:17.165041 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:28:17.165041 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:28:17.165041 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:28:17.165041 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:28:17.165041 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:17.165041 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 291/580] 10.222.0.81 () {56 vars in 1102 bytes} [Mon Jul 18 16:28:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:17.165881 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d063d-9597-416e-833d-6bdc746e0d3d None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:17.166957 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449f8d10-eac6-434e-96f3-94cc68bcb729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:17.167961 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f8d10-eac6-434e-96f3-94cc68bcb729 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:17.168334 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f8d10-eac6-434e-96f3-94cc68bcb729 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:17.168708 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f8d10-eac6-434e-96f3-94cc68bcb729 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:17.177054 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449f8d10-eac6-434e-96f3-94cc68bcb729 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:17.178637 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449f8d10-eac6-434e-96f3-94cc68bcb729 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:17.200121 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-449f8d10-eac6-434e-96f3-94cc68bcb729 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:28:17.200121 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:17.200121 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:17.200121 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:17.200121 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:17.200121 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:17.200121 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:17.200121 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:17.200121 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:17.200121 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:17.200121 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:17.200121 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:17.200121 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:28:17.200121 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:28:17.200121 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:28:17.201964 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:28:17.201964 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:17.201964 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:17.201964 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:17.201964 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:17.201964 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:17.201964 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:17.201964 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:17.201964 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:17.201964 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:17.201964 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:17.201964 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:17.201964 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:17.201964 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:17.201964 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:17.201964 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:17.201964 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:17.202893 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:28:17.202893 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:28:17.202893 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:28:17.202893 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:28:17.202893 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:28:17.202893 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:28:17.202893 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:28:17.202893 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:17.202893 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 290/581] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Jul 18 16:28:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:17.202893 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449f8d10-eac6-434e-96f3-94cc68bcb729 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:17.257115 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:17.297411 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d063d-9597-416e-833d-6bdc746e0d3d None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:17.307768 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449f8d10-eac6-434e-96f3-94cc68bcb729 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:17.317937 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:17.337893 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc6de19-0671-41e2-8f9b-da621c39c13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:17.338921 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6de19-0671-41e2-8f9b-da621c39c13e None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:17.339421 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6de19-0671-41e2-8f9b-da621c39c13e None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:17.339793 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6de19-0671-41e2-8f9b-da621c39c13e None admin] PATH_INFO: `/v3/users` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:17.340632 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc6de19-0671-41e2-8f9b-da621c39c13e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:17.340970 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc6de19-0671-41e2-8f9b-da621c39c13e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:17.342414 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc6de19-0671-41e2-8f9b-da621c39c13e None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:17.344364 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea5f221-9b39-46d3-a5b9-5113bf338498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:17.345113 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea5f221-9b39-46d3-a5b9-5113bf338498 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:17.345681 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea5f221-9b39-46d3-a5b9-5113bf338498 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:17.345965 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea5f221-9b39-46d3-a5b9-5113bf338498 None admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:17.346702 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea5f221-9b39-46d3-a5b9-5113bf338498 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:17.347004 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea5f221-9b39-46d3-a5b9-5113bf338498 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:17.348406 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea5f221-9b39-46d3-a5b9-5113bf338498 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:17.360128 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 291/582] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:28:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:17.360966 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea5f221-9b39-46d3-a5b9-5113bf338498 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:17.366962 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 292/583] 10.222.0.81 () {56 vars in 1137 bytes} [Mon Jul 18 16:28:17 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:17.368114 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc6de19-0671-41e2-8f9b-da621c39c13e None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:17.468449 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea5f221-9b39-46d3-a5b9-5113bf338498 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:17.489362 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc6de19-0671-41e2-8f9b-da621c39c13e None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:17.505951 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d06b995-dce2-40c0-a56c-83d3b8e7be69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:17.506715 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d06b995-dce2-40c0-a56c-83d3b8e7be69 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:17.507066 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d06b995-dce2-40c0-a56c-83d3b8e7be69 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:17.507412 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d06b995-dce2-40c0-a56c-83d3b8e7be69 None admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:17.508505 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d06b995-dce2-40c0-a56c-83d3b8e7be69 None admin] RBAC: Adding query filter params (name=service) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:17.508883 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d06b995-dce2-40c0-a56c-83d3b8e7be69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:17.510260 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d06b995-dce2-40c0-a56c-83d3b8e7be69 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:17.519338 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 292/584] 10.222.0.81 () {56 vars in 1103 bytes} [Mon Jul 18 16:28:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:17.520200 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:17.520558 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d06b995-dce2-40c0-a56c-83d3b8e7be69 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:17.532392 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c9635-c871-4c92-90e7-7064f40a5f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:17.533540 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c9635-c871-4c92-90e7-7064f40a5f12 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:17.533891 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c9635-c871-4c92-90e7-7064f40a5f12 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:17.534538 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c9635-c871-4c92-90e7-7064f40a5f12 None admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:17.537105 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7c9635-c871-4c92-90e7-7064f40a5f12 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:17.537105 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7c9635-c871-4c92-90e7-7064f40a5f12 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:17.537396 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7c9635-c871-4c92-90e7-7064f40a5f12 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:17.551235 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 293/585] 10.222.0.81 () {56 vars in 1148 bytes} [Mon Jul 18 16:28:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:17.554258 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:17.556773 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c9635-c871-4c92-90e7-7064f40a5f12 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:17.628615 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d06b995-dce2-40c0-a56c-83d3b8e7be69 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:17.668515 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed9b35c-9337-4511-9a26-3c4bb106a481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:17.669909 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c9635-c871-4c92-90e7-7064f40a5f12 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:17.670049 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9b35c-9337-4511-9a26-3c4bb106a481 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:17.670329 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9b35c-9337-4511-9a26-3c4bb106a481 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:17.670671 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9b35c-9337-4511-9a26-3c4bb106a481 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:17.680130 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed9b35c-9337-4511-9a26-3c4bb106a481 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:17.682284 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed9b35c-9337-4511-9a26-3c4bb106a481 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:17.698705 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-9ed9b35c-9337-4511-9a26-3c4bb106a481 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 18 16:28:17.698705 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:17.698705 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:17.698705 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:17.698705 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:17.698705 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:17.698705 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:17.698705 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:17.698705 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:17.698705 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:17.698705 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:17.698705 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:17.698705 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:28:17.698705 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:28:17.698705 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:28:17.698705 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:28:17.699956 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:17.699956 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:17.699956 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:28:17.699956 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:28:17.699956 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:28:17.699956 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:28:17.699956 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:17.699956 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:17.699956 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:17.699956 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:17.699956 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:17.699956 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:17.699956 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:17.699956 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:17.699956 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:17.699956 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:17.699956 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:17.699956 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:17.700951 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:17.700951 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:17.700951 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:28:17.700951 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:28:17.700951 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:28:17.700951 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:28:17.700951 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:28:17.700951 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:28:17.700951 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 18 16:28:17.700951 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:17.700951 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 293/586] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Jul 18 16:28:17 2022] GET /identity/v3/users/glance => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:17.701563 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed9b35c-9337-4511-9a26-3c4bb106a481 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:17.714102 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22883e01-f3d6-49d8-9528-cdb8f0ea8294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:17.714915 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22883e01-f3d6-49d8-9528-cdb8f0ea8294 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:17.715199 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22883e01-f3d6-49d8-9528-cdb8f0ea8294 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:17.715476 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22883e01-f3d6-49d8-9528-cdb8f0ea8294 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:17.726517 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22883e01-f3d6-49d8-9528-cdb8f0ea8294 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:17.727996 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22883e01-f3d6-49d8-9528-cdb8f0ea8294 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:17.746221 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-22883e01-f3d6-49d8-9528-cdb8f0ea8294 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:17.746221 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:17.746221 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:17.746221 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:17.746221 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:17.746221 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:17.746221 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:17.746221 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:17.746221 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:17.746221 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:17.746221 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:17.746221 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:17.746221 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:28:17.746221 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:28:17.746221 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:28:17.747858 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:28:17.747858 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:17.747858 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:17.747858 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:17.747858 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:17.747858 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:17.747858 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:17.747858 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:17.747858 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:17.747858 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:17.747858 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:17.747858 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:17.747858 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:17.747858 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:17.747858 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:17.747858 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:17.747858 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:17.749419 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:28:17.749419 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:28:17.749419 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:17.749419 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:17.749419 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 294/587] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:28:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:17.749419 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22883e01-f3d6-49d8-9528-cdb8f0ea8294 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:17.793758 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:17.806890 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:17.817516 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed9b35c-9337-4511-9a26-3c4bb106a481 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:17.852800 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890208d7-68f7-4c59-95e4-1c14b95054e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:17.853579 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22883e01-f3d6-49d8-9528-cdb8f0ea8294 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:17.853823 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890208d7-68f7-4c59-95e4-1c14b95054e6 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:17.854205 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890208d7-68f7-4c59-95e4-1c14b95054e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:17.854600 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890208d7-68f7-4c59-95e4-1c14b95054e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:17.868843 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890208d7-68f7-4c59-95e4-1c14b95054e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:17.870335 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890208d7-68f7-4c59-95e4-1c14b95054e6 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:17.889163 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5824859b-c09a-42da-b805-83f3ed6bd67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:17.889844 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-890208d7-68f7-4c59-95e4-1c14b95054e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:17.889844 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:17.889844 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:17.889844 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:17.889844 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:17.889844 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:17.889844 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:17.889844 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:17.889844 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:17.889844 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:17.889844 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:17.889844 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:17.889844 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:28:17.889844 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:28:17.889844 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:28:17.891113 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:28:17.891113 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:17.891113 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:17.891113 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:17.891113 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:17.891113 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:17.891113 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:17.891113 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:17.891113 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:17.891113 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:17.891113 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:17.891113 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:17.891113 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:17.891113 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:17.891113 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:17.891113 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:17.891113 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:17.896871 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:28:17.896871 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:28:17.896871 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:17.896871 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:17.897147 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5824859b-c09a-42da-b805-83f3ed6bd67b None admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:17.897233 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 294/588] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:28:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:17.897314 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5824859b-c09a-42da-b805-83f3ed6bd67b None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:17.897314 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5824859b-c09a-42da-b805-83f3ed6bd67b None admin] PATH_INFO: `/v3/projects/9d1d84bf334d47e6bfba1141c1fc6f59/users/07f0c5bf1bee48a0bafdf7a9e4537c70/roles/a716f51ae5b44c918918ed808ad2b2b0` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:17.897476 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890208d7-68f7-4c59-95e4-1c14b95054e6 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:17.912462 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5824859b-c09a-42da-b805-83f3ed6bd67b None admin] RBAC: Authorizing `identity:create_grant(project_id=9d1d84bf334d47e6bfba1141c1fc6f59, user_id=07f0c5bf1bee48a0bafdf7a9e4537c70, role_id=a716f51ae5b44c918918ed808ad2b2b0)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:17.914034 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5824859b-c09a-42da-b805-83f3ed6bd67b None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:17.994287 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 295/589] 10.222.0.81 () {58 vars in 1439 bytes} [Mon Jul 18 16:28:17 2022] PUT /identity/v3/projects/9d1d84bf334d47e6bfba1141c1fc6f59/users/07f0c5bf1bee48a0bafdf7a9e4537c70/roles/a716f51ae5b44c918918ed808ad2b2b0 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:28:17.996595 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5824859b-c09a-42da-b805-83f3ed6bd67b None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:18.002291 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890208d7-68f7-4c59-95e4-1c14b95054e6 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:18.042831 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb6679-fb5a-4d0d-8346-5b45958aabae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:18.043926 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb6679-fb5a-4d0d-8346-5b45958aabae None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:18.044411 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb6679-fb5a-4d0d-8346-5b45958aabae None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:18.044884 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb6679-fb5a-4d0d-8346-5b45958aabae None admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:18.045974 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eb6679-fb5a-4d0d-8346-5b45958aabae None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:18.046486 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eb6679-fb5a-4d0d-8346-5b45958aabae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:18.048133 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eb6679-fb5a-4d0d-8346-5b45958aabae None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:18.070453 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:18.079272 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 295/590] 10.222.0.81 () {56 vars in 1137 bytes} [Mon Jul 18 16:28:17 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:18.079272 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb6679-fb5a-4d0d-8346-5b45958aabae None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:18.143974 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:18.155458 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5824859b-c09a-42da-b805-83f3ed6bd67b None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:18.198684 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d74f28e-5dea-4b86-ba8d-dfa01da84397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:18.199351 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74f28e-5dea-4b86-ba8d-dfa01da84397 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:18.199634 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74f28e-5dea-4b86-ba8d-dfa01da84397 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:18.199945 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74f28e-5dea-4b86-ba8d-dfa01da84397 None admin] PATH_INFO: `/v3/domains` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:18.200856 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d74f28e-5dea-4b86-ba8d-dfa01da84397 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:18.201455 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d74f28e-5dea-4b86-ba8d-dfa01da84397 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:18.202498 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d74f28e-5dea-4b86-ba8d-dfa01da84397 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:18.214664 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 296/591] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:28:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:18.215599 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d74f28e-5dea-4b86-ba8d-dfa01da84397 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:18.217147 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb6679-fb5a-4d0d-8346-5b45958aabae None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:18.263845 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee269f6-9e0d-4802-8b34-3bbb849b717b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:18.265021 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee269f6-9e0d-4802-8b34-3bbb849b717b None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:18.265911 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee269f6-9e0d-4802-8b34-3bbb849b717b None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:18.266476 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee269f6-9e0d-4802-8b34-3bbb849b717b None admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:18.267472 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee269f6-9e0d-4802-8b34-3bbb849b717b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:18.268159 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee269f6-9e0d-4802-8b34-3bbb849b717b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:18.270043 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee269f6-9e0d-4802-8b34-3bbb849b717b None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:18.286740 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 296/592] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:28:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:18.292884 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee269f6-9e0d-4802-8b34-3bbb849b717b None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:18.328243 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d74f28e-5dea-4b86-ba8d-dfa01da84397 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:18.365092 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5889b0fa-b0a8-4398-be6e-6f798b7841e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:18.365928 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5889b0fa-b0a8-4398-be6e-6f798b7841e7 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:18.366362 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5889b0fa-b0a8-4398-be6e-6f798b7841e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:18.366582 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5889b0fa-b0a8-4398-be6e-6f798b7841e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:18.371246 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:18.379008 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5889b0fa-b0a8-4398-be6e-6f798b7841e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:18.380559 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5889b0fa-b0a8-4398-be6e-6f798b7841e7 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:18.400106 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-5889b0fa-b0a8-4398-be6e-6f798b7841e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:18.400106 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:18.400106 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:18.400106 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:18.400106 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:18.400106 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:18.400106 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:18.400106 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:18.400106 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:18.400106 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:18.400106 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:18.400106 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:18.400106 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:28:18.400106 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:28:18.400106 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:28:18.401171 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:28:18.401171 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:18.401171 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:18.401171 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:18.401171 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:18.401171 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:18.401171 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:18.401171 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:18.401171 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:18.401171 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:18.401171 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:18.401171 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:18.401171 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:18.401171 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:18.401171 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:18.401171 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:18.401171 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:18.402115 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:28:18.402115 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:28:18.402115 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:18.402115 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:18.406574 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 297/593] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:28:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:18.407617 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5889b0fa-b0a8-4398-be6e-6f798b7841e7 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:18.411998 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:18.431524 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee269f6-9e0d-4802-8b34-3bbb849b717b None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:18.479792 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7cb01d-896c-4e67-a9f2-b01febaf2591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:18.481494 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7cb01d-896c-4e67-a9f2-b01febaf2591 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:18.482087 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7cb01d-896c-4e67-a9f2-b01febaf2591 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:18.482633 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7cb01d-896c-4e67-a9f2-b01febaf2591 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:18.493061 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7cb01d-896c-4e67-a9f2-b01febaf2591 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:18.495653 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7cb01d-896c-4e67-a9f2-b01febaf2591 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:18.516873 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-cf7cb01d-896c-4e67-a9f2-b01febaf2591 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:28:18.516873 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:18.516873 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:18.516873 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:18.516873 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:18.516873 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:18.516873 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:18.516873 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:18.516873 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:18.516873 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:18.516873 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:18.516873 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:18.516873 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:28:18.516873 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:28:18.516873 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:28:18.518057 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:28:18.518057 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:18.518057 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:18.518057 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:18.518057 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:18.518057 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:18.518057 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:18.518057 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:18.518057 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:18.518057 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:18.518057 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:18.518057 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:18.518057 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:18.518057 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:18.518057 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:18.518057 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:18.518057 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:18.519189 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:28:18.519189 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:28:18.519189 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:28:18.519189 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:28:18.519189 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:28:18.519189 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:28:18.519189 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:28:18.519189 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:18.521384 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 297/594] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Jul 18 16:28:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:18.522612 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7cb01d-896c-4e67-a9f2-b01febaf2591 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:18.540496 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5889b0fa-b0a8-4398-be6e-6f798b7841e7 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:18.577953 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7848a230-87c3-4261-ab5f-e89619c57300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:18.579016 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848a230-87c3-4261-ab5f-e89619c57300 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:18.579341 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848a230-87c3-4261-ab5f-e89619c57300 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:18.579755 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848a230-87c3-4261-ab5f-e89619c57300 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:18.588595 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7848a230-87c3-4261-ab5f-e89619c57300 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:18.590194 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7848a230-87c3-4261-ab5f-e89619c57300 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:18.606040 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-7848a230-87c3-4261-ab5f-e89619c57300 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 18 16:28:18.606040 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:18.606040 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:18.606040 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:18.606040 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:18.606040 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:18.606040 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:18.606040 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:18.606040 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:18.606040 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:18.606040 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:18.606040 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:18.606040 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:28:18.606040 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:28:18.606040 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:28:18.606040 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:28:18.607336 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:18.607336 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:18.607336 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:28:18.607336 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:28:18.607336 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:28:18.607336 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:28:18.607336 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:18.607336 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:18.607336 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:18.607336 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:18.607336 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:18.607336 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:18.607336 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:18.607336 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:18.607336 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:18.607336 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:18.607336 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:18.607336 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:18.608623 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:18.608623 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:18.608623 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:28:18.608623 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:28:18.608623 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:28:18.608623 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:28:18.608623 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:28:18.608623 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:28:18.608623 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 18 16:28:18.608623 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:18.615026 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 298/595] 10.222.0.81 () {56 vars in 1102 bytes} [Mon Jul 18 16:28:18 2022] GET /identity/v3/users/neutron => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:18.615996 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7848a230-87c3-4261-ab5f-e89619c57300 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:18.652898 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7cb01d-896c-4e67-a9f2-b01febaf2591 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:18.677011 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:18.692343 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b96112-405e-4633-a2ed-8e2ad3ac7ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:18.693172 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b96112-405e-4633-a2ed-8e2ad3ac7ad8 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:18.702745 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b96112-405e-4633-a2ed-8e2ad3ac7ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:18.702745 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b96112-405e-4633-a2ed-8e2ad3ac7ad8 None admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:18.702745 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b96112-405e-4633-a2ed-8e2ad3ac7ad8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:18.702745 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b96112-405e-4633-a2ed-8e2ad3ac7ad8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:18.702745 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b96112-405e-4633-a2ed-8e2ad3ac7ad8 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:18.703177 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:18.713621 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 298/596] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:28:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:18.714745 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b96112-405e-4633-a2ed-8e2ad3ac7ad8 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:18.748288 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7848a230-87c3-4261-ab5f-e89619c57300 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:18.786951 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f116eb68-5ee3-46a1-bb11-fcd1f3082b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:18.787815 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f116eb68-5ee3-46a1-bb11-fcd1f3082b6b None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:18.788220 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f116eb68-5ee3-46a1-bb11-fcd1f3082b6b None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:18.788638 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f116eb68-5ee3-46a1-bb11-fcd1f3082b6b None admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:18.789537 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f116eb68-5ee3-46a1-bb11-fcd1f3082b6b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:18.789985 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f116eb68-5ee3-46a1-bb11-fcd1f3082b6b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:18.791855 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f116eb68-5ee3-46a1-bb11-fcd1f3082b6b None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:18.805948 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 299/597] 10.222.0.81 () {56 vars in 1148 bytes} [Mon Jul 18 16:28:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:18.807137 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f116eb68-5ee3-46a1-bb11-fcd1f3082b6b None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:18.855198 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b96112-405e-4633-a2ed-8e2ad3ac7ad8 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:18.902570 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38973d0-7c30-4ac6-a0e5-2ad02d734ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:18.903491 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38973d0-7c30-4ac6-a0e5-2ad02d734ea7 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:18.903613 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38973d0-7c30-4ac6-a0e5-2ad02d734ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:18.903888 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38973d0-7c30-4ac6-a0e5-2ad02d734ea7 None admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:18.905095 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38973d0-7c30-4ac6-a0e5-2ad02d734ea7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:18.905463 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38973d0-7c30-4ac6-a0e5-2ad02d734ea7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:18.907249 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38973d0-7c30-4ac6-a0e5-2ad02d734ea7 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:18.925547 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f116eb68-5ee3-46a1-bb11-fcd1f3082b6b None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:18.935746 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 299/598] 10.222.0.81 () {56 vars in 1139 bytes} [Mon Jul 18 16:28:18 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:18.935746 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38973d0-7c30-4ac6-a0e5-2ad02d734ea7 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:18.957840 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:18.971070 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5092864-4c9e-4af3-8876-8c3a5350ab32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:18.972399 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5092864-4c9e-4af3-8876-8c3a5350ab32 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:18.972898 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5092864-4c9e-4af3-8876-8c3a5350ab32 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:18.973416 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5092864-4c9e-4af3-8876-8c3a5350ab32 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:18.981093 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5092864-4c9e-4af3-8876-8c3a5350ab32 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:18.983818 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5092864-4c9e-4af3-8876-8c3a5350ab32 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:18.985542 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:18.999955 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-a5092864-4c9e-4af3-8876-8c3a5350ab32 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:28:18.999955 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:18.999955 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:18.999955 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:18.999955 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:18.999955 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:18.999955 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:18.999955 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:18.999955 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:18.999955 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:18.999955 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:18.999955 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:18.999955 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:28:18.999955 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:28:18.999955 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:28:19.007069 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:28:19.007069 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:19.007069 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:19.007069 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:19.007069 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:19.007069 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:19.007069 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:19.007069 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:19.007069 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:19.007069 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:19.007069 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:19.007069 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:19.007069 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:19.007069 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:19.007069 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:19.007069 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:19.007069 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:19.008615 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:28:19.008615 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:28:19.008615 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:28:19.008615 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:28:19.008615 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:28:19.008615 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:28:19.008615 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:28:19.008615 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:19.009290 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 300/599] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Jul 18 16:28:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:19.010414 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5092864-4c9e-4af3-8876-8c3a5350ab32 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:19.059685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38973d0-7c30-4ac6-a0e5-2ad02d734ea7 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:19.100191 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb399a74-6410-45c9-87af-9a387ecd7f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:19.101096 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb399a74-6410-45c9-87af-9a387ecd7f1e None admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:19.101365 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb399a74-6410-45c9-87af-9a387ecd7f1e None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:19.101638 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb399a74-6410-45c9-87af-9a387ecd7f1e None admin] PATH_INFO: `/v3/projects/9d1d84bf334d47e6bfba1141c1fc6f59/users/baaee55accfa458a9832127c5ab77656/roles/a716f51ae5b44c918918ed808ad2b2b0` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:19.121263 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb399a74-6410-45c9-87af-9a387ecd7f1e None admin] RBAC: Authorizing `identity:create_grant(project_id=9d1d84bf334d47e6bfba1141c1fc6f59, user_id=baaee55accfa458a9832127c5ab77656, role_id=a716f51ae5b44c918918ed808ad2b2b0)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:19.123318 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb399a74-6410-45c9-87af-9a387ecd7f1e None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:19.128611 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5092864-4c9e-4af3-8876-8c3a5350ab32 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:19.167109 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a2593-9ed2-4e27-8d9d-8af539d428c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:19.167989 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a2593-9ed2-4e27-8d9d-8af539d428c0 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:19.168331 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a2593-9ed2-4e27-8d9d-8af539d428c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:19.168609 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a2593-9ed2-4e27-8d9d-8af539d428c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:19.179626 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754a2593-9ed2-4e27-8d9d-8af539d428c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:19.181148 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754a2593-9ed2-4e27-8d9d-8af539d428c0 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:19.199590 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-754a2593-9ed2-4e27-8d9d-8af539d428c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:19.199590 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:19.199590 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:19.199590 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:19.199590 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:19.199590 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:19.199590 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:19.199590 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:19.199590 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:19.199590 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:19.199590 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:19.199590 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:19.199590 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:28:19.199590 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:28:19.199590 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:28:19.201208 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:28:19.201208 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:19.201208 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:19.201208 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:19.201208 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:19.201208 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:19.201208 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:19.201208 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:19.201208 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:19.201208 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:19.201208 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:19.201208 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:19.201208 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:19.201208 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:19.201208 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:19.201208 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:19.201208 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:19.202140 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:28:19.202140 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:28:19.202140 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:19.202140 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:19.202140 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 301/600] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:28:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:19.202140 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a2593-9ed2-4e27-8d9d-8af539d428c0 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:19.223995 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 300/601] 10.222.0.81 () {58 vars in 1439 bytes} [Mon Jul 18 16:28:18 2022] PUT /identity/v3/projects/9d1d84bf334d47e6bfba1141c1fc6f59/users/baaee55accfa458a9832127c5ab77656/roles/a716f51ae5b44c918918ed808ad2b2b0 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:28:19.225694 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac8c7c-fbcc-41b3-96ed-412a62cd8b08 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:19.225984 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac8c7c-fbcc-41b3-96ed-412a62cd8b08 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:19.226262 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac8c7c-fbcc-41b3-96ed-412a62cd8b08 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:19.227806 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 301/602] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:28:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:19.228428 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ac8c7c-fbcc-41b3-96ed-412a62cd8b08 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:19.252283 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:19.331845 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:19.334630 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a2593-9ed2-4e27-8d9d-8af539d428c0 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:19.346318 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ac8c7c-fbcc-41b3-96ed-412a62cd8b08 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:19.375880 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ae37e-cfc9-46c3-9a74-9a0e47ccc408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:19.376892 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ae37e-cfc9-46c3-9a74-9a0e47ccc408 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:19.377401 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ae37e-cfc9-46c3-9a74-9a0e47ccc408 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:19.377884 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ae37e-cfc9-46c3-9a74-9a0e47ccc408 None admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:19.378898 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772ae37e-cfc9-46c3-9a74-9a0e47ccc408 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:19.379449 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772ae37e-cfc9-46c3-9a74-9a0e47ccc408 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:19.381123 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772ae37e-cfc9-46c3-9a74-9a0e47ccc408 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:19.387102 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14372906-4793-4d4d-83a8-fa06f7f9a203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:19.388393 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14372906-4793-4d4d-83a8-fa06f7f9a203 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:19.388673 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14372906-4793-4d4d-83a8-fa06f7f9a203 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:19.388947 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14372906-4793-4d4d-83a8-fa06f7f9a203 None admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:19.389718 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14372906-4793-4d4d-83a8-fa06f7f9a203 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:19.390018 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14372906-4793-4d4d-83a8-fa06f7f9a203 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:19.391380 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14372906-4793-4d4d-83a8-fa06f7f9a203 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:19.395317 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 302/603] 10.222.0.81 () {56 vars in 1148 bytes} [Mon Jul 18 16:28:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:19.396769 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee9d89-1b63-4722-b8eb-d4cf0f5495bb None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:19.397099 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee9d89-1b63-4722-b8eb-d4cf0f5495bb None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:19.397389 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee9d89-1b63-4722-b8eb-d4cf0f5495bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:19.408272 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 302/604] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:28:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:19.409110 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14372906-4793-4d4d-83a8-fa06f7f9a203 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:19.420261 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-71ee9d89-1b63-4722-b8eb-d4cf0f5495bb None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:19.421864 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-71ee9d89-1b63-4722-b8eb-d4cf0f5495bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:19.498417 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 303/605] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:28:19.499297 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ee9d89-1b63-4722-b8eb-d4cf0f5495bb None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:19.527965 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14372906-4793-4d4d-83a8-fa06f7f9a203 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:19.548509 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:19.565325 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa99c091-10b1-4f96-9b92-cf3bef8f9185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:19.566232 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99c091-10b1-4f96-9b92-cf3bef8f9185 None admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:19.566517 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99c091-10b1-4f96-9b92-cf3bef8f9185 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:19.566798 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99c091-10b1-4f96-9b92-cf3bef8f9185 None admin] PATH_INFO: `/v3/projects/9d1d84bf334d47e6bfba1141c1fc6f59/users/e638fbc5f1f3447c8e189c228bbae530/roles/a716f51ae5b44c918918ed808ad2b2b0` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:19.583096 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa99c091-10b1-4f96-9b92-cf3bef8f9185 None admin] RBAC: Authorizing `identity:create_grant(project_id=9d1d84bf334d47e6bfba1141c1fc6f59, user_id=e638fbc5f1f3447c8e189c228bbae530, role_id=a716f51ae5b44c918918ed808ad2b2b0)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:19.584844 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa99c091-10b1-4f96-9b92-cf3bef8f9185 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:19.629498 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ee9d89-1b63-4722-b8eb-d4cf0f5495bb None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:19.665649 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8eb38b-afc0-49bf-8482-10f6ab3f6e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:19.666565 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8eb38b-afc0-49bf-8482-10f6ab3f6e70 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:19.666845 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8eb38b-afc0-49bf-8482-10f6ab3f6e70 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:19.667115 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8eb38b-afc0-49bf-8482-10f6ab3f6e70 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:19.674823 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8eb38b-afc0-49bf-8482-10f6ab3f6e70 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:19.676394 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8eb38b-afc0-49bf-8482-10f6ab3f6e70 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:19.682330 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:19.690435 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 303/606] 10.222.0.81 () {58 vars in 1439 bytes} [Mon Jul 18 16:28:19 2022] PUT /identity/v3/projects/9d1d84bf334d47e6bfba1141c1fc6f59/users/e638fbc5f1f3447c8e189c228bbae530/roles/a716f51ae5b44c918918ed808ad2b2b0 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:28:19.691316 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa99c091-10b1-4f96-9b92-cf3bef8f9185 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:19.696237 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-2e8eb38b-afc0-49bf-8482-10f6ab3f6e70 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:28:19.696237 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:19.696237 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:19.696237 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:19.696237 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:19.696237 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:19.696237 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:19.696237 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:19.696237 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:19.696237 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:19.696237 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:19.696237 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:19.696237 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:28:19.696237 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:28:19.696237 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:28:19.697217 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:28:19.697217 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:19.697217 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:19.697217 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:19.697217 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:19.697217 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:19.697217 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:19.697217 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:19.697217 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:19.697217 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:19.697217 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:19.697217 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:19.697217 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:19.697217 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:19.697217 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:19.697217 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:19.697217 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:19.698141 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:28:19.698141 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:28:19.698141 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:28:19.698141 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:28:19.698141 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:28:19.698141 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:28:19.698141 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:28:19.698141 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:19.698141 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 304/607] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Jul 18 16:28:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:19.708942 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8eb38b-afc0-49bf-8482-10f6ab3f6e70 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:19.831663 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa99c091-10b1-4f96-9b92-cf3bef8f9185 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:19.878890 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb635d-7ef5-4563-b85b-2bc9b44eea38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:19.879808 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb635d-7ef5-4563-b85b-2bc9b44eea38 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:19.880300 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb635d-7ef5-4563-b85b-2bc9b44eea38 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:19.880590 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb635d-7ef5-4563-b85b-2bc9b44eea38 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:19.884983 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:19.898227 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bb635d-7ef5-4563-b85b-2bc9b44eea38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:28:19.904209 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8eb38b-afc0-49bf-8482-10f6ab3f6e70 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:19.909063 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-d6bb635d-7ef5-4563-b85b-2bc9b44eea38 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:28:19.909063 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:19.909063 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:19.909063 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:19.909063 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:19.909063 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:19.909063 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:19.909063 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:19.909063 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:19.909063 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:19.909063 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:19.909063 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:19.909063 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:28:19.909063 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:28:19.909063 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:28:19.909063 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:28:19.910257 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:28:19.910257 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:28:19.910257 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:28:19.910257 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:28:19.910257 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:19.910257 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:19.910257 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:19.910257 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:19.910257 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:19.910257 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:19.910257 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:19.910257 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:19.910257 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:19.910257 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:19.910257 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:19.910257 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:19.911298 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:19.911298 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:19.911298 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:19.911298 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:19.911298 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:28:19.911298 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:28:19.911298 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:28:19.911298 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:28:19.911298 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:28:19.911298 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:28:19.911298 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:28:19.911298 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:19.914254 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 304/608] 10.222.0.81 () {56 vars in 1102 bytes} [Mon Jul 18 16:28:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:19.920325 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb635d-7ef5-4563-b85b-2bc9b44eea38 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:19.947144 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa5828f-0ae6-4303-bb72-9d2a5bf44a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:19.947725 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5828f-0ae6-4303-bb72-9d2a5bf44a09 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:19.948050 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5828f-0ae6-4303-bb72-9d2a5bf44a09 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:19.948321 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5828f-0ae6-4303-bb72-9d2a5bf44a09 None admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:19.949156 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa5828f-0ae6-4303-bb72-9d2a5bf44a09 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:19.949461 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa5828f-0ae6-4303-bb72-9d2a5bf44a09 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:19.951798 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa5828f-0ae6-4303-bb72-9d2a5bf44a09 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:19.971876 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 305/609] 10.222.0.81 () {56 vars in 1148 bytes} [Mon Jul 18 16:28:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:19.974422 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa5828f-0ae6-4303-bb72-9d2a5bf44a09 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:19.997487 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:20.070901 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb635d-7ef5-4563-b85b-2bc9b44eea38 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:20.111062 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa5828f-0ae6-4303-bb72-9d2a5bf44a09 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:20.152768 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21ab069-035d-4a03-aef8-7410aa3c0fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:20.153392 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ab069-035d-4a03-aef8-7410aa3c0fdb None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:20.153666 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ab069-035d-4a03-aef8-7410aa3c0fdb None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:20.153936 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ab069-035d-4a03-aef8-7410aa3c0fdb None admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:20.154680 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21ab069-035d-4a03-aef8-7410aa3c0fdb None admin] RBAC: Adding query filter params (name=service) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:20.154982 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21ab069-035d-4a03-aef8-7410aa3c0fdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:20.156368 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21ab069-035d-4a03-aef8-7410aa3c0fdb None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:20.165853 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba75c81f-765b-40da-95f9-e641003043b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:20.166752 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba75c81f-765b-40da-95f9-e641003043b9 None admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:20.167024 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba75c81f-765b-40da-95f9-e641003043b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:20.167294 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba75c81f-765b-40da-95f9-e641003043b9 None admin] PATH_INFO: `/v3/projects/9d1d84bf334d47e6bfba1141c1fc6f59/users/b742c540de6545249fe3245047d00c81/roles/a716f51ae5b44c918918ed808ad2b2b0` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:20.173854 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 305/610] 10.222.0.81 () {56 vars in 1103 bytes} [Mon Jul 18 16:28:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:28:20.178950 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21ab069-035d-4a03-aef8-7410aa3c0fdb None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:20.198908 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba75c81f-765b-40da-95f9-e641003043b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=9d1d84bf334d47e6bfba1141c1fc6f59, user_id=b742c540de6545249fe3245047d00c81, role_id=a716f51ae5b44c918918ed808ad2b2b0)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:20.200738 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba75c81f-765b-40da-95f9-e641003043b9 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:20.203537 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:20.275955 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 306/611] 10.222.0.81 () {58 vars in 1439 bytes} [Mon Jul 18 16:28:19 2022] PUT /identity/v3/projects/9d1d84bf334d47e6bfba1141c1fc6f59/users/b742c540de6545249fe3245047d00c81/roles/a716f51ae5b44c918918ed808ad2b2b0 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:28:20.277848 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4addbee-cb6c-43fa-8e53-a6c1558db063 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:20.278930 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4addbee-cb6c-43fa-8e53-a6c1558db063 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:20.279435 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4addbee-cb6c-43fa-8e53-a6c1558db063 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:20.281255 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 307/612] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:28:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:20.291538 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9a689-3321-40ae-8166-15020a309f63 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:20.292207 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9a689-3321-40ae-8166-15020a309f63 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:20.292710 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9a689-3321-40ae-8166-15020a309f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:20.312781 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-3ba9a689-3321-40ae-8166-15020a309f63 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:20.314375 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-3ba9a689-3321-40ae-8166-15020a309f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:20.342750 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21ab069-035d-4a03-aef8-7410aa3c0fdb None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:20.399388 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:20.417190 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 308/613] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 16:28:20.442017 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b319fc6-39d8-42aa-ba8e-0355afaa2505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:20.443490 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b319fc6-39d8-42aa-ba8e-0355afaa2505 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:20.443797 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b319fc6-39d8-42aa-ba8e-0355afaa2505 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:20.444073 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b319fc6-39d8-42aa-ba8e-0355afaa2505 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:20.452535 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba9a689-3321-40ae-8166-15020a309f63 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:20.467378 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b319fc6-39d8-42aa-ba8e-0355afaa2505 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:20.471158 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b319fc6-39d8-42aa-ba8e-0355afaa2505 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:20.493960 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-8b319fc6-39d8-42aa-ba8e-0355afaa2505 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:20.493960 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:20.493960 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:20.493960 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:20.493960 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:20.493960 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:20.493960 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:20.493960 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:20.493960 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:20.493960 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:20.493960 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:20.493960 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:20.493960 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:28:20.493960 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:28:20.493960 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:28:20.494944 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:28:20.494944 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:20.494944 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:20.494944 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:20.494944 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:20.494944 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:20.494944 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:20.494944 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:20.494944 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:20.494944 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:20.494944 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:20.494944 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:20.494944 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:20.494944 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:20.494944 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:20.494944 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:20.494944 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:20.495909 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:28:20.495909 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:28:20.495909 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:20.495909 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:20.495909 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 306/614] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:28:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:20.500955 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b319fc6-39d8-42aa-ba8e-0355afaa2505 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:20.618790 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b319fc6-39d8-42aa-ba8e-0355afaa2505 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:20.619945 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba9a689-3321-40ae-8166-15020a309f63 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:20.660385 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a6422c-8d36-4dcb-821d-dede86d8413b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:20.661106 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6422c-8d36-4dcb-821d-dede86d8413b None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:20.661391 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6422c-8d36-4dcb-821d-dede86d8413b None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:20.661664 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6422c-8d36-4dcb-821d-dede86d8413b None admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:20.662388 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a6422c-8d36-4dcb-821d-dede86d8413b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:20.662699 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a6422c-8d36-4dcb-821d-dede86d8413b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:20.664094 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a6422c-8d36-4dcb-821d-dede86d8413b None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:20.672163 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:20.692295 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 307/615] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:28:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:20.694734 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a6422c-8d36-4dcb-821d-dede86d8413b None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:20.697664 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d652e-8276-4b8e-b5c8-1b5a54efaf9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:20.698542 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d652e-8276-4b8e-b5c8-1b5a54efaf9c None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:20.698822 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d652e-8276-4b8e-b5c8-1b5a54efaf9c None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:20.699098 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d652e-8276-4b8e-b5c8-1b5a54efaf9c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:20.722346 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674d652e-8276-4b8e-b5c8-1b5a54efaf9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:28:20.736111 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-674d652e-8276-4b8e-b5c8-1b5a54efaf9c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:28:20.736111 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:20.736111 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:20.736111 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:20.736111 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:20.736111 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:20.736111 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:20.736111 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:20.736111 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:20.736111 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:20.736111 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:20.736111 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:20.736111 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:28:20.736111 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:28:20.736111 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:28:20.736111 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:28:20.737149 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:28:20.737149 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:28:20.737149 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:28:20.737149 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:28:20.737149 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:20.737149 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:20.737149 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:20.737149 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:20.737149 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:20.737149 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:20.737149 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:20.737149 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:20.737149 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:20.737149 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:20.737149 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:20.737149 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:20.738017 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:20.738017 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:20.738017 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:20.738017 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:20.738017 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:28:20.738017 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:28:20.738017 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:28:20.738017 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:28:20.738017 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:28:20.738017 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:28:20.738017 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:28:20.738017 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:20.744821 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 309/616] 10.222.0.81 () {56 vars in 1102 bytes} [Mon Jul 18 16:28:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:28:20.751315 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d652e-8276-4b8e-b5c8-1b5a54efaf9c None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:20.762953 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:20.872390 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d652e-8276-4b8e-b5c8-1b5a54efaf9c None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:20.909028 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baf683a-0f7f-4ec5-a033-62d21c2589a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:20.910060 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf683a-0f7f-4ec5-a033-62d21c2589a1 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:20.910060 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf683a-0f7f-4ec5-a033-62d21c2589a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:20.910304 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf683a-0f7f-4ec5-a033-62d21c2589a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:20.911053 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baf683a-0f7f-4ec5-a033-62d21c2589a1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:20.911355 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baf683a-0f7f-4ec5-a033-62d21c2589a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:20.913120 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baf683a-0f7f-4ec5-a033-62d21c2589a1 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:20.923094 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 310/617] 10.222.0.81 () {56 vars in 1103 bytes} [Mon Jul 18 16:28:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:20.928200 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baf683a-0f7f-4ec5-a033-62d21c2589a1 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:20.953725 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a6422c-8d36-4dcb-821d-dede86d8413b None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:20.984097 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:21.057519 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8a612a-5adf-42b8-a93a-df9feb5a0b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:21.058330 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a612a-5adf-42b8-a93a-df9feb5a0b5a None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:21.058609 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a612a-5adf-42b8-a93a-df9feb5a0b5a None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:21.058878 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a612a-5adf-42b8-a93a-df9feb5a0b5a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:21.072702 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8a612a-5adf-42b8-a93a-df9feb5a0b5a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:21.074203 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8a612a-5adf-42b8-a93a-df9feb5a0b5a None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:21.092724 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baf683a-0f7f-4ec5-a033-62d21c2589a1 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:21.109935 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-ff8a612a-5adf-42b8-a93a-df9feb5a0b5a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 18 16:28:21.109935 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:21.109935 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:21.109935 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:21.109935 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:21.109935 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:21.109935 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:21.109935 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:21.109935 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:21.109935 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:21.109935 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:21.109935 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:21.109935 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:28:21.109935 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:28:21.109935 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:28:21.109935 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:28:21.111659 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:21.111659 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:21.111659 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:28:21.111659 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:28:21.111659 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:28:21.111659 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:28:21.111659 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:21.111659 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:21.111659 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:21.111659 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:21.111659 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:21.111659 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:21.111659 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:21.111659 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:21.111659 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:21.111659 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:21.111659 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:21.111659 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:21.112929 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:21.112929 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:21.112929 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:28:21.112929 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:28:21.112929 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:28:21.112929 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:28:21.112929 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:28:21.112929 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:28:21.112929 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 18 16:28:21.112929 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:21.112929 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 308/618] 10.222.0.81 () {56 vars in 1096 bytes} [Mon Jul 18 16:28:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 417 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:21.119782 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8a612a-5adf-42b8-a93a-df9feb5a0b5a None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:21.166002 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefe3e47-e431-400f-a86a-7b516bacde5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:21.167158 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe3e47-e431-400f-a86a-7b516bacde5f None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:21.167633 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe3e47-e431-400f-a86a-7b516bacde5f None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:21.170408 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe3e47-e431-400f-a86a-7b516bacde5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:21.193385 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefe3e47-e431-400f-a86a-7b516bacde5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:21.201471 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefe3e47-e431-400f-a86a-7b516bacde5f None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:21.234596 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-eefe3e47-e431-400f-a86a-7b516bacde5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:21.234596 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:21.234596 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:21.234596 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:21.234596 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:21.234596 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:21.234596 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:21.234596 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:21.234596 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:21.234596 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:21.234596 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:21.234596 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:21.234596 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:28:21.234596 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:28:21.234596 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:28:21.235596 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:28:21.235596 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:21.235596 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:21.235596 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:21.235596 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:21.235596 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:21.235596 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:21.235596 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:21.235596 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:21.235596 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:21.235596 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:21.235596 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:21.235596 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:21.235596 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:21.235596 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:21.235596 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:21.235596 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:21.236578 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:28:21.236578 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:28:21.236578 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:21.236578 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:21.239146 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 311/619] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:28:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:21.244924 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefe3e47-e431-400f-a86a-7b516bacde5f None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:21.313192 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:21.328524 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8a612a-5adf-42b8-a93a-df9feb5a0b5a None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:21.387281 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9331804-53d3-4734-9774-c1f9e7773e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:21.388554 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9331804-53d3-4734-9774-c1f9e7773e14 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:21.388836 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9331804-53d3-4734-9774-c1f9e7773e14 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:21.389111 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9331804-53d3-4734-9774-c1f9e7773e14 None admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:21.389962 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9331804-53d3-4734-9774-c1f9e7773e14 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:21.390257 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9331804-53d3-4734-9774-c1f9e7773e14 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:21.391830 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9331804-53d3-4734-9774-c1f9e7773e14 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:21.396328 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:21.402497 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefe3e47-e431-400f-a86a-7b516bacde5f None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:21.412432 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 309/620] 10.222.0.81 () {56 vars in 1135 bytes} [Mon Jul 18 16:28:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:28:21.418594 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9331804-53d3-4734-9774-c1f9e7773e14 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:21.509023 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5eaf5-235c-493e-ba2f-1cea6673d463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:21.509709 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5eaf5-235c-493e-ba2f-1cea6673d463 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:21.509993 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5eaf5-235c-493e-ba2f-1cea6673d463 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:21.510267 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5eaf5-235c-493e-ba2f-1cea6673d463 None admin] PATH_INFO: `/v3/domains` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:21.511011 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b5eaf5-235c-493e-ba2f-1cea6673d463 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:21.511300 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b5eaf5-235c-493e-ba2f-1cea6673d463 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:21.513224 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b5eaf5-235c-493e-ba2f-1cea6673d463 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:21.537396 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9331804-53d3-4734-9774-c1f9e7773e14 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:21.542245 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 312/621] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:28:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:21.547631 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5eaf5-235c-493e-ba2f-1cea6673d463 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:21.577639 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d0fd0c-d5e6-4516-b949-b332cd79bb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:21.578439 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0fd0c-d5e6-4516-b949-b332cd79bb71 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:21.578720 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0fd0c-d5e6-4516-b949-b332cd79bb71 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:21.578997 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0fd0c-d5e6-4516-b949-b332cd79bb71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:21.604899 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d0fd0c-d5e6-4516-b949-b332cd79bb71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:21.606484 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d0fd0c-d5e6-4516-b949-b332cd79bb71 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:21.649257 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-29d0fd0c-d5e6-4516-b949-b332cd79bb71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:21.649257 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:21.649257 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:21.649257 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:21.649257 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:21.649257 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:21.649257 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:21.649257 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:21.649257 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:21.649257 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:21.649257 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:21.649257 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:21.649257 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:28:21.649257 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:28:21.649257 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:28:21.650258 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:28:21.650258 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:21.650258 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:21.650258 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:21.650258 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:21.650258 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:21.650258 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:21.650258 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:21.650258 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:21.650258 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:21.650258 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:21.650258 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:21.650258 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:21.650258 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:21.650258 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:21.650258 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:21.650258 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:21.651190 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:28:21.651190 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:28:21.651190 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:21.651190 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:21.651190 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 310/622] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:28:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:21.655735 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1825f83-4450-4b75-a2d8-7d2711c91a05 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:21.655735 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1825f83-4450-4b75-a2d8-7d2711c91a05 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:21.655735 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1825f83-4450-4b75-a2d8-7d2711c91a05 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:21.655735 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 311/623] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:28:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:21.661250 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1825f83-4450-4b75-a2d8-7d2711c91a05 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:21.666394 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:21.712580 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5eaf5-235c-493e-ba2f-1cea6673d463 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:21.757148 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa43e2-8e47-4ca0-bbdf-bd3029942b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:21.758202 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa43e2-8e47-4ca0-bbdf-bd3029942b11 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:21.758483 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa43e2-8e47-4ca0-bbdf-bd3029942b11 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:21.758755 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa43e2-8e47-4ca0-bbdf-bd3029942b11 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:21.769721 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aa43e2-8e47-4ca0-bbdf-bd3029942b11 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:21.771557 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aa43e2-8e47-4ca0-bbdf-bd3029942b11 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:21.788162 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1825f83-4450-4b75-a2d8-7d2711c91a05 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:21.791779 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-e1aa43e2-8e47-4ca0-bbdf-bd3029942b11 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 16:28:21.791779 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:21.791779 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:21.791779 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:21.791779 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:21.791779 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:21.791779 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:21.791779 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:21.791779 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:21.791779 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:21.791779 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:21.791779 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:21.791779 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:28:21.791779 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:28:21.791779 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:28:21.791779 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:28:21.793008 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:21.793008 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:21.793008 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:28:21.793008 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:28:21.793008 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:28:21.793008 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:28:21.793008 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:21.793008 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:21.793008 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:21.793008 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:21.793008 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:21.793008 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:21.793008 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:21.793008 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:21.793008 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:21.793008 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:21.793008 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:21.793008 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:21.794746 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:21.794746 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:21.794746 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:28:21.794746 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:28:21.794746 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:28:21.794746 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:28:21.794746 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:28:21.794746 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:28:21.794746 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 16:28:21.794746 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:21.794746 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 313/624] 10.222.0.81 () {56 vars in 1093 bytes} [Mon Jul 18 16:28:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:28:21.795471 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebc42f-059b-47f3-b01e-fed8fbae7838 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:21.795570 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebc42f-059b-47f3-b01e-fed8fbae7838 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:21.799757 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebc42f-059b-47f3-b01e-fed8fbae7838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:21.817463 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-72ebc42f-059b-47f3-b01e-fed8fbae7838 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:21.819172 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-72ebc42f-059b-47f3-b01e-fed8fbae7838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:21.829865 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0b711d-5d6c-42fc-b9a4-b6b2228d77a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:21.830909 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b711d-5d6c-42fc-b9a4-b6b2228d77a1 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:21.831417 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b711d-5d6c-42fc-b9a4-b6b2228d77a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:21.831918 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b711d-5d6c-42fc-b9a4-b6b2228d77a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:21.832827 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0b711d-5d6c-42fc-b9a4-b6b2228d77a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:21.833327 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0b711d-5d6c-42fc-b9a4-b6b2228d77a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:21.834995 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0b711d-5d6c-42fc-b9a4-b6b2228d77a1 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:21.835921 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:21.848942 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 312/625] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:28:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:21.850146 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0b711d-5d6c-42fc-b9a4-b6b2228d77a1 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:21.919804 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 314/626] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:28:21.924030 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ebc42f-059b-47f3-b01e-fed8fbae7838 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:21.927146 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:21.977281 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0b711d-5d6c-42fc-b9a4-b6b2228d77a1 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:22.018373 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001dfd61-829c-4519-b66c-162c91130ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:22.019401 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001dfd61-829c-4519-b66c-162c91130ab1 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:22.020096 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001dfd61-829c-4519-b66c-162c91130ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:22.020580 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001dfd61-829c-4519-b66c-162c91130ab1 None admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:22.022175 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001dfd61-829c-4519-b66c-162c91130ab1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:22.022894 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001dfd61-829c-4519-b66c-162c91130ab1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:22.025701 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001dfd61-829c-4519-b66c-162c91130ab1 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:22.049404 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 313/627] 10.222.0.81 () {56 vars in 1133 bytes} [Mon Jul 18 16:28:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:22.050493 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001dfd61-829c-4519-b66c-162c91130ab1 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:22.058030 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ebc42f-059b-47f3-b01e-fed8fbae7838 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:22.091991 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20829d2a-3c1e-4f4a-99ff-38a4234be089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:22.092784 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20829d2a-3c1e-4f4a-99ff-38a4234be089 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:22.093063 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20829d2a-3c1e-4f4a-99ff-38a4234be089 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:22.093336 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20829d2a-3c1e-4f4a-99ff-38a4234be089 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:22.100356 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20829d2a-3c1e-4f4a-99ff-38a4234be089 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:22.101806 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20829d2a-3c1e-4f4a-99ff-38a4234be089 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:22.116007 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-20829d2a-3c1e-4f4a-99ff-38a4234be089 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:28:22.116007 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:22.116007 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:22.116007 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:22.116007 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:22.116007 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:22.116007 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:22.116007 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:22.116007 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:22.116007 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:22.116007 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:22.116007 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:22.116007 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:28:22.116007 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:28:22.116007 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:28:22.116980 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:28:22.116980 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:22.116980 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:22.116980 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:22.116980 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:22.116980 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:22.116980 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:22.116980 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:22.116980 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:22.116980 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:22.116980 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:22.116980 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:22.116980 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:22.116980 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:22.116980 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:22.116980 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:22.116980 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:22.117917 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:28:22.117917 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:28:22.117917 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:28:22.117917 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:28:22.117917 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:28:22.117917 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:28:22.117917 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:28:22.117917 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:22.117917 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 315/628] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Jul 18 16:28:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:22.118417 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64b9c5-d5d7-4638-ba22-bba1233cadc2 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:22.119121 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64b9c5-d5d7-4638-ba22-bba1233cadc2 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:22.119121 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64b9c5-d5d7-4638-ba22-bba1233cadc2 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:22.124950 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 316/629] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:28:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:22.124950 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f64b9c5-d5d7-4638-ba22-bba1233cadc2 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:22.136309 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:22.169180 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001dfd61-829c-4519-b66c-162c91130ab1 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:22.194015 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:22.212008 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a328ca8e-d803-4aba-b9a1-b45078f9c612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:22.213322 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328ca8e-d803-4aba-b9a1-b45078f9c612 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:22.213607 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328ca8e-d803-4aba-b9a1-b45078f9c612 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:22.213881 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328ca8e-d803-4aba-b9a1-b45078f9c612 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:22.226366 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a328ca8e-d803-4aba-b9a1-b45078f9c612 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:28:22.234676 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-a328ca8e-d803-4aba-b9a1-b45078f9c612 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:28:22.234676 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:22.234676 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:22.234676 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:22.234676 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:22.234676 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:22.234676 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:22.234676 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:22.234676 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:22.234676 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:22.234676 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:22.234676 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:22.234676 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:28:22.234676 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:28:22.234676 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:28:22.234676 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:28:22.235848 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:28:22.235848 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:28:22.235848 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:28:22.235848 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:28:22.235848 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:22.235848 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:22.235848 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:22.235848 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:22.235848 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:22.235848 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:22.235848 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:22.235848 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:22.235848 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:22.235848 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:22.235848 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:22.235848 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:22.236895 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:22.236895 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:22.236895 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:22.236895 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:22.236895 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:28:22.236895 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:28:22.236895 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:28:22.236895 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:28:22.236895 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:28:22.236895 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:28:22.236895 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:28:22.236895 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:22.241377 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 314/630] 10.222.0.81 () {56 vars in 1102 bytes} [Mon Jul 18 16:28:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:22.242718 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbcaffb-8086-4057-99d4-20e3dd00bf48 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:22.242973 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbcaffb-8086-4057-99d4-20e3dd00bf48 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:22.243254 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbcaffb-8086-4057-99d4-20e3dd00bf48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:22.243360 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f64b9c5-d5d7-4638-ba22-bba1233cadc2 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:22.262998 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-9cbcaffb-8086-4057-99d4-20e3dd00bf48 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:22.264248 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-9cbcaffb-8086-4057-99d4-20e3dd00bf48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:22.279631 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db098d-7da6-45e9-846f-bdd2ff4eb041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:22.280236 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db098d-7da6-45e9-846f-bdd2ff4eb041 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:22.280514 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db098d-7da6-45e9-846f-bdd2ff4eb041 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:22.280782 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db098d-7da6-45e9-846f-bdd2ff4eb041 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:22.339911 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 315/631] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:28:22.339911 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbcaffb-8086-4057-99d4-20e3dd00bf48 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:22.355704 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97db098d-7da6-45e9-846f-bdd2ff4eb041 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:22.357759 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97db098d-7da6-45e9-846f-bdd2ff4eb041 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:22.368081 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:22.459582 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 317/632] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Jul 18 16:28:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:28:22.460830 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db098d-7da6-45e9-846f-bdd2ff4eb041 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:22.468283 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbcaffb-8086-4057-99d4-20e3dd00bf48 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:22.480923 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:22.506259 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dfb129-81ac-47f3-aa81-6f83e1da93b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:22.507278 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dfb129-81ac-47f3-aa81-6f83e1da93b2 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:22.508059 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dfb129-81ac-47f3-aa81-6f83e1da93b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:22.508566 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dfb129-81ac-47f3-aa81-6f83e1da93b2 None admin] PATH_INFO: `/v3/projects` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:22.509555 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dfb129-81ac-47f3-aa81-6f83e1da93b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:22.509942 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dfb129-81ac-47f3-aa81-6f83e1da93b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:22.511500 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dfb129-81ac-47f3-aa81-6f83e1da93b2 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:22.529376 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 316/633] 10.222.0.81 () {56 vars in 1148 bytes} [Mon Jul 18 16:28:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:22.529376 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dfb129-81ac-47f3-aa81-6f83e1da93b2 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:22.576924 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db098d-7da6-45e9-846f-bdd2ff4eb041 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:22.586582 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:22.612777 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb9bc4d-13e8-471c-8768-d9568472d064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:22.613545 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9bc4d-13e8-471c-8768-d9568472d064 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:22.613904 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9bc4d-13e8-471c-8768-d9568472d064 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:22.614108 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9bc4d-13e8-471c-8768-d9568472d064 None admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:22.614848 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb9bc4d-13e8-471c-8768-d9568472d064 None admin] RBAC: Adding query filter params (name=service) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:22.615152 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb9bc4d-13e8-471c-8768-d9568472d064 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:22.616580 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb9bc4d-13e8-471c-8768-d9568472d064 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:22.624819 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 318/634] 10.222.0.81 () {56 vars in 1103 bytes} [Mon Jul 18 16:28:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:22.626027 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb9bc4d-13e8-471c-8768-d9568472d064 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:22.638698 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dfb129-81ac-47f3-aa81-6f83e1da93b2 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:22.673467 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966900c7-c7cd-4676-a33d-253d31936f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:22.674338 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966900c7-c7cd-4676-a33d-253d31936f02 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:22.674560 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966900c7-c7cd-4676-a33d-253d31936f02 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:22.675258 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966900c7-c7cd-4676-a33d-253d31936f02 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:22.684971 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966900c7-c7cd-4676-a33d-253d31936f02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:28:22.692539 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-966900c7-c7cd-4676-a33d-253d31936f02 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:28:22.692539 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:22.692539 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:22.692539 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:22.692539 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:22.692539 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:22.692539 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:22.692539 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:22.692539 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:22.692539 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:22.692539 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:22.692539 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:22.692539 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:28:22.692539 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:28:22.692539 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:28:22.692539 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:28:22.693658 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:28:22.693658 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:28:22.693658 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:28:22.693658 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:28:22.693658 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:22.693658 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:22.693658 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:22.693658 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:22.693658 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:22.693658 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:22.693658 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:22.693658 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:22.693658 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:22.693658 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:22.693658 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:22.693658 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:22.694547 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:22.694547 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:22.694547 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:22.694547 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:22.694547 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:28:22.694547 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:28:22.694547 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:28:22.694547 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:28:22.694547 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:28:22.694547 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:28:22.694547 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:28:22.694547 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:22.694547 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 317/635] 10.222.0.81 () {56 vars in 1102 bytes} [Mon Jul 18 16:28:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:22.695267 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966900c7-c7cd-4676-a33d-253d31936f02 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:22.725804 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:22.728982 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb9bc4d-13e8-471c-8768-d9568472d064 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:22.779253 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec515f9b-0368-4995-9fd1-752ab63df09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:22.780282 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec515f9b-0368-4995-9fd1-752ab63df09e None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:22.780620 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec515f9b-0368-4995-9fd1-752ab63df09e None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:22.780968 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec515f9b-0368-4995-9fd1-752ab63df09e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:22.792519 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec515f9b-0368-4995-9fd1-752ab63df09e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:22.794043 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec515f9b-0368-4995-9fd1-752ab63df09e None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:22.802896 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966900c7-c7cd-4676-a33d-253d31936f02 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:22.812202 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-ec515f9b-0368-4995-9fd1-752ab63df09e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:22.812202 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:22.812202 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:22.812202 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:22.812202 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:22.812202 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:22.812202 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:22.812202 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:22.812202 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:22.812202 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:22.812202 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:22.812202 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:22.812202 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:28:22.812202 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:28:22.812202 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:28:22.813383 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:28:22.813383 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:22.813383 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:22.813383 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:22.813383 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:22.813383 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:22.813383 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:22.813383 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:22.813383 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:22.813383 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:22.813383 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:22.813383 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:22.813383 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:22.813383 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:22.813383 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:22.813383 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:22.813383 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:22.814491 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:28:22.814491 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:28:22.814491 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:22.814491 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:22.814491 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 319/636] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:28:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:22.814962 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cdc97a-3c3c-4c29-ba2c-2bc33c928f01 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:22.814962 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cdc97a-3c3c-4c29-ba2c-2bc33c928f01 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:22.815244 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cdc97a-3c3c-4c29-ba2c-2bc33c928f01 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:22.816728 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 320/637] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:28:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:22.817185 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cdc97a-3c3c-4c29-ba2c-2bc33c928f01 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:22.845256 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da62e293-6bd2-4029-a7a9-09b07410b46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:22.846078 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62e293-6bd2-4029-a7a9-09b07410b46c None admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:22.846355 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62e293-6bd2-4029-a7a9-09b07410b46c None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:22.846629 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62e293-6bd2-4029-a7a9-09b07410b46c None admin] PATH_INFO: `/v3/projects/9d1d84bf334d47e6bfba1141c1fc6f59/users/251475c53ac64cd48ae84567d8c2ee87/roles/a716f51ae5b44c918918ed808ad2b2b0` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:22.847336 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:22.863182 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da62e293-6bd2-4029-a7a9-09b07410b46c None admin] RBAC: Authorizing `identity:create_grant(project_id=9d1d84bf334d47e6bfba1141c1fc6f59, user_id=251475c53ac64cd48ae84567d8c2ee87, role_id=a716f51ae5b44c918918ed808ad2b2b0)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:22.864663 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da62e293-6bd2-4029-a7a9-09b07410b46c None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:22.925571 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cdc97a-3c3c-4c29-ba2c-2bc33c928f01 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:22.944034 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 318/638] 10.222.0.81 () {58 vars in 1439 bytes} [Mon Jul 18 16:28:22 2022] PUT /identity/v3/projects/9d1d84bf334d47e6bfba1141c1fc6f59/users/251475c53ac64cd48ae84567d8c2ee87/roles/a716f51ae5b44c918918ed808ad2b2b0 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:28:22.944898 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da62e293-6bd2-4029-a7a9-09b07410b46c None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:22.975459 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9914a7a-3569-47cd-88f9-7d79dae49cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:22.976325 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9914a7a-3569-47cd-88f9-7d79dae49cd3 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:22.976641 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9914a7a-3569-47cd-88f9-7d79dae49cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:22.976947 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9914a7a-3569-47cd-88f9-7d79dae49cd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:22.988976 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9914a7a-3569-47cd-88f9-7d79dae49cd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:22.990463 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9914a7a-3569-47cd-88f9-7d79dae49cd3 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:23.009744 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-b9914a7a-3569-47cd-88f9-7d79dae49cd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:23.009744 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:23.009744 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:23.009744 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:23.009744 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:23.009744 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:23.009744 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:23.009744 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:23.009744 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:23.009744 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:23.009744 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:23.009744 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:23.009744 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:28:23.009744 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:28:23.009744 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:28:23.010849 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:28:23.010849 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:23.010849 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:23.010849 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:23.010849 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:23.010849 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:23.010849 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:23.010849 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:23.010849 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:23.010849 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:23.010849 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:23.010849 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:23.010849 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:23.010849 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:23.010849 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:23.010849 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:23.010849 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:23.011832 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:28:23.011832 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:28:23.011832 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:23.011832 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:23.011832 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 321/639] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:28:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:23.011832 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9914a7a-3569-47cd-88f9-7d79dae49cd3 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:23.059845 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:23.080827 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da62e293-6bd2-4029-a7a9-09b07410b46c None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:23.109516 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:23.124322 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0b2402-f713-4691-958f-1ab8147b46f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:23.124990 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b2402-f713-4691-958f-1ab8147b46f8 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:23.125279 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b2402-f713-4691-958f-1ab8147b46f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:23.125556 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b2402-f713-4691-958f-1ab8147b46f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:23.126302 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0b2402-f713-4691-958f-1ab8147b46f8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:23.126604 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0b2402-f713-4691-958f-1ab8147b46f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:23.128058 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0b2402-f713-4691-958f-1ab8147b46f8 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:23.138071 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 319/640] 10.222.0.81 () {56 vars in 1103 bytes} [Mon Jul 18 16:28:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:23.140231 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc55d17-5845-41a7-961b-c45451b06678 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:23.140709 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc55d17-5845-41a7-961b-c45451b06678 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:23.141219 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc55d17-5845-41a7-961b-c45451b06678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:23.143517 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9914a7a-3569-47cd-88f9-7d79dae49cd3 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:23.160659 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-dfc55d17-5845-41a7-961b-c45451b06678 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:23.161847 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-dfc55d17-5845-41a7-961b-c45451b06678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:23.182186 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d645d-43d6-4432-add7-7812f46708a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:23.183340 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d645d-43d6-4432-add7-7812f46708a2 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:23.183869 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d645d-43d6-4432-add7-7812f46708a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:23.184896 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d645d-43d6-4432-add7-7812f46708a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:23.185770 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60d645d-43d6-4432-add7-7812f46708a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:23.186353 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60d645d-43d6-4432-add7-7812f46708a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:23.188011 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60d645d-43d6-4432-add7-7812f46708a2 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:23.201001 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 322/641] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:28:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:23.202092 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d645d-43d6-4432-add7-7812f46708a2 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:23.233495 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 320/642] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:28:23.234456 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc55d17-5845-41a7-961b-c45451b06678 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:23.327729 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d645d-43d6-4432-add7-7812f46708a2 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:23.328331 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:23.357561 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc55d17-5845-41a7-961b-c45451b06678 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:23.363938 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9923514-74d2-46b5-9948-7706e2c4cdac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:23.364588 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9923514-74d2-46b5-9948-7706e2c4cdac None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:23.365315 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9923514-74d2-46b5-9948-7706e2c4cdac None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:23.365593 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9923514-74d2-46b5-9948-7706e2c4cdac None admin] PATH_INFO: `/v3/domains` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:23.366305 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9923514-74d2-46b5-9948-7706e2c4cdac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:23.366608 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9923514-74d2-46b5-9948-7706e2c4cdac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:23.368372 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9923514-74d2-46b5-9948-7706e2c4cdac None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:23.370539 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:23.388188 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 323/643] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:28:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:23.388188 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9923514-74d2-46b5-9948-7706e2c4cdac None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:23.400308 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc9d402-d9e5-41c9-a7c0-3957f9323cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:23.401094 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9d402-d9e5-41c9-a7c0-3957f9323cec None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:23.401373 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9d402-d9e5-41c9-a7c0-3957f9323cec None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:23.401645 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9d402-d9e5-41c9-a7c0-3957f9323cec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:23.413231 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc9d402-d9e5-41c9-a7c0-3957f9323cec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:23.414685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc9d402-d9e5-41c9-a7c0-3957f9323cec None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:23.432797 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-4fc9d402-d9e5-41c9-a7c0-3957f9323cec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:23.432797 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:23.432797 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:23.432797 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:23.432797 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:23.432797 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:23.432797 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:23.432797 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:23.432797 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:23.432797 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:23.432797 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:23.432797 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:23.432797 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:28:23.432797 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:28:23.432797 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:28:23.433800 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:28:23.433800 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:23.433800 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:23.433800 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:23.433800 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:23.433800 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:23.433800 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:23.433800 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:23.433800 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:23.433800 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:23.433800 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:23.433800 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:23.433800 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:23.433800 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:23.433800 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:23.433800 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:23.433800 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:23.435265 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:28:23.435265 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:28:23.435265 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:23.435265 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:23.435265 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 321/644] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:28:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:23.435579 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc9d402-d9e5-41c9-a7c0-3957f9323cec None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:23.507137 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9923514-74d2-46b5-9948-7706e2c4cdac None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:23.546625 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d0281f-10fa-46bb-a3a6-494f4bf467bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:23.547519 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0281f-10fa-46bb-a3a6-494f4bf467bd None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:23.547817 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0281f-10fa-46bb-a3a6-494f4bf467bd None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:23.548094 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0281f-10fa-46bb-a3a6-494f4bf467bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:23.550113 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc9d402-d9e5-41c9-a7c0-3957f9323cec None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:23.555154 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d0281f-10fa-46bb-a3a6-494f4bf467bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:23.556610 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d0281f-10fa-46bb-a3a6-494f4bf467bd None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:23.571462 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-65d0281f-10fa-46bb-a3a6-494f4bf467bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:28:23.571462 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:23.571462 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:23.571462 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:23.571462 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:23.571462 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:23.571462 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:23.571462 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:23.571462 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:23.571462 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:23.571462 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:23.571462 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:23.571462 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:28:23.571462 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:28:23.571462 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:28:23.572462 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:28:23.572462 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:23.572462 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:23.572462 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:23.572462 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:23.572462 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:23.572462 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:23.572462 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:23.572462 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:23.572462 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:23.572462 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:23.572462 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:23.572462 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:23.572462 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:23.572462 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:23.572462 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:23.572462 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:23.573533 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:28:23.573533 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:28:23.573533 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:28:23.573533 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:28:23.573533 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:28:23.573533 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:28:23.573533 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:28:23.573533 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:23.573533 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 324/645] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Jul 18 16:28:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:23.574036 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d0281f-10fa-46bb-a3a6-494f4bf467bd None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:23.576750 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:23.589302 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f05bd-8425-4c7f-9bef-c88bf1972d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:23.590109 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f05bd-8425-4c7f-9bef-c88bf1972d03 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:23.590386 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f05bd-8425-4c7f-9bef-c88bf1972d03 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:23.593197 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f05bd-8425-4c7f-9bef-c88bf1972d03 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:23.603184 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938f05bd-8425-4c7f-9bef-c88bf1972d03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:28:23.611208 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-938f05bd-8425-4c7f-9bef-c88bf1972d03 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:28:23.611208 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:23.611208 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:23.611208 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:23.611208 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:23.611208 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:23.611208 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:23.611208 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:23.611208 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:23.611208 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:23.611208 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:23.611208 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:23.611208 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:28:23.611208 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:28:23.611208 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:28:23.611208 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:28:23.617390 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:28:23.617390 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:28:23.617390 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:28:23.617390 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:28:23.617390 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:23.617390 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:23.617390 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:23.617390 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:23.617390 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:23.617390 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:23.617390 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:23.617390 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:23.617390 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:23.617390 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:23.617390 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:23.617390 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:23.618483 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:23.618483 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:23.618483 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:23.618483 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:23.618483 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:28:23.618483 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:28:23.618483 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:28:23.618483 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:28:23.618483 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:28:23.618483 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:28:23.618483 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:28:23.618483 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:23.618483 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 322/646] 10.222.0.81 () {56 vars in 1102 bytes} [Mon Jul 18 16:28:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:23.618483 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f05bd-8425-4c7f-9bef-c88bf1972d03 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:23.644636 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:23.694080 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d0281f-10fa-46bb-a3a6-494f4bf467bd None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:23.724172 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f05bd-8425-4c7f-9bef-c88bf1972d03 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:23.729539 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dda5c22-d2a2-4c67-a7be-17901bf002e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:23.730344 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda5c22-d2a2-4c67-a7be-17901bf002e2 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:23.730628 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda5c22-d2a2-4c67-a7be-17901bf002e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:23.730904 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda5c22-d2a2-4c67-a7be-17901bf002e2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:23.740157 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dda5c22-d2a2-4c67-a7be-17901bf002e2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:23.741611 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dda5c22-d2a2-4c67-a7be-17901bf002e2 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:23.756543 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-9dda5c22-d2a2-4c67-a7be-17901bf002e2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 18 16:28:23.756543 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:23.756543 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:23.756543 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:23.756543 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:23.756543 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:23.756543 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:23.756543 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:23.756543 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:23.756543 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:23.756543 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:23.756543 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:23.756543 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:28:23.756543 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:28:23.756543 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:28:23.756543 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:28:23.757765 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:23.757765 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:23.757765 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:28:23.757765 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:28:23.757765 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:28:23.757765 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:28:23.757765 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:23.757765 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:23.757765 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:23.757765 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:23.757765 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:23.757765 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:23.757765 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:23.757765 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:23.757765 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:23.757765 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:23.757765 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:23.757765 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:23.758747 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:23.758747 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:23.758747 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:28:23.758747 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:28:23.758747 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:28:23.758747 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:28:23.758747 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:28:23.758747 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:28:23.758747 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 18 16:28:23.758747 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:23.758747 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 325/647] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Jul 18 16:28:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:23.758747 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dda5c22-d2a2-4c67-a7be-17901bf002e2 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:23.767704 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25e45d-52f1-4523-b3ee-88ab8ae1b436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:23.768683 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25e45d-52f1-4523-b3ee-88ab8ae1b436 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:23.769143 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25e45d-52f1-4523-b3ee-88ab8ae1b436 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:23.769595 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25e45d-52f1-4523-b3ee-88ab8ae1b436 None admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:23.770497 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25e45d-52f1-4523-b3ee-88ab8ae1b436 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:23.770989 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25e45d-52f1-4523-b3ee-88ab8ae1b436 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:23.772594 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25e45d-52f1-4523-b3ee-88ab8ae1b436 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:23.794081 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 323/648] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:28:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:23.795438 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25e45d-52f1-4523-b3ee-88ab8ae1b436 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:23.849764 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:23.868666 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dda5c22-d2a2-4c67-a7be-17901bf002e2 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:23.883795 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:23.904710 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231289ed-159e-47a7-8935-8e5d52f8d086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:23.905381 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231289ed-159e-47a7-8935-8e5d52f8d086 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:23.905665 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231289ed-159e-47a7-8935-8e5d52f8d086 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:23.905943 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231289ed-159e-47a7-8935-8e5d52f8d086 None admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:23.906736 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231289ed-159e-47a7-8935-8e5d52f8d086 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:23.907046 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231289ed-159e-47a7-8935-8e5d52f8d086 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:23.908515 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231289ed-159e-47a7-8935-8e5d52f8d086 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:23.910126 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25e45d-52f1-4523-b3ee-88ab8ae1b436 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:23.927392 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 326/649] 10.222.0.81 () {56 vars in 1148 bytes} [Mon Jul 18 16:28:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:23.928283 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231289ed-159e-47a7-8935-8e5d52f8d086 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:23.947935 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae9aa1f-a14d-48c5-b2a3-f1dd12399e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:23.948540 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9aa1f-a14d-48c5-b2a3-f1dd12399e1e None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:23.948814 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9aa1f-a14d-48c5-b2a3-f1dd12399e1e None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:23.949236 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9aa1f-a14d-48c5-b2a3-f1dd12399e1e None admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:23.949943 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae9aa1f-a14d-48c5-b2a3-f1dd12399e1e None admin] RBAC: Adding query filter params (name=service) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:23.950257 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae9aa1f-a14d-48c5-b2a3-f1dd12399e1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:23.951607 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae9aa1f-a14d-48c5-b2a3-f1dd12399e1e None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:23.964372 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 324/650] 10.222.0.81 () {56 vars in 1103 bytes} [Mon Jul 18 16:28:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:23.964372 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae9aa1f-a14d-48c5-b2a3-f1dd12399e1e None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:24.046676 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231289ed-159e-47a7-8935-8e5d52f8d086 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:24.075936 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae9aa1f-a14d-48c5-b2a3-f1dd12399e1e None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:24.082880 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:24.087184 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e50f101-3d48-4e85-85e1-172b940eed8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:24.088078 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50f101-3d48-4e85-85e1-172b940eed8b None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:24.088505 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50f101-3d48-4e85-85e1-172b940eed8b None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:24.088947 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50f101-3d48-4e85-85e1-172b940eed8b None admin] PATH_INFO: `/v3/users` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:24.089930 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e50f101-3d48-4e85-85e1-172b940eed8b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:24.090349 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e50f101-3d48-4e85-85e1-172b940eed8b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:24.092284 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e50f101-3d48-4e85-85e1-172b940eed8b None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:24.112647 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84662dad-3d52-4723-8cbd-2cadbe424cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:24.117546 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 327/651] 10.222.0.81 () {56 vars in 1137 bytes} [Mon Jul 18 16:28:23 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:24.117689 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84662dad-3d52-4723-8cbd-2cadbe424cea None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:24.117689 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84662dad-3d52-4723-8cbd-2cadbe424cea None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:24.117689 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84662dad-3d52-4723-8cbd-2cadbe424cea None admin] PATH_INFO: `/v3/users/glance` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:24.117893 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e50f101-3d48-4e85-85e1-172b940eed8b None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:24.131923 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84662dad-3d52-4723-8cbd-2cadbe424cea None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:24.133563 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84662dad-3d52-4723-8cbd-2cadbe424cea None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:24.149320 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-84662dad-3d52-4723-8cbd-2cadbe424cea None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 18 16:28:24.149320 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:24.149320 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:24.149320 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:24.149320 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:24.149320 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:24.149320 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:24.149320 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:24.149320 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:24.149320 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:24.149320 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:24.149320 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:24.149320 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:28:24.149320 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:28:24.149320 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:28:24.149320 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:28:24.150576 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:24.150576 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:24.150576 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:28:24.150576 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:28:24.150576 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:28:24.150576 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:28:24.150576 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:24.150576 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:24.150576 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:24.150576 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:24.150576 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:24.150576 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:24.150576 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:24.150576 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:24.150576 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:24.150576 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:24.150576 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:24.150576 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:24.151679 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:24.151679 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:24.151679 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:28:24.151679 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:28:24.151679 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:28:24.151679 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:28:24.151679 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:28:24.151679 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:28:24.151679 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 18 16:28:24.151679 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:24.151679 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 325/652] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Jul 18 16:28:23 2022] GET /identity/v3/users/glance => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:24.151679 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84662dad-3d52-4723-8cbd-2cadbe424cea None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:24.160994 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:24.234379 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e50f101-3d48-4e85-85e1-172b940eed8b None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:24.268159 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84662dad-3d52-4723-8cbd-2cadbe424cea None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:24.268334 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3647e296-8c75-48f8-9b25-8d590aa7e1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:24.268827 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647e296-8c75-48f8-9b25-8d590aa7e1b7 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:24.269107 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647e296-8c75-48f8-9b25-8d590aa7e1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:24.269381 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647e296-8c75-48f8-9b25-8d590aa7e1b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:24.270195 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3647e296-8c75-48f8-9b25-8d590aa7e1b7 None admin] RBAC: Adding query filter params (role.id=a716f51ae5b44c918918ed808ad2b2b0, scope.project.id=9d1d84bf334d47e6bfba1141c1fc6f59, user.id=07f0c5bf1bee48a0bafdf7a9e4537c70) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:24.270514 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3647e296-8c75-48f8-9b25-8d590aa7e1b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:24.271939 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3647e296-8c75-48f8-9b25-8d590aa7e1b7 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:24.279393 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 328/653] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Jul 18 16:28:24 2022] GET /identity/v3/role_assignments?user.id=07f0c5bf1bee48a0bafdf7a9e4537c70&scope.project.id=9d1d84bf334d47e6bfba1141c1fc6f59&role.id=a716f51ae5b44c918918ed808ad2b2b0 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:24.279393 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3647e296-8c75-48f8-9b25-8d590aa7e1b7 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:24.312791 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d9af09-e93c-48d9-9451-e66e8e34ecbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:24.313611 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9af09-e93c-48d9-9451-e66e8e34ecbc None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:24.313907 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9af09-e93c-48d9-9451-e66e8e34ecbc None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:24.314169 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9af09-e93c-48d9-9451-e66e8e34ecbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:24.327561 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d9af09-e93c-48d9-9451-e66e8e34ecbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:24.329174 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d9af09-e93c-48d9-9451-e66e8e34ecbc None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:24.348887 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-36d9af09-e93c-48d9-9451-e66e8e34ecbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:24.348887 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:24.348887 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:24.348887 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:24.348887 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:24.348887 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:24.348887 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:24.348887 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:24.348887 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:24.348887 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:24.348887 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:24.348887 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:24.348887 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:28:24.348887 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:28:24.348887 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:28:24.349915 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:28:24.349915 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:24.349915 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:24.349915 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:24.349915 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:24.349915 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:24.349915 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:24.349915 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:24.349915 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:24.349915 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:24.349915 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:24.349915 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:24.349915 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:24.349915 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:24.349915 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:24.349915 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:24.349915 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:24.350856 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:28:24.350856 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:28:24.350856 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:24.350856 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:24.350856 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 326/654] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:28:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:24.351794 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d9af09-e93c-48d9-9451-e66e8e34ecbc None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:24.376735 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:24.430828 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:24.439346 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3647e296-8c75-48f8-9b25-8d590aa7e1b7 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:24.485047 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d9af09-e93c-48d9-9451-e66e8e34ecbc None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:24.488157 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e50a48-3632-4e08-92f4-befac1313c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:24.488905 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e50a48-3632-4e08-92f4-befac1313c7d None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:24.489260 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e50a48-3632-4e08-92f4-befac1313c7d None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:24.489640 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e50a48-3632-4e08-92f4-befac1313c7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:24.528092 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13858d64-faf6-410d-9cbb-7129bdd9fbe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:24.529072 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13858d64-faf6-410d-9cbb-7129bdd9fbe2 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:24.529577 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13858d64-faf6-410d-9cbb-7129bdd9fbe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:24.530060 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13858d64-faf6-410d-9cbb-7129bdd9fbe2 None admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:24.531059 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13858d64-faf6-410d-9cbb-7129bdd9fbe2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:24.531552 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13858d64-faf6-410d-9cbb-7129bdd9fbe2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:24.533442 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13858d64-faf6-410d-9cbb-7129bdd9fbe2 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:24.555450 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 327/655] 10.222.0.81 () {56 vars in 1137 bytes} [Mon Jul 18 16:28:24 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:24.559898 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13858d64-faf6-410d-9cbb-7129bdd9fbe2 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:24.584261 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e50a48-3632-4e08-92f4-befac1313c7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:24.585740 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e50a48-3632-4e08-92f4-befac1313c7d None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:24.656106 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:24.675481 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13858d64-faf6-410d-9cbb-7129bdd9fbe2 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:24.693926 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:24.701886 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 329/656] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Jul 18 16:28:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:28:24.703226 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e50a48-3632-4e08-92f4-befac1313c7d None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:24.712346 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c024efb-db8d-4330-823b-e792c38507ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:24.713011 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c024efb-db8d-4330-823b-e792c38507ae None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:24.713289 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c024efb-db8d-4330-823b-e792c38507ae None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:24.713560 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c024efb-db8d-4330-823b-e792c38507ae None admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:24.714274 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c024efb-db8d-4330-823b-e792c38507ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:24.714575 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c024efb-db8d-4330-823b-e792c38507ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:24.716490 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c024efb-db8d-4330-823b-e792c38507ae None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:24.728851 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 328/657] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:28:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:24.729806 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c024efb-db8d-4330-823b-e792c38507ae None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:24.812232 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e50a48-3632-4e08-92f4-befac1313c7d None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:24.839667 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c024efb-db8d-4330-823b-e792c38507ae None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:24.849507 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f690652-b314-4800-b5ec-17d26b0cac10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:24.850542 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f690652-b314-4800-b5ec-17d26b0cac10 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:24.851047 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f690652-b314-4800-b5ec-17d26b0cac10 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:24.851540 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f690652-b314-4800-b5ec-17d26b0cac10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:24.876915 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95db1f32-d977-4787-a673-9d92cdeee052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:24.877855 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db1f32-d977-4787-a673-9d92cdeee052 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:24.878138 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db1f32-d977-4787-a673-9d92cdeee052 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:24.878409 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db1f32-d977-4787-a673-9d92cdeee052 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:24.891387 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95db1f32-d977-4787-a673-9d92cdeee052 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:24.892927 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95db1f32-d977-4787-a673-9d92cdeee052 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:24.893716 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:24.919240 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:24.920337 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-95db1f32-d977-4787-a673-9d92cdeee052 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:24.920337 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:24.920337 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:24.920337 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:24.920337 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:24.920337 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:24.920337 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:24.920337 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:24.920337 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:24.920337 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:24.920337 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:24.920337 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:24.920337 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:28:24.920337 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:28:24.920337 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:28:24.921257 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:28:24.921257 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:24.921257 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:24.921257 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:24.921257 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:24.921257 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:24.921257 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:24.921257 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:24.921257 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:24.921257 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:24.921257 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:24.921257 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:24.921257 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:24.921257 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:24.921257 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:24.921257 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:24.921257 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:24.922221 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:28:24.922221 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:28:24.922221 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:24.922221 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:24.924093 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 329/658] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:28:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:24.925118 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95db1f32-d977-4787-a673-9d92cdeee052 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:24.933055 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f690652-b314-4800-b5ec-17d26b0cac10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:24.935405 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f690652-b314-4800-b5ec-17d26b0cac10 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:25.048903 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 330/659] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Jul 18 16:28:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:28:25.048903 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f690652-b314-4800-b5ec-17d26b0cac10 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:25.054685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95db1f32-d977-4787-a673-9d92cdeee052 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:25.089749 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a41be7d-93fc-42f4-a43e-7a9851a1216b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:25.091117 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a41be7d-93fc-42f4-a43e-7a9851a1216b None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:25.091399 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a41be7d-93fc-42f4-a43e-7a9851a1216b None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:25.091663 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a41be7d-93fc-42f4-a43e-7a9851a1216b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:25.099955 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a41be7d-93fc-42f4-a43e-7a9851a1216b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:25.101390 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a41be7d-93fc-42f4-a43e-7a9851a1216b None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:25.115599 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-7a41be7d-93fc-42f4-a43e-7a9851a1216b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 18 16:28:25.115599 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:25.115599 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:25.115599 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:25.115599 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:25.115599 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:25.115599 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:25.115599 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:25.115599 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:25.115599 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:25.115599 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:25.115599 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:25.115599 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:28:25.115599 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:28:25.115599 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:28:25.115599 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:28:25.116782 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:25.116782 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:25.116782 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:28:25.116782 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:28:25.116782 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:28:25.116782 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:28:25.116782 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:25.116782 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:25.116782 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:25.116782 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:25.116782 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:25.116782 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:25.116782 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:25.116782 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:25.116782 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:25.116782 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:25.116782 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:25.116782 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:25.117759 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:25.117759 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:25.117759 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:28:25.117759 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:28:25.117759 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:28:25.117759 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:28:25.117759 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:28:25.117759 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:28:25.117759 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 18 16:28:25.117759 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:25.117759 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 330/660] 10.222.0.81 () {56 vars in 1102 bytes} [Mon Jul 18 16:28:24 2022] GET /identity/v3/users/neutron => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:25.118395 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d96b1b-4402-4dbb-884c-c8ca2bfddb11 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:25.118526 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d96b1b-4402-4dbb-884c-c8ca2bfddb11 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:25.118809 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d96b1b-4402-4dbb-884c-c8ca2bfddb11 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:25.120432 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 331/661] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:28:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:25.125128 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d96b1b-4402-4dbb-884c-c8ca2bfddb11 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:25.158356 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:25.165668 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f690652-b314-4800-b5ec-17d26b0cac10 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:25.180489 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:25.200799 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c554ef42-411e-41f7-89c3-dd27192460d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:25.201463 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554ef42-411e-41f7-89c3-dd27192460d4 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:25.201743 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554ef42-411e-41f7-89c3-dd27192460d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:25.202014 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554ef42-411e-41f7-89c3-dd27192460d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:25.202738 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c554ef42-411e-41f7-89c3-dd27192460d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:25.203040 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c554ef42-411e-41f7-89c3-dd27192460d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:25.204428 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c554ef42-411e-41f7-89c3-dd27192460d4 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:25.216399 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 331/662] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:28:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:25.217220 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c554ef42-411e-41f7-89c3-dd27192460d4 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:25.241494 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d96b1b-4402-4dbb-884c-c8ca2bfddb11 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:25.278196 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a12dc3-c25a-456b-82be-14021cddd0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:25.279038 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a12dc3-c25a-456b-82be-14021cddd0da None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:25.279320 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a12dc3-c25a-456b-82be-14021cddd0da None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:25.279572 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a12dc3-c25a-456b-82be-14021cddd0da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:25.291196 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a12dc3-c25a-456b-82be-14021cddd0da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:25.292739 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a12dc3-c25a-456b-82be-14021cddd0da None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:25.311133 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-42a12dc3-c25a-456b-82be-14021cddd0da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:25.311133 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:25.311133 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:25.311133 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:25.311133 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:25.311133 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:25.311133 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:25.311133 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:25.311133 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:25.311133 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:25.311133 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:25.311133 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:25.311133 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:28:25.311133 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:28:25.311133 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:28:25.312101 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:28:25.312101 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:25.312101 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:25.312101 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:25.312101 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:25.312101 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:25.312101 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:25.312101 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:25.312101 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:25.312101 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:25.312101 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:25.312101 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:25.312101 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:25.312101 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:25.312101 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:25.312101 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:25.312101 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:25.313159 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:28:25.313159 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:28:25.313159 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:25.313159 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:25.313159 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 332/663] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:28:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:25.314032 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e7ff2-9878-466a-9636-4f14a9481dfa None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:25.314340 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e7ff2-9878-466a-9636-4f14a9481dfa None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:25.314595 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e7ff2-9878-466a-9636-4f14a9481dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:25.331162 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c554ef42-411e-41f7-89c3-dd27192460d4 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:25.332428 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-407e7ff2-9878-466a-9636-4f14a9481dfa None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:25.334223 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-407e7ff2-9878-466a-9636-4f14a9481dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:25.368783 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181da2e0-fae1-41ed-8a0c-9d444a806be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:25.369456 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181da2e0-fae1-41ed-8a0c-9d444a806be3 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:25.369883 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181da2e0-fae1-41ed-8a0c-9d444a806be3 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:25.370178 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181da2e0-fae1-41ed-8a0c-9d444a806be3 None admin] PATH_INFO: `/v3/users` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:25.372374 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181da2e0-fae1-41ed-8a0c-9d444a806be3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:25.372695 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181da2e0-fae1-41ed-8a0c-9d444a806be3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:25.374150 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181da2e0-fae1-41ed-8a0c-9d444a806be3 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:25.395378 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 332/664] 10.222.0.81 () {56 vars in 1139 bytes} [Mon Jul 18 16:28:25 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:25.396518 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181da2e0-fae1-41ed-8a0c-9d444a806be3 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:25.410071 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 333/665] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:28:25.411162 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e7ff2-9878-466a-9636-4f14a9481dfa None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:25.417251 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:25.451202 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:25.510318 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181da2e0-fae1-41ed-8a0c-9d444a806be3 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:25.532733 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e7ff2-9878-466a-9636-4f14a9481dfa None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:25.553522 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f8b402-4756-40c3-b9be-5217e773a140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:25.554352 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8b402-4756-40c3-b9be-5217e773a140 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:25.554673 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8b402-4756-40c3-b9be-5217e773a140 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:25.554906 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8b402-4756-40c3-b9be-5217e773a140 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:25.563437 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f8b402-4756-40c3-b9be-5217e773a140 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:25.564847 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f8b402-4756-40c3-b9be-5217e773a140 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:25.572337 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7bcca5-4591-4f09-aedb-379f22bf3769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:25.573007 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7bcca5-4591-4f09-aedb-379f22bf3769 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:25.573289 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7bcca5-4591-4f09-aedb-379f22bf3769 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:25.573565 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7bcca5-4591-4f09-aedb-379f22bf3769 None admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:25.574320 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7bcca5-4591-4f09-aedb-379f22bf3769 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:25.574597 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7bcca5-4591-4f09-aedb-379f22bf3769 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:25.576013 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7bcca5-4591-4f09-aedb-379f22bf3769 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:25.579040 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-33f8b402-4756-40c3-b9be-5217e773a140 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:28:25.579040 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:25.579040 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:25.579040 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:25.579040 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:25.579040 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:25.579040 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:25.579040 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:25.579040 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:25.579040 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:25.579040 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:25.579040 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:25.579040 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:28:25.579040 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:28:25.579040 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:28:25.580002 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:28:25.580002 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:25.580002 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:25.580002 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:25.580002 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:25.580002 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:25.580002 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:25.580002 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:25.580002 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:25.580002 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:25.580002 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:25.580002 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:25.580002 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:25.580002 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:25.580002 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:25.580002 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:25.580002 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:25.580974 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:28:25.580974 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:28:25.580974 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:28:25.580974 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:28:25.580974 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:28:25.580974 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:28:25.580974 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:28:25.580974 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:25.580974 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 333/666] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Jul 18 16:28:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:25.581481 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f8b402-4756-40c3-b9be-5217e773a140 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:25.593485 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 334/667] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:28:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:25.594327 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7bcca5-4591-4f09-aedb-379f22bf3769 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:25.671961 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:25.692631 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:25.702079 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7bcca5-4591-4f09-aedb-379f22bf3769 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:25.702234 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f8b402-4756-40c3-b9be-5217e773a140 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:25.738637 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd052bae-b79c-45b9-aa82-32c70ddf80a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:25.739410 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd052bae-b79c-45b9-aa82-32c70ddf80a7 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:25.739699 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd052bae-b79c-45b9-aa82-32c70ddf80a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:25.740024 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd052bae-b79c-45b9-aa82-32c70ddf80a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:25.740409 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee7f1e-0d40-43b7-8b77-29c3f0241b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:25.741298 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee7f1e-0d40-43b7-8b77-29c3f0241b81 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:25.741584 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee7f1e-0d40-43b7-8b77-29c3f0241b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:25.741859 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee7f1e-0d40-43b7-8b77-29c3f0241b81 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:25.754615 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cee7f1e-0d40-43b7-8b77-29c3f0241b81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:28:25.763066 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-8cee7f1e-0d40-43b7-8b77-29c3f0241b81 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:28:25.763066 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:25.763066 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:25.763066 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:25.763066 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:25.763066 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:25.763066 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:25.763066 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:25.763066 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:25.763066 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:25.763066 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:25.763066 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:25.763066 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:28:25.763066 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:28:25.763066 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:28:25.763066 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:28:25.764126 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:28:25.764126 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:28:25.764126 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:28:25.764126 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:28:25.764126 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:25.764126 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:25.764126 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:25.764126 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:25.764126 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:25.764126 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:25.764126 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:25.764126 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:25.764126 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:25.764126 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:25.764126 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:25.764126 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:25.765039 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:25.765039 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:25.765039 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:25.765039 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:25.765039 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:28:25.765039 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:28:25.765039 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:28:25.765039 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:28:25.765039 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:28:25.765039 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:28:25.765039 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:28:25.765039 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:25.765039 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 335/668] 10.222.0.81 () {56 vars in 1102 bytes} [Mon Jul 18 16:28:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:25.765755 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee7f1e-0d40-43b7-8b77-29c3f0241b81 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:25.816896 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd052bae-b79c-45b9-aa82-32c70ddf80a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:25.818366 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd052bae-b79c-45b9-aa82-32c70ddf80a7 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:25.903818 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:25.910488 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee7f1e-0d40-43b7-8b77-29c3f0241b81 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:25.935573 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 334/669] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Jul 18 16:28:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:28:25.935573 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd052bae-b79c-45b9-aa82-32c70ddf80a7 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:25.952822 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac4363-6221-4549-bb4d-b8096bdfdbd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:25.953486 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac4363-6221-4549-bb4d-b8096bdfdbd5 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:25.953770 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac4363-6221-4549-bb4d-b8096bdfdbd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:25.954044 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac4363-6221-4549-bb4d-b8096bdfdbd5 None admin] PATH_INFO: `/v3/projects` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:25.954833 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ac4363-6221-4549-bb4d-b8096bdfdbd5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:25.955236 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ac4363-6221-4549-bb4d-b8096bdfdbd5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:25.956690 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ac4363-6221-4549-bb4d-b8096bdfdbd5 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:25.971233 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 336/670] 10.222.0.81 () {56 vars in 1148 bytes} [Mon Jul 18 16:28:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:25.972235 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac4363-6221-4549-bb4d-b8096bdfdbd5 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:25.985638 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:26.052080 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd052bae-b79c-45b9-aa82-32c70ddf80a7 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:26.077257 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac4363-6221-4549-bb4d-b8096bdfdbd5 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:26.097040 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439bd7d8-4ac5-41fb-b45c-00e5e38ee96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:26.097840 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bd7d8-4ac5-41fb-b45c-00e5e38ee96c None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:26.098121 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bd7d8-4ac5-41fb-b45c-00e5e38ee96c None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:26.098396 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bd7d8-4ac5-41fb-b45c-00e5e38ee96c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:26.106255 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439bd7d8-4ac5-41fb-b45c-00e5e38ee96c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:26.107695 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439bd7d8-4ac5-41fb-b45c-00e5e38ee96c None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:26.112886 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b858e7-6f93-4936-9442-2c6785fb7a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:26.113670 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b858e7-6f93-4936-9442-2c6785fb7a92 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:26.113842 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b858e7-6f93-4936-9442-2c6785fb7a92 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:26.114122 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b858e7-6f93-4936-9442-2c6785fb7a92 None admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:26.114858 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b858e7-6f93-4936-9442-2c6785fb7a92 None admin] RBAC: Adding query filter params (name=service) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:26.115156 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b858e7-6f93-4936-9442-2c6785fb7a92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:26.116533 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b858e7-6f93-4936-9442-2c6785fb7a92 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:26.122637 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-439bd7d8-4ac5-41fb-b45c-00e5e38ee96c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:28:26.122637 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:26.122637 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:26.122637 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:26.122637 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:26.122637 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:26.122637 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:26.122637 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:26.122637 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:26.122637 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:26.122637 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:26.122637 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:26.122637 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:28:26.122637 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:28:26.122637 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:28:26.123781 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:28:26.123781 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:26.123781 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:26.123781 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:26.123781 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:26.123781 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:26.123781 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:26.123781 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:26.123781 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:26.123781 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:26.123781 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:26.123781 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:26.123781 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:26.123781 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:26.123781 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:26.123781 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:26.123781 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:26.124703 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:28:26.124703 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:28:26.124703 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:28:26.124703 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:28:26.124703 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:28:26.124703 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:28:26.124703 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:28:26.124703 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:26.124703 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 335/671] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Jul 18 16:28:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:26.125317 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439bd7d8-4ac5-41fb-b45c-00e5e38ee96c None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:26.131155 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 337/672] 10.222.0.81 () {56 vars in 1103 bytes} [Mon Jul 18 16:28:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:26.132664 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b858e7-6f93-4936-9442-2c6785fb7a92 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:26.164628 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:26.209792 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:26.237689 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439bd7d8-4ac5-41fb-b45c-00e5e38ee96c None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:26.244804 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b858e7-6f93-4936-9442-2c6785fb7a92 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:26.278071 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331bb524-0f85-4096-b58a-5156350627a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:26.279295 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331bb524-0f85-4096-b58a-5156350627a9 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:26.279746 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331bb524-0f85-4096-b58a-5156350627a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:26.280173 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331bb524-0f85-4096-b58a-5156350627a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:26.284959 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfcf2fa-d816-4316-ab5c-836441767a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:26.285650 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfcf2fa-d816-4316-ab5c-836441767a27 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:26.285932 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfcf2fa-d816-4316-ab5c-836441767a27 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:26.286206 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfcf2fa-d816-4316-ab5c-836441767a27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:26.287032 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfcf2fa-d816-4316-ab5c-836441767a27 None admin] RBAC: Adding query filter params (role.id=a716f51ae5b44c918918ed808ad2b2b0, scope.project.id=9d1d84bf334d47e6bfba1141c1fc6f59, user.id=baaee55accfa458a9832127c5ab77656) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:26.287584 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfcf2fa-d816-4316-ab5c-836441767a27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:26.288785 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfcf2fa-d816-4316-ab5c-836441767a27 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:26.291441 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331bb524-0f85-4096-b58a-5156350627a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:26.293427 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331bb524-0f85-4096-b58a-5156350627a9 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:26.304121 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 338/673] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Jul 18 16:28:26 2022] GET /identity/v3/role_assignments?user.id=baaee55accfa458a9832127c5ab77656&scope.project.id=9d1d84bf334d47e6bfba1141c1fc6f59&role.id=a716f51ae5b44c918918ed808ad2b2b0 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:26.304121 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfcf2fa-d816-4316-ab5c-836441767a27 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:26.324505 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-331bb524-0f85-4096-b58a-5156350627a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:26.324505 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:26.324505 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:26.324505 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:26.324505 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:26.324505 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:26.324505 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:26.324505 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:26.324505 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:26.324505 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:26.324505 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:26.324505 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:26.324505 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:28:26.324505 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:28:26.324505 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:28:26.325960 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:28:26.325960 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:26.325960 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:26.325960 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:26.325960 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:26.325960 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:26.325960 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:26.325960 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:26.325960 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:26.325960 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:26.325960 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:26.325960 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:26.325960 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:26.325960 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:26.325960 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:26.325960 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:26.325960 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:26.326904 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:28:26.326904 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:28:26.326904 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:26.326904 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:26.330636 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 336/674] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:28:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:26.331535 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331bb524-0f85-4096-b58a-5156350627a9 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:26.425216 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfcf2fa-d816-4316-ab5c-836441767a27 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:26.455198 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:26.474265 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331bb524-0f85-4096-b58a-5156350627a9 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:26.478998 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6040f993-d7ad-4f45-9c66-f1eda528c866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:26.479680 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040f993-d7ad-4f45-9c66-f1eda528c866 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:26.479993 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040f993-d7ad-4f45-9c66-f1eda528c866 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:26.480263 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040f993-d7ad-4f45-9c66-f1eda528c866 None admin] PATH_INFO: `/v3/projects` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:26.481117 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6040f993-d7ad-4f45-9c66-f1eda528c866 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:26.481421 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6040f993-d7ad-4f45-9c66-f1eda528c866 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:26.482873 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6040f993-d7ad-4f45-9c66-f1eda528c866 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:26.486779 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:26.496746 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 339/675] 10.222.0.81 () {56 vars in 1148 bytes} [Mon Jul 18 16:28:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:26.497616 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6040f993-d7ad-4f45-9c66-f1eda528c866 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:26.522119 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450fd4b2-0236-49dd-ae90-23106cbaa98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:26.522914 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450fd4b2-0236-49dd-ae90-23106cbaa98c None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:26.523197 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450fd4b2-0236-49dd-ae90-23106cbaa98c None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:26.523467 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450fd4b2-0236-49dd-ae90-23106cbaa98c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:26.536241 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450fd4b2-0236-49dd-ae90-23106cbaa98c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:26.537699 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450fd4b2-0236-49dd-ae90-23106cbaa98c None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:26.557940 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-450fd4b2-0236-49dd-ae90-23106cbaa98c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:26.557940 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:26.557940 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:26.557940 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:26.557940 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:26.557940 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:26.557940 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:26.557940 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:26.557940 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:26.557940 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:26.557940 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:26.557940 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:26.557940 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:28:26.557940 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:28:26.557940 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:28:26.559250 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:28:26.559250 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:26.559250 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:26.559250 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:26.559250 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:26.559250 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:26.559250 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:26.559250 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:26.559250 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:26.559250 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:26.559250 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:26.559250 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:26.559250 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:26.559250 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:26.559250 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:26.559250 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:26.559250 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:26.560514 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:28:26.560514 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:28:26.560514 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:26.560514 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:26.560514 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 337/676] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:28:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:26.560514 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de052089-f35b-49de-abfb-b701ec48d928 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:26.561011 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de052089-f35b-49de-abfb-b701ec48d928 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:26.561011 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de052089-f35b-49de-abfb-b701ec48d928 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:26.563898 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 338/677] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:28:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:26.565014 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de052089-f35b-49de-abfb-b701ec48d928 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:26.615256 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6040f993-d7ad-4f45-9c66-f1eda528c866 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:26.654974 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf92b0-163b-4f8d-9fb8-6f858bc89b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:26.656040 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf92b0-163b-4f8d-9fb8-6f858bc89b2d None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:26.656330 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf92b0-163b-4f8d-9fb8-6f858bc89b2d None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:26.656710 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf92b0-163b-4f8d-9fb8-6f858bc89b2d None admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:26.657749 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bf92b0-163b-4f8d-9fb8-6f858bc89b2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:26.658066 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bf92b0-163b-4f8d-9fb8-6f858bc89b2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:26.659883 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bf92b0-163b-4f8d-9fb8-6f858bc89b2d None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:26.672394 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 340/678] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:28:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:26.673054 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf92b0-163b-4f8d-9fb8-6f858bc89b2d None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:26.689058 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de052089-f35b-49de-abfb-b701ec48d928 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:26.727321 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6407d372-d16c-4413-9964-19087a36be42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:26.728030 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407d372-d16c-4413-9964-19087a36be42 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:26.728279 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407d372-d16c-4413-9964-19087a36be42 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:26.728555 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407d372-d16c-4413-9964-19087a36be42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:26.729390 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6407d372-d16c-4413-9964-19087a36be42 None admin] RBAC: Adding query filter params (role.id=a716f51ae5b44c918918ed808ad2b2b0, scope.project.id=9d1d84bf334d47e6bfba1141c1fc6f59, user.id=e638fbc5f1f3447c8e189c228bbae530) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:26.729704 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6407d372-d16c-4413-9964-19087a36be42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:26.731656 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6407d372-d16c-4413-9964-19087a36be42 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:26.740721 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 339/679] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Jul 18 16:28:26 2022] GET /identity/v3/role_assignments?user.id=e638fbc5f1f3447c8e189c228bbae530&scope.project.id=9d1d84bf334d47e6bfba1141c1fc6f59&role.id=a716f51ae5b44c918918ed808ad2b2b0 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:26.740721 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e526cdca-0887-4c1c-a15a-facce626cf35 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:26.740721 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e526cdca-0887-4c1c-a15a-facce626cf35 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:26.740721 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e526cdca-0887-4c1c-a15a-facce626cf35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:26.741997 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:26.764107 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:26.767201 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-e526cdca-0887-4c1c-a15a-facce626cf35 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:26.768616 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-e526cdca-0887-4c1c-a15a-facce626cf35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:26.813205 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf92b0-163b-4f8d-9fb8-6f858bc89b2d None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:26.853368 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4390b69-4113-4b83-964d-d385610bda95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:26.854053 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4390b69-4113-4b83-964d-d385610bda95 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:26.854337 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4390b69-4113-4b83-964d-d385610bda95 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:26.854611 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4390b69-4113-4b83-964d-d385610bda95 None admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:26.855356 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4390b69-4113-4b83-964d-d385610bda95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:26.855667 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4390b69-4113-4b83-964d-d385610bda95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:26.857371 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4390b69-4113-4b83-964d-d385610bda95 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:26.864226 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 340/680] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:28:26.865707 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e526cdca-0887-4c1c-a15a-facce626cf35 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:26.871467 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 341/681] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:28:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:26.881211 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4390b69-4113-4b83-964d-d385610bda95 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:27.009078 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e526cdca-0887-4c1c-a15a-facce626cf35 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:27.014314 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4390b69-4113-4b83-964d-d385610bda95 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:27.034412 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:27.046848 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:27.053335 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf97d2-7ea0-4c98-a748-dbdc2bb4d512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:27.054129 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf97d2-7ea0-4c98-a748-dbdc2bb4d512 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:27.054402 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf97d2-7ea0-4c98-a748-dbdc2bb4d512 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:27.054674 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf97d2-7ea0-4c98-a748-dbdc2bb4d512 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:27.058320 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7065c952-5c29-4205-b823-cfaa719de8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:27.059634 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7065c952-5c29-4205-b823-cfaa719de8ed None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:27.059947 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7065c952-5c29-4205-b823-cfaa719de8ed None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:27.060216 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7065c952-5c29-4205-b823-cfaa719de8ed None admin] PATH_INFO: `/v3/users/swift` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:27.062224 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bf97d2-7ea0-4c98-a748-dbdc2bb4d512 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:27.063680 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bf97d2-7ea0-4c98-a748-dbdc2bb4d512 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:27.068689 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7065c952-5c29-4205-b823-cfaa719de8ed None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:27.070425 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7065c952-5c29-4205-b823-cfaa719de8ed None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:27.081602 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-96bf97d2-7ea0-4c98-a748-dbdc2bb4d512 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:28:27.081602 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:27.081602 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:27.081602 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:27.081602 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:27.081602 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:27.081602 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:27.081602 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:27.081602 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:27.081602 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:27.081602 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:27.081602 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:27.081602 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:28:27.081602 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:28:27.081602 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:28:27.082572 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:28:27.082572 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:27.082572 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:27.082572 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:27.082572 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:27.082572 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:27.082572 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:27.082572 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:27.082572 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:27.082572 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:27.082572 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:27.082572 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:27.082572 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:27.082572 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:27.082572 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:27.082572 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:27.082572 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:27.083490 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:28:27.083490 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:28:27.083490 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:28:27.083490 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:28:27.083490 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:28:27.083490 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:28:27.083490 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:28:27.083490 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:27.084454 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 341/682] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Jul 18 16:28:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:27.087863 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf97d2-7ea0-4c98-a748-dbdc2bb4d512 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:27.088167 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-7065c952-5c29-4205-b823-cfaa719de8ed None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 18 16:28:27.088167 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:27.088167 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:27.088167 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:27.088167 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:27.088167 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:27.088167 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:27.088167 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:27.088167 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:27.088167 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:27.088167 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:27.088167 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:27.088167 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:28:27.088167 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:28:27.088167 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:28:27.088167 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:28:27.089142 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:27.089142 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:27.089142 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:28:27.089142 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:28:27.089142 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:28:27.089142 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:28:27.089142 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:27.089142 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:27.089142 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:27.089142 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:27.089142 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:27.089142 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:27.089142 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:27.089142 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:27.089142 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:27.089142 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:27.089142 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:27.089142 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:27.090118 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:27.090118 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:27.090118 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:28:27.090118 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:28:27.090118 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:28:27.090118 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:28:27.090118 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:28:27.090118 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:28:27.090118 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 18 16:28:27.090118 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:27.090118 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 342/683] 10.222.0.81 () {56 vars in 1096 bytes} [Mon Jul 18 16:28:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:27.097425 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7065c952-5c29-4205-b823-cfaa719de8ed None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:27.207310 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf97d2-7ea0-4c98-a748-dbdc2bb4d512 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:27.228157 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7065c952-5c29-4205-b823-cfaa719de8ed None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:27.250684 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e796fee4-04a1-4526-a87f-22783ad53e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:27.251488 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e796fee4-04a1-4526-a87f-22783ad53e48 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:27.252176 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e796fee4-04a1-4526-a87f-22783ad53e48 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:27.252472 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e796fee4-04a1-4526-a87f-22783ad53e48 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:27.268251 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e796fee4-04a1-4526-a87f-22783ad53e48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:28:27.270619 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515501f9-91eb-41af-8572-f52b422d9c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:27.271533 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515501f9-91eb-41af-8572-f52b422d9c27 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:27.272054 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515501f9-91eb-41af-8572-f52b422d9c27 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:27.272540 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515501f9-91eb-41af-8572-f52b422d9c27 None admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:27.273618 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515501f9-91eb-41af-8572-f52b422d9c27 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:27.274183 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515501f9-91eb-41af-8572-f52b422d9c27 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:27.275821 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515501f9-91eb-41af-8572-f52b422d9c27 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:27.276281 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-e796fee4-04a1-4526-a87f-22783ad53e48 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:28:27.276281 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:27.276281 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:27.276281 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:27.276281 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:27.276281 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:27.276281 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:27.276281 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:27.276281 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:27.276281 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:27.276281 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:27.276281 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:27.276281 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:28:27.276281 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:28:27.276281 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:28:27.276281 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:28:27.277194 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:28:27.277194 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:28:27.277194 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:28:27.277194 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:28:27.277194 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:27.277194 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:27.277194 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:27.277194 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:27.277194 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:27.277194 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:27.277194 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:27.277194 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:27.277194 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:27.277194 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:27.277194 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:27.277194 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:27.278110 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:27.278110 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:27.278110 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:27.278110 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:27.278110 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:28:27.278110 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:28:27.278110 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:28:27.278110 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:28:27.278110 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:28:27.278110 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:28:27.278110 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:28:27.278110 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:27.278110 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 342/684] 10.222.0.81 () {56 vars in 1096 bytes} [Mon Jul 18 16:28:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:27.278840 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e796fee4-04a1-4526-a87f-22783ad53e48 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:27.302599 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 343/685] 10.222.0.81 () {56 vars in 1135 bytes} [Mon Jul 18 16:28:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:27.303940 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515501f9-91eb-41af-8572-f52b422d9c27 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:27.341159 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:27.361095 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:27.418016 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e796fee4-04a1-4526-a87f-22783ad53e48 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:27.422441 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515501f9-91eb-41af-8572-f52b422d9c27 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:27.471831 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647260e4-2b94-444a-85e0-0dca610fca04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:27.471831 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647260e4-2b94-444a-85e0-0dca610fca04 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:27.471831 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647260e4-2b94-444a-85e0-0dca610fca04 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:27.471831 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647260e4-2b94-444a-85e0-0dca610fca04 None admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:27.472725 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647260e4-2b94-444a-85e0-0dca610fca04 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:27.472725 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647260e4-2b94-444a-85e0-0dca610fca04 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:27.472725 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647260e4-2b94-444a-85e0-0dca610fca04 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:27.478479 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b651a45-0f40-42db-8103-f901862c8342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:27.479160 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b651a45-0f40-42db-8103-f901862c8342 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:27.479445 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b651a45-0f40-42db-8103-f901862c8342 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:27.480273 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b651a45-0f40-42db-8103-f901862c8342 None admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:27.481062 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b651a45-0f40-42db-8103-f901862c8342 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:27.481373 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b651a45-0f40-42db-8103-f901862c8342 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:27.483196 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b651a45-0f40-42db-8103-f901862c8342 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:27.487192 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 343/686] 10.222.0.81 () {56 vars in 1148 bytes} [Mon Jul 18 16:28:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:27.488329 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647260e4-2b94-444a-85e0-0dca610fca04 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:27.497325 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 344/687] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Jul 18 16:28:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:27.497325 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b651a45-0f40-42db-8103-f901862c8342 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:27.606034 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:27.608217 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647260e4-2b94-444a-85e0-0dca610fca04 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:27.613244 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b651a45-0f40-42db-8103-f901862c8342 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:27.622904 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:27.644457 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b88b5a-543d-42e1-ac72-abfd9bc3437f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:27.645111 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b88b5a-543d-42e1-ac72-abfd9bc3437f None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:27.645440 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b88b5a-543d-42e1-ac72-abfd9bc3437f None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:27.645717 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b88b5a-543d-42e1-ac72-abfd9bc3437f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:27.652194 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37decfb-09d4-4a32-8d23-374aa1b4320b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:27.655412 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37decfb-09d4-4a32-8d23-374aa1b4320b None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:27.655412 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37decfb-09d4-4a32-8d23-374aa1b4320b None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:27.655412 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37decfb-09d4-4a32-8d23-374aa1b4320b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:27.655412 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37decfb-09d4-4a32-8d23-374aa1b4320b None admin] RBAC: Adding query filter params (role.id=a716f51ae5b44c918918ed808ad2b2b0, scope.project.id=9d1d84bf334d47e6bfba1141c1fc6f59, user.id=b742c540de6545249fe3245047d00c81) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:27.655412 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37decfb-09d4-4a32-8d23-374aa1b4320b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:27.657077 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37decfb-09d4-4a32-8d23-374aa1b4320b None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:27.663697 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 345/688] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Jul 18 16:28:27 2022] GET /identity/v3/role_assignments?user.id=b742c540de6545249fe3245047d00c81&scope.project.id=9d1d84bf334d47e6bfba1141c1fc6f59&role.id=a716f51ae5b44c918918ed808ad2b2b0 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:27.664704 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37decfb-09d4-4a32-8d23-374aa1b4320b None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:27.720206 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b88b5a-543d-42e1-ac72-abfd9bc3437f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:27.721674 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b88b5a-543d-42e1-ac72-abfd9bc3437f None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:27.786968 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37decfb-09d4-4a32-8d23-374aa1b4320b None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:27.824249 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ab8a7d-d854-4f10-b2a9-07a1bc3a12a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:27.825104 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab8a7d-d854-4f10-b2a9-07a1bc3a12a0 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:27.825393 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab8a7d-d854-4f10-b2a9-07a1bc3a12a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:27.825674 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab8a7d-d854-4f10-b2a9-07a1bc3a12a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:27.836556 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ab8a7d-d854-4f10-b2a9-07a1bc3a12a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:27.838090 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ab8a7d-d854-4f10-b2a9-07a1bc3a12a0 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:27.842378 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 344/689] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Jul 18 16:28:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:28:27.847567 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b88b5a-543d-42e1-ac72-abfd9bc3437f None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:27.859319 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-e2ab8a7d-d854-4f10-b2a9-07a1bc3a12a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:27.859319 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:27.859319 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:27.859319 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:27.859319 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:27.859319 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:27.859319 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:27.859319 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:27.859319 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:27.859319 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:27.859319 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:27.859319 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:27.859319 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:28:27.859319 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:28:27.859319 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:28:27.860350 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:28:27.860350 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:27.860350 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:27.860350 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:27.860350 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:27.860350 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:27.860350 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:27.860350 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:27.860350 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:27.860350 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:27.860350 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:27.860350 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:27.860350 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:27.860350 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:27.860350 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:27.860350 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:27.860350 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:27.861257 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:28:27.861257 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:28:27.861257 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:27.861257 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:27.863671 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 346/690] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:28:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:27.873090 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ab8a7d-d854-4f10-b2a9-07a1bc3a12a0 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:27.881070 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:27.911916 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:27.994115 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b88b5a-543d-42e1-ac72-abfd9bc3437f None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:28.002419 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ab8a7d-d854-4f10-b2a9-07a1bc3a12a0 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:28.033549 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e71fc8e-d533-46b9-b151-116a33fc87c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:28.034698 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71fc8e-d533-46b9-b151-116a33fc87c1 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:28.035188 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71fc8e-d533-46b9-b151-116a33fc87c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:28.035686 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71fc8e-d533-46b9-b151-116a33fc87c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:28.045011 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72784ec5-8fb5-47e7-90f4-ffe7b383b328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:28.045665 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72784ec5-8fb5-47e7-90f4-ffe7b383b328 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:28.045990 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72784ec5-8fb5-47e7-90f4-ffe7b383b328 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:28.046266 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72784ec5-8fb5-47e7-90f4-ffe7b383b328 None admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:28.046983 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72784ec5-8fb5-47e7-90f4-ffe7b383b328 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:28.047284 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72784ec5-8fb5-47e7-90f4-ffe7b383b328 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:28.048686 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72784ec5-8fb5-47e7-90f4-ffe7b383b328 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:28.050431 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e71fc8e-d533-46b9-b151-116a33fc87c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:28.052127 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e71fc8e-d533-46b9-b151-116a33fc87c1 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:28.061650 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 347/691] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:28:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:28.066990 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72784ec5-8fb5-47e7-90f4-ffe7b383b328 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:28.072567 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-8e71fc8e-d533-46b9-b151-116a33fc87c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:28.072567 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:28.072567 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:28.072567 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:28.072567 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:28.072567 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:28.072567 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:28.072567 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:28.072567 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:28.072567 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:28.072567 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:28.072567 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:28.072567 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:28:28.072567 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:28:28.072567 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:28:28.073497 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:28:28.073497 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:28.073497 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:28.073497 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:28.073497 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:28.073497 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:28.073497 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:28.073497 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:28.073497 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:28.073497 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:28.073497 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:28.073497 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:28.073497 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:28.073497 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:28.073497 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:28.073497 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:28.073497 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:28.074478 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:28:28.074478 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:28:28.074478 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:28.074478 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:28.077790 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 345/692] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:28:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:28.083121 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e71fc8e-d533-46b9-b151-116a33fc87c1 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:28.158122 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:28.169253 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:28.213998 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e71fc8e-d533-46b9-b151-116a33fc87c1 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:28.249714 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72784ec5-8fb5-47e7-90f4-ffe7b383b328 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:28.252675 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82dd46d-0bb0-4075-907e-c9832e86c570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:28.253579 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82dd46d-0bb0-4075-907e-c9832e86c570 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:28.254073 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82dd46d-0bb0-4075-907e-c9832e86c570 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:28.254548 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82dd46d-0bb0-4075-907e-c9832e86c570 None admin] PATH_INFO: `/v3/domains` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:28.255509 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82dd46d-0bb0-4075-907e-c9832e86c570 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:28.256074 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82dd46d-0bb0-4075-907e-c9832e86c570 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:28.258788 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82dd46d-0bb0-4075-907e-c9832e86c570 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:28.272723 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 346/693] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:28:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:28.278176 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82dd46d-0bb0-4075-907e-c9832e86c570 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:28.388300 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82dd46d-0bb0-4075-907e-c9832e86c570 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:28.396992 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f3d7a-8aa1-4a5a-b909-e3a06e85086a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:28.397807 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f3d7a-8aa1-4a5a-b909-e3a06e85086a None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:28.398088 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f3d7a-8aa1-4a5a-b909-e3a06e85086a None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:28.398360 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f3d7a-8aa1-4a5a-b909-e3a06e85086a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:28.416241 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:28.420678 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504f3d7a-8aa1-4a5a-b909-e3a06e85086a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:28.422090 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504f3d7a-8aa1-4a5a-b909-e3a06e85086a None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:28.428971 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178a4d1f-49b0-4212-8d93-edc47a86db3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:28.430043 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a4d1f-49b0-4212-8d93-edc47a86db3f None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:28.430489 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a4d1f-49b0-4212-8d93-edc47a86db3f None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:28.431289 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a4d1f-49b0-4212-8d93-edc47a86db3f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:28.439248 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178a4d1f-49b0-4212-8d93-edc47a86db3f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:28.441167 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178a4d1f-49b0-4212-8d93-edc47a86db3f None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:28.456069 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-178a4d1f-49b0-4212-8d93-edc47a86db3f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:28:28.456069 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:28.456069 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:28.456069 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:28.456069 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:28.456069 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:28.456069 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:28.456069 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:28.456069 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:28.456069 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:28.456069 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:28.456069 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:28.456069 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:28:28.456069 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:28:28.456069 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:28:28.457029 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:28:28.457029 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:28.457029 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:28.457029 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:28.457029 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:28.457029 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:28.457029 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:28.457029 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:28.457029 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:28.457029 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:28.457029 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:28.457029 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:28.457029 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:28.457029 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:28.457029 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:28.457029 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:28.457029 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:28.457927 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:28:28.457927 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:28:28.457927 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:28:28.457927 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:28:28.457927 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:28:28.457927 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:28:28.457927 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:28:28.457927 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:28.460519 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 347/694] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Jul 18 16:28:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:28.464104 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-504f3d7a-8aa1-4a5a-b909-e3a06e85086a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 16:28:28.464104 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:28.464104 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:28.464104 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:28.464104 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:28.464104 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:28.464104 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:28.464104 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:28.464104 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:28.464104 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:28.464104 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:28.464104 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:28.464104 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:28:28.464104 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:28:28.464104 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:28:28.464104 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:28:28.465883 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:28.465883 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:28.465883 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:28:28.465883 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:28:28.465883 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:28:28.465883 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:28:28.465883 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:28.465883 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:28.465883 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:28.465883 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:28.465883 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:28.465883 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:28.465883 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:28.465883 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:28.465883 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:28.465883 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:28.465883 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:28.465883 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:28.466866 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:28.466866 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:28.466866 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:28:28.466866 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:28:28.466866 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:28:28.466866 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:28:28.466866 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:28:28.466866 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:28:28.466866 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 16:28:28.466866 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:28.468971 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178a4d1f-49b0-4212-8d93-edc47a86db3f None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:28.471203 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 348/695] 10.222.0.81 () {56 vars in 1093 bytes} [Mon Jul 18 16:28:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 404 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:28:28.479772 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f3d7a-8aa1-4a5a-b909-e3a06e85086a None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:28.596302 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f3d7a-8aa1-4a5a-b909-e3a06e85086a None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:28.597137 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178a4d1f-49b0-4212-8d93-edc47a86db3f None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:28.628526 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:28.633890 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fd4070-9952-46c4-a225-f7d3d68af7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:28.634791 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd4070-9952-46c4-a225-f7d3d68af7fe None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:28.635229 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd4070-9952-46c4-a225-f7d3d68af7fe None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:28.635501 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd4070-9952-46c4-a225-f7d3d68af7fe None admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:28.636456 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fd4070-9952-46c4-a225-f7d3d68af7fe None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:28.636763 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fd4070-9952-46c4-a225-f7d3d68af7fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:28.638270 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fd4070-9952-46c4-a225-f7d3d68af7fe None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:28.647840 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec38fc9-c969-4c08-9a88-9b3ed6bab679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:28.649663 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec38fc9-c969-4c08-9a88-9b3ed6bab679 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:28.650130 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec38fc9-c969-4c08-9a88-9b3ed6bab679 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:28.650582 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec38fc9-c969-4c08-9a88-9b3ed6bab679 None admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:28.651693 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec38fc9-c969-4c08-9a88-9b3ed6bab679 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:28.652364 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec38fc9-c969-4c08-9a88-9b3ed6bab679 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:28.655225 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec38fc9-c969-4c08-9a88-9b3ed6bab679 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:28.662322 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 349/696] 10.222.0.81 () {56 vars in 1133 bytes} [Mon Jul 18 16:28:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:28.663901 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5532de-eb82-4ed0-9b43-9b39d6d9506a None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:28.664258 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5532de-eb82-4ed0-9b43-9b39d6d9506a None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:28.664600 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5532de-eb82-4ed0-9b43-9b39d6d9506a None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:28.670208 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 350/697] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:28:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:28.670208 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5532de-eb82-4ed0-9b43-9b39d6d9506a None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:28.679321 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 348/698] 10.222.0.81 () {56 vars in 1148 bytes} [Mon Jul 18 16:28:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:28.683760 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f322c9-601a-4863-be4a-0a5bc8528bcf None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:28.683760 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f322c9-601a-4863-be4a-0a5bc8528bcf None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:28.683760 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f322c9-601a-4863-be4a-0a5bc8528bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:28.712495 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-54f322c9-601a-4863-be4a-0a5bc8528bcf None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:28.715869 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-54f322c9-601a-4863-be4a-0a5bc8528bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:28.770032 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:28.786084 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5532de-eb82-4ed0-9b43-9b39d6d9506a None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:28.807271 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 349/699] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:28:28.808555 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f322c9-601a-4863-be4a-0a5bc8528bcf None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:28.823807 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a302c55-3689-460e-b706-36a59fb39b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:28.824461 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a302c55-3689-460e-b706-36a59fb39b2b None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:28.824815 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a302c55-3689-460e-b706-36a59fb39b2b None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:28.825155 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a302c55-3689-460e-b706-36a59fb39b2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:28.888376 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:28.899605 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a302c55-3689-460e-b706-36a59fb39b2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:28.901008 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a302c55-3689-460e-b706-36a59fb39b2b None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:28.936761 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f322c9-601a-4863-be4a-0a5bc8528bcf None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:28.975432 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146a1bb-01fa-486d-907a-df83da0430e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:28.976520 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146a1bb-01fa-486d-907a-df83da0430e6 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:28.977062 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146a1bb-01fa-486d-907a-df83da0430e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:28.977554 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146a1bb-01fa-486d-907a-df83da0430e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:28.978589 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a146a1bb-01fa-486d-907a-df83da0430e6 None admin] RBAC: Adding query filter params (role.id=a716f51ae5b44c918918ed808ad2b2b0, scope.project.id=9d1d84bf334d47e6bfba1141c1fc6f59, user.id=251475c53ac64cd48ae84567d8c2ee87) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:28.979128 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a146a1bb-01fa-486d-907a-df83da0430e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:28.981455 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a146a1bb-01fa-486d-907a-df83da0430e6 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:28.992091 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 350/700] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Jul 18 16:28:28 2022] GET /identity/v3/role_assignments?user.id=251475c53ac64cd48ae84567d8c2ee87&scope.project.id=9d1d84bf334d47e6bfba1141c1fc6f59&role.id=a716f51ae5b44c918918ed808ad2b2b0 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:28.993315 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146a1bb-01fa-486d-907a-df83da0430e6 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:29.009312 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 351/701] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Jul 18 16:28:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:28:29.015659 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a302c55-3689-460e-b706-36a59fb39b2b None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:29.074009 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:29.120026 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:29.132104 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a302c55-3689-460e-b706-36a59fb39b2b None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:29.160953 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146a1bb-01fa-486d-907a-df83da0430e6 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:29.170803 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4445d562-259c-4775-861a-e9dd70fcdc75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:29.172011 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445d562-259c-4775-861a-e9dd70fcdc75 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:29.172443 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445d562-259c-4775-861a-e9dd70fcdc75 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:29.172862 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445d562-259c-4775-861a-e9dd70fcdc75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:29.184968 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4445d562-259c-4775-861a-e9dd70fcdc75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:29.186711 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4445d562-259c-4775-861a-e9dd70fcdc75 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:29.203846 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e599b74-e218-419b-bd10-b1ea796e4203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:29.204846 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e599b74-e218-419b-bd10-b1ea796e4203 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:29.205233 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e599b74-e218-419b-bd10-b1ea796e4203 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:29.205608 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e599b74-e218-419b-bd10-b1ea796e4203 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:29.206374 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e599b74-e218-419b-bd10-b1ea796e4203 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:29.207975 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e599b74-e218-419b-bd10-b1ea796e4203 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:29.210398 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-4445d562-259c-4775-861a-e9dd70fcdc75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:29.210398 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:29.210398 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:29.210398 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:29.210398 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:29.210398 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:29.210398 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:29.210398 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:29.210398 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:29.210398 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:29.210398 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:29.210398 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:29.210398 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:28:29.210398 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:28:29.210398 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:28:29.211452 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:28:29.211452 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:29.211452 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:29.211452 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:29.211452 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:29.211452 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:29.211452 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:29.211452 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:29.211452 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:29.211452 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:29.211452 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:29.211452 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:29.211452 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:29.211452 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:29.211452 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:29.211452 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:29.211452 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:29.212488 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:28:29.212488 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:28:29.212488 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:29.212488 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:29.220840 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 352/702] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:28:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:29.222747 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085181d7-fd18-4cce-8ea8-71f55460b6d1 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:29.223262 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085181d7-fd18-4cce-8ea8-71f55460b6d1 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:29.223729 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085181d7-fd18-4cce-8ea8-71f55460b6d1 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:29.225343 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 353/703] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:28:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:29.226336 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085181d7-fd18-4cce-8ea8-71f55460b6d1 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:29.228253 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-2e599b74-e218-419b-bd10-b1ea796e4203 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 16:28:29.228253 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:29.228253 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 16:28:29.228253 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 16:28:29.228253 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 16:28:29.228253 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 16:28:29.228253 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 16:28:29.228253 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:28:29.228253 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 16:28:29.228253 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:29.228253 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 16:28:29.228253 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:29.228253 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:29.228253 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:29.228253 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:29.228253 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:29.229282 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:29.229282 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:29.229282 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:29.229282 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:29.229282 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:29.229282 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:29.229282 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:29.229282 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 16:28:29.229282 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 16:28:29.229282 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 16:28:29.229282 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 16:28:29.229282 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:29.229282 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:29.229282 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:29.229282 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:29.229282 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:29.230217 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:29.230217 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:29.230217 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:29.230217 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:29.230217 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:29.230217 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:29.230217 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:29.230217 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:29.230217 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:29.230217 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:29.230217 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:29.230217 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 16:28:29.230217 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:28:29.230217 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 16:28:29.230217 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:29.234004 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 351/704] 10.222.0.81 () {56 vars in 1129 bytes} [Mon Jul 18 16:28:28 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:29.236794 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc5479-09fb-4eb9-a4be-e73596216289 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:29.237233 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc5479-09fb-4eb9-a4be-e73596216289 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:29.237651 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc5479-09fb-4eb9-a4be-e73596216289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:29.257827 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-bcfc5479-09fb-4eb9-a4be-e73596216289 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:29.259448 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-bcfc5479-09fb-4eb9-a4be-e73596216289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:29.344625 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 352/705] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:28:29.345719 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfc5479-09fb-4eb9-a4be-e73596216289 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:29.384422 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:29.397227 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085181d7-fd18-4cce-8ea8-71f55460b6d1 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:29.446231 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992dd9d2-90d1-491b-9b70-ac7558a642e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:29.447292 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992dd9d2-90d1-491b-9b70-ac7558a642e5 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:29.447811 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992dd9d2-90d1-491b-9b70-ac7558a642e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:29.448284 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992dd9d2-90d1-491b-9b70-ac7558a642e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:29.450604 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992dd9d2-90d1-491b-9b70-ac7558a642e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:29.451244 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992dd9d2-90d1-491b-9b70-ac7558a642e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:29.453605 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992dd9d2-90d1-491b-9b70-ac7558a642e5 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:29.466773 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfc5479-09fb-4eb9-a4be-e73596216289 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:29.479250 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 354/706] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:28:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:29.484695 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992dd9d2-90d1-491b-9b70-ac7558a642e5 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:29.487657 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:29.520366 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2991c134-2267-495a-84af-6cfdf1ca3873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:29.521634 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2991c134-2267-495a-84af-6cfdf1ca3873 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:29.522430 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2991c134-2267-495a-84af-6cfdf1ca3873 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:29.523274 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2991c134-2267-495a-84af-6cfdf1ca3873 None admin] PATH_INFO: `/v3/services` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:29.524235 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2991c134-2267-495a-84af-6cfdf1ca3873 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:29.524744 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2991c134-2267-495a-84af-6cfdf1ca3873 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:29.527407 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2991c134-2267-495a-84af-6cfdf1ca3873 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:29.534256 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 353/707] 10.222.0.81 () {56 vars in 1124 bytes} [Mon Jul 18 16:28:29 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:29.535798 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2991c134-2267-495a-84af-6cfdf1ca3873 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:29.594360 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992dd9d2-90d1-491b-9b70-ac7558a642e5 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:29.630437 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77040b2-fc47-40a7-aff4-506b689b4234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:29.631261 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77040b2-fc47-40a7-aff4-506b689b4234 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:29.631552 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77040b2-fc47-40a7-aff4-506b689b4234 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:29.631910 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77040b2-fc47-40a7-aff4-506b689b4234 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:29.643207 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77040b2-fc47-40a7-aff4-506b689b4234 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:29.644728 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77040b2-fc47-40a7-aff4-506b689b4234 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:29.649074 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:29.658430 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2991c134-2267-495a-84af-6cfdf1ca3873 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:29.662518 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-b77040b2-fc47-40a7-aff4-506b689b4234 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:29.662518 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:29.662518 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:29.662518 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:29.662518 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:29.662518 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:29.662518 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:29.662518 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:29.662518 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:29.662518 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:29.662518 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:29.662518 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:29.662518 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:28:29.662518 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:28:29.662518 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:28:29.663458 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:28:29.663458 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:29.663458 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:29.663458 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:29.663458 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:29.663458 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:29.663458 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:29.663458 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:29.663458 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:29.663458 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:29.663458 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:29.663458 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:29.663458 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:29.663458 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:29.663458 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:29.663458 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:29.663458 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:29.664402 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:28:29.664402 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:28:29.664402 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:29.664402 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:29.669261 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 355/708] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:28:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:29.670149 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77040b2-fc47-40a7-aff4-506b689b4234 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:29.703473 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da0fdb-bb18-4568-948c-4bdbed9c7d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:29.704619 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da0fdb-bb18-4568-948c-4bdbed9c7d7f None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:29.705114 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da0fdb-bb18-4568-948c-4bdbed9c7d7f None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:29.705629 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da0fdb-bb18-4568-948c-4bdbed9c7d7f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:29.713706 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55da0fdb-bb18-4568-948c-4bdbed9c7d7f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:29.715596 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55da0fdb-bb18-4568-948c-4bdbed9c7d7f None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:29.731889 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-55da0fdb-bb18-4568-948c-4bdbed9c7d7f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:28:29.731889 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:29.731889 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:29.731889 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:29.731889 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:29.731889 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:29.731889 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:29.731889 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:29.731889 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:29.731889 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:29.731889 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:29.731889 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:29.731889 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:28:29.731889 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:28:29.731889 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:28:29.732867 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:28:29.732867 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:29.732867 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:29.732867 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:29.732867 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:29.732867 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:29.732867 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:29.732867 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:29.732867 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:29.732867 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:29.732867 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:29.732867 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:29.732867 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:29.732867 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:29.732867 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:29.732867 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:29.732867 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:29.733804 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:28:29.733804 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:28:29.733804 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:28:29.733804 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:28:29.733804 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:28:29.733804 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:28:29.733804 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:28:29.733804 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:29.735107 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:29.742055 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 354/709] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Jul 18 16:28:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:29.743298 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da0fdb-bb18-4568-948c-4bdbed9c7d7f None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:29.783931 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77040b2-fc47-40a7-aff4-506b689b4234 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:29.820707 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cbcb65-8285-4b0a-98d4-9f4b9b715fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:29.821375 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cbcb65-8285-4b0a-98d4-9f4b9b715fa7 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:29.821652 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cbcb65-8285-4b0a-98d4-9f4b9b715fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:29.821929 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cbcb65-8285-4b0a-98d4-9f4b9b715fa7 None admin] PATH_INFO: `/v3/services` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:29.823397 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cbcb65-8285-4b0a-98d4-9f4b9b715fa7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:29.823397 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cbcb65-8285-4b0a-98d4-9f4b9b715fa7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:29.824567 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cbcb65-8285-4b0a-98d4-9f4b9b715fa7 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:29.831348 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 356/710] 10.222.0.81 () {56 vars in 1124 bytes} [Mon Jul 18 16:28:29 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:29.832398 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cbcb65-8285-4b0a-98d4-9f4b9b715fa7 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:29.859624 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da0fdb-bb18-4568-948c-4bdbed9c7d7f None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:29.899833 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd3280-54b5-4944-9ac6-c1bbb52b281a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:29.900912 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd3280-54b5-4944-9ac6-c1bbb52b281a None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:29.901481 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd3280-54b5-4944-9ac6-c1bbb52b281a None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:29.901953 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd3280-54b5-4944-9ac6-c1bbb52b281a None admin] PATH_INFO: `/v3/domains` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:29.903526 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbd3280-54b5-4944-9ac6-c1bbb52b281a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:29.904098 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbd3280-54b5-4944-9ac6-c1bbb52b281a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:29.905724 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbd3280-54b5-4944-9ac6-c1bbb52b281a None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:29.920832 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 355/711] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:28:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:29.928893 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd3280-54b5-4944-9ac6-c1bbb52b281a None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:29.955958 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:29.964065 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cbcb65-8285-4b0a-98d4-9f4b9b715fa7 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:29.990734 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:30.009217 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ee9ef-dd91-4918-8477-2741f60f7773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:30.009850 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ee9ef-dd91-4918-8477-2741f60f7773 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:30.010097 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ee9ef-dd91-4918-8477-2741f60f7773 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:30.010417 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ee9ef-dd91-4918-8477-2741f60f7773 None admin] PATH_INFO: `/v3/projects` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:30.011297 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4ee9ef-dd91-4918-8477-2741f60f7773 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:30.011611 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4ee9ef-dd91-4918-8477-2741f60f7773 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:30.013179 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4ee9ef-dd91-4918-8477-2741f60f7773 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:30.026669 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 357/712] 10.222.0.81 () {56 vars in 1148 bytes} [Mon Jul 18 16:28:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:30.042827 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ee9ef-dd91-4918-8477-2741f60f7773 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:30.063747 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd3280-54b5-4944-9ac6-c1bbb52b281a None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:30.204337 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ee9ef-dd91-4918-8477-2741f60f7773 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:30.226633 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676f8995-6b38-4646-bc75-18b780e90e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:30.227702 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f8995-6b38-4646-bc75-18b780e90e9d None admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:30.229089 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f8995-6b38-4646-bc75-18b780e90e9d None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:30.229363 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f8995-6b38-4646-bc75-18b780e90e9d None admin] PATH_INFO: `/v3/users` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:30.230084 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676f8995-6b38-4646-bc75-18b780e90e9d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:30.231629 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676f8995-6b38-4646-bc75-18b780e90e9d None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:30.240334 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f1fe4d-1662-4067-8ad1-afbdc3e47ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:30.240991 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1fe4d-1662-4067-8ad1-afbdc3e47ea1 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:30.241267 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1fe4d-1662-4067-8ad1-afbdc3e47ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:30.241538 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1fe4d-1662-4067-8ad1-afbdc3e47ea1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:30.242443 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f1fe4d-1662-4067-8ad1-afbdc3e47ea1 None admin] RBAC: Adding query filter params (role.id=fd83eab44cb343a2b532ce32a2ac31d8, scope.project.id=9d1d84bf334d47e6bfba1141c1fc6f59, user.id=07f0c5bf1bee48a0bafdf7a9e4537c70) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:30.242792 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f1fe4d-1662-4067-8ad1-afbdc3e47ea1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:30.244235 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f1fe4d-1662-4067-8ad1-afbdc3e47ea1 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:30.250068 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 358/713] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Jul 18 16:28:30 2022] GET /identity/v3/role_assignments?user.id=07f0c5bf1bee48a0bafdf7a9e4537c70&scope.project.id=9d1d84bf334d47e6bfba1141c1fc6f59&role.id=fd83eab44cb343a2b532ce32a2ac31d8 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:28:30.251313 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0cdc0-42df-4fd9-a0d6-767e1dd4fb23 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:30.251595 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0cdc0-42df-4fd9-a0d6-767e1dd4fb23 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:30.251897 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0cdc0-42df-4fd9-a0d6-767e1dd4fb23 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:30.257182 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 359/714] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:28:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:30.259148 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759053ce-14df-49ba-8593-51f5b8c0db25 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:30.259506 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759053ce-14df-49ba-8593-51f5b8c0db25 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:30.259925 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759053ce-14df-49ba-8593-51f5b8c0db25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:30.279668 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-759053ce-14df-49ba-8593-51f5b8c0db25 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:30.281056 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-759053ce-14df-49ba-8593-51f5b8c0db25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:30.323696 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:30.362346 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 360/715] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 16:28:30.385996 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 356/716] 10.222.0.81 () {60 vars in 1132 bytes} [Mon Jul 18 16:28:29 2022] POST /identity/v3/users => generated 254 bytes in 458 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:28:30.392865 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759053ce-14df-49ba-8593-51f5b8c0db25 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:30.513839 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759053ce-14df-49ba-8593-51f5b8c0db25 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:30.551930 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6820a8aa-cdb0-486a-bf2d-16feaea63427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:30.552861 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820a8aa-cdb0-486a-bf2d-16feaea63427 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:30.553252 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820a8aa-cdb0-486a-bf2d-16feaea63427 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:30.553596 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820a8aa-cdb0-486a-bf2d-16feaea63427 None admin] PATH_INFO: `/v3/services/network` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:30.554330 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6820a8aa-cdb0-486a-bf2d-16feaea63427 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:30.555790 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6820a8aa-cdb0-486a-bf2d-16feaea63427 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:30.570787 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-6820a8aa-cdb0-486a-bf2d-16feaea63427 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 16:28:30.570787 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:30.570787 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 16:28:30.570787 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 16:28:30.570787 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 16:28:30.570787 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 16:28:30.570787 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 16:28:30.570787 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:28:30.570787 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 16:28:30.570787 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:30.570787 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 16:28:30.570787 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:30.570787 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:30.570787 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:30.570787 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:30.570787 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:30.570787 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:30.572102 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:30.572102 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:30.572102 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:30.572102 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:30.572102 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:30.572102 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:30.572102 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 16:28:30.572102 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 16:28:30.572102 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 16:28:30.572102 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 16:28:30.572102 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:30.572102 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:30.572102 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:30.572102 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:30.572102 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:30.572102 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:30.573183 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:30.573183 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:30.573183 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:30.573183 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:30.573183 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:30.573183 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:30.573183 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:30.573183 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:30.573183 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:30.573183 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:30.573183 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 16:28:30.573183 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:28:30.573183 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 16:28:30.573183 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:30.575875 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 361/717] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Jul 18 16:28:30 2022] GET /identity/v3/services/network => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:30.580931 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676f8995-6b38-4646-bc75-18b780e90e9d None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:30.691472 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:30.724120 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676f8995-6b38-4646-bc75-18b780e90e9d None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:30.760841 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75497c4e-0bb2-455f-ac29-027ca96cb3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:30.761517 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75497c4e-0bb2-455f-ac29-027ca96cb3c3 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:30.761860 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75497c4e-0bb2-455f-ac29-027ca96cb3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:30.762121 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75497c4e-0bb2-455f-ac29-027ca96cb3c3 None admin] PATH_INFO: `/v3/services` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:30.762835 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75497c4e-0bb2-455f-ac29-027ca96cb3c3 None admin] RBAC: Adding query filter params (name=network) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:30.763140 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75497c4e-0bb2-455f-ac29-027ca96cb3c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:30.764665 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75497c4e-0bb2-455f-ac29-027ca96cb3c3 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:30.770004 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 357/718] 10.222.0.81 () {56 vars in 1112 bytes} [Mon Jul 18 16:28:30 2022] GET /identity/v3/services?name=network => generated 124 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:30.775363 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6820a8aa-cdb0-486a-bf2d-16feaea63427 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:30.817486 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:30.885334 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6820a8aa-cdb0-486a-bf2d-16feaea63427 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:30.923900 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296960dd-a6f7-4d0d-b4c2-f2cc2bc4ec5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:30.924574 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296960dd-a6f7-4d0d-b4c2-f2cc2bc4ec5c None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:30.924859 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296960dd-a6f7-4d0d-b4c2-f2cc2bc4ec5c None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:30.925137 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296960dd-a6f7-4d0d-b4c2-f2cc2bc4ec5c None admin] PATH_INFO: `/v3/services` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:30.925853 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296960dd-a6f7-4d0d-b4c2-f2cc2bc4ec5c None admin] RBAC: Adding query filter params (type=network) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:30.926219 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296960dd-a6f7-4d0d-b4c2-f2cc2bc4ec5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:30.927607 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296960dd-a6f7-4d0d-b4c2-f2cc2bc4ec5c None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:30.932887 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 362/719] 10.222.0.81 () {56 vars in 1112 bytes} [Mon Jul 18 16:28:30 2022] GET /identity/v3/services?type=network => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:28:31.413535 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f1adf-fbad-4347-8d12-074ed7d0d024 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:31.414057 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f1adf-fbad-4347-8d12-074ed7d0d024 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:31.414136 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f1adf-fbad-4347-8d12-074ed7d0d024 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:31.415776 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 358/720] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:28:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:31.420982 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b83afb-4500-4558-b4f9-52db1b05ba8d None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:31.421274 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b83afb-4500-4558-b4f9-52db1b05ba8d None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:31.421555 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b83afb-4500-4558-b4f9-52db1b05ba8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:31.443026 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-14b83afb-4500-4558-b4f9-52db1b05ba8d None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:31.444260 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-14b83afb-4500-4558-b4f9-52db1b05ba8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:31.542428 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 363/721] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:28:31.582548 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f1adf-fbad-4347-8d12-074ed7d0d024 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:31.713715 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f1adf-fbad-4347-8d12-074ed7d0d024 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:31.750702 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08c7336-43ee-4985-8d18-afb2a1d19a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:31.751887 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c7336-43ee-4985-8d18-afb2a1d19a24 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:31.752368 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c7336-43ee-4985-8d18-afb2a1d19a24 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:31.752834 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c7336-43ee-4985-8d18-afb2a1d19a24 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:31.756009 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:31.770469 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08c7336-43ee-4985-8d18-afb2a1d19a24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:28:31.779217 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-e08c7336-43ee-4985-8d18-afb2a1d19a24 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:28:31.779217 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:31.779217 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:31.779217 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:31.779217 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:31.779217 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:31.779217 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:31.779217 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:31.779217 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:31.779217 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:31.779217 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:31.779217 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:31.779217 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:28:31.779217 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:28:31.779217 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:28:31.779217 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:28:31.780214 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:28:31.780214 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:28:31.780214 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:28:31.780214 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:28:31.780214 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:31.780214 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:31.780214 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:31.780214 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:31.780214 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:31.780214 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:31.780214 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:31.780214 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:31.780214 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:31.780214 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:31.780214 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:31.780214 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:31.781436 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:31.781436 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:31.781436 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:31.781436 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:31.781436 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:28:31.781436 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:28:31.781436 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:28:31.781436 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:28:31.781436 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:28:31.781436 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:28:31.781436 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:28:31.781436 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:31.781436 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 359/722] 10.222.0.81 () {56 vars in 1096 bytes} [Mon Jul 18 16:28:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:31.786502 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b83afb-4500-4558-b4f9-52db1b05ba8d None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:31.849498 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:31.946477 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b83afb-4500-4558-b4f9-52db1b05ba8d None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:31.981443 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa0eeac-1e52-4676-ace8-871f5376c25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:31.982120 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0eeac-1e52-4676-ace8-871f5376c25b None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:31.982402 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0eeac-1e52-4676-ace8-871f5376c25b None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:31.982718 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0eeac-1e52-4676-ace8-871f5376c25b None admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:31.983401 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa0eeac-1e52-4676-ace8-871f5376c25b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:31.983700 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa0eeac-1e52-4676-ace8-871f5376c25b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:31.985119 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa0eeac-1e52-4676-ace8-871f5376c25b None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:31.998217 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 364/723] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Jul 18 16:28:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:32.005284 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08c7336-43ee-4985-8d18-afb2a1d19a24 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:32.156455 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08c7336-43ee-4985-8d18-afb2a1d19a24 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:32.190818 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a229ca6-c010-4317-9a7e-8301cbe5e45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:32.191630 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a229ca6-c010-4317-9a7e-8301cbe5e45d None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:32.191929 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a229ca6-c010-4317-9a7e-8301cbe5e45d None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:32.192191 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a229ca6-c010-4317-9a7e-8301cbe5e45d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:32.202821 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a229ca6-c010-4317-9a7e-8301cbe5e45d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:32.204370 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a229ca6-c010-4317-9a7e-8301cbe5e45d None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:32.234700 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-1a229ca6-c010-4317-9a7e-8301cbe5e45d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:32.234700 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:32.234700 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:32.234700 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:32.234700 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:32.234700 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:32.234700 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:32.234700 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:32.234700 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:32.234700 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:32.234700 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:32.234700 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:32.234700 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:28:32.234700 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:28:32.234700 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:28:32.235650 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:28:32.235650 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:32.235650 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:32.235650 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:32.235650 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:32.235650 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:32.235650 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:32.235650 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:32.235650 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:32.235650 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:32.235650 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:32.235650 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:32.235650 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:32.235650 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:32.235650 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:32.235650 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:32.235650 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:32.236586 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:28:32.236586 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:28:32.236586 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:32.236586 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:32.236586 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 360/724] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:28:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:32.241649 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa0eeac-1e52-4676-ace8-871f5376c25b None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:32.391334 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:32.400322 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa0eeac-1e52-4676-ace8-871f5376c25b None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:32.448985 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381c4c8a-f802-4181-b8e2-76db39c56002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:32.449742 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c4c8a-f802-4181-b8e2-76db39c56002 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:32.450033 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c4c8a-f802-4181-b8e2-76db39c56002 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:32.450311 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c4c8a-f802-4181-b8e2-76db39c56002 None admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:32.451043 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381c4c8a-f802-4181-b8e2-76db39c56002 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:32.451353 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381c4c8a-f802-4181-b8e2-76db39c56002 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:32.452763 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381c4c8a-f802-4181-b8e2-76db39c56002 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:32.474291 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 365/725] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:28:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:32.479778 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a229ca6-c010-4317-9a7e-8301cbe5e45d None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:32.562368 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:32.565514 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054db67e-9dcb-44d8-aa91-dbb645eef463 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:32.566010 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054db67e-9dcb-44d8-aa91-dbb645eef463 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:32.566101 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054db67e-9dcb-44d8-aa91-dbb645eef463 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:32.567742 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 366/726] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:28:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:32.572997 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e6eb5-2014-4051-962f-c0bcd8715645 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:32.573284 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e6eb5-2014-4051-962f-c0bcd8715645 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:32.578127 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e6eb5-2014-4051-962f-c0bcd8715645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:32.591566 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-8e0e6eb5-2014-4051-962f-c0bcd8715645 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:32.592810 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-8e0e6eb5-2014-4051-962f-c0bcd8715645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:32.650856 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a229ca6-c010-4317-9a7e-8301cbe5e45d None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:32.716893 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 367/727] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 16:28:32.718415 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f91311c-3b29-43e0-bd1d-50b2db8fc336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:32.719440 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f91311c-3b29-43e0-bd1d-50b2db8fc336 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:32.719969 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f91311c-3b29-43e0-bd1d-50b2db8fc336 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:32.720479 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f91311c-3b29-43e0-bd1d-50b2db8fc336 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:32.736488 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f91311c-3b29-43e0-bd1d-50b2db8fc336 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:32.738335 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f91311c-3b29-43e0-bd1d-50b2db8fc336 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:32.738733 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e6eb5-2014-4051-962f-c0bcd8715645 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:32.759752 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-4f91311c-3b29-43e0-bd1d-50b2db8fc336 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 18 16:28:32.759752 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:32.759752 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:32.759752 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:32.759752 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:32.759752 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:32.759752 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:32.759752 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:32.759752 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:32.759752 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:32.759752 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:32.759752 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:32.759752 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:28:32.759752 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:28:32.759752 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:28:32.759752 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:28:32.760831 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:32.760831 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:32.760831 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:28:32.760831 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:28:32.760831 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:28:32.760831 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:28:32.760831 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:32.760831 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:32.760831 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:32.760831 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:32.760831 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:32.760831 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:32.760831 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:32.760831 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:32.760831 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:32.760831 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:32.760831 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:32.760831 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:32.762402 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:32.762402 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:32.762402 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:28:32.762402 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:28:32.762402 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:28:32.762402 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:28:32.762402 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:28:32.762402 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:28:32.762402 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 18 16:28:32.762402 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:32.763583 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 361/728] 10.222.0.81 () {56 vars in 1096 bytes} [Mon Jul 18 16:28:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:32.772720 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f91311c-3b29-43e0-bd1d-50b2db8fc336 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:32.847137 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:32.876906 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e6eb5-2014-4051-962f-c0bcd8715645 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:32.923004 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8224a3-e168-4adb-a2c7-2c03cbbcd253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:32.924618 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8224a3-e168-4adb-a2c7-2c03cbbcd253 None admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:32.925271 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8224a3-e168-4adb-a2c7-2c03cbbcd253 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:32.925798 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8224a3-e168-4adb-a2c7-2c03cbbcd253 None admin] PATH_INFO: `/v3/services` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:32.926961 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8224a3-e168-4adb-a2c7-2c03cbbcd253 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:32.929199 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8224a3-e168-4adb-a2c7-2c03cbbcd253 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:32.930549 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f91311c-3b29-43e0-bd1d-50b2db8fc336 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:32.941959 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:32.967070 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d08187-e1e2-4803-9a57-80ba1471f1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:32.967940 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d08187-e1e2-4803-9a57-80ba1471f1ae None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:32.968295 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d08187-e1e2-4803-9a57-80ba1471f1ae None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:32.968639 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d08187-e1e2-4803-9a57-80ba1471f1ae None admin] PATH_INFO: `/v3/users` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:32.969559 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d08187-e1e2-4803-9a57-80ba1471f1ae None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:32.969857 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d08187-e1e2-4803-9a57-80ba1471f1ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:32.971274 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d08187-e1e2-4803-9a57-80ba1471f1ae None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:32.989259 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 362/729] 10.222.0.81 () {56 vars in 1135 bytes} [Mon Jul 18 16:28:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:32.990524 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d9ea4-5dd8-4e5c-8ed4-1f090b2dfffc None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:32.990812 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d9ea4-5dd8-4e5c-8ed4-1f090b2dfffc None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:32.991072 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d9ea4-5dd8-4e5c-8ed4-1f090b2dfffc None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:32.997178 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 363/730] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:28:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:32.997178 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d9ea4-5dd8-4e5c-8ed4-1f090b2dfffc None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:33.032368 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 368/731] 10.222.0.81 () {60 vars in 1141 bytes} [Mon Jul 18 16:28:32 2022] POST /identity/v3/services => generated 251 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:28:33.033391 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507c3a2-ced2-4e0f-89fa-2a7acc15e060 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:33.033682 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507c3a2-ced2-4e0f-89fa-2a7acc15e060 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:33.033957 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507c3a2-ced2-4e0f-89fa-2a7acc15e060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:33.087783 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-1507c3a2-ced2-4e0f-89fa-2a7acc15e060 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:33.088981 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-1507c3a2-ced2-4e0f-89fa-2a7acc15e060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:33.139472 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d9ea4-5dd8-4e5c-8ed4-1f090b2dfffc None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:33.182720 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1d3929-fae8-42f3-9661-65d34c70bdb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:33.184319 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d3929-fae8-42f3-9661-65d34c70bdb2 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:33.184960 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d3929-fae8-42f3-9661-65d34c70bdb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:33.185520 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d3929-fae8-42f3-9661-65d34c70bdb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:33.223092 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:33.273567 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1d3929-fae8-42f3-9661-65d34c70bdb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:33.276053 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1d3929-fae8-42f3-9661-65d34c70bdb2 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:33.286701 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 369/732] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:33 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:28:33.314111 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1507c3a2-ced2-4e0f-89fa-2a7acc15e060 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:33.399318 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 364/733] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Jul 18 16:28:32 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:28:33.401134 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226e70e-5cc5-4479-85ec-9d6f4db8aa7d None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:33.401690 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226e70e-5cc5-4479-85ec-9d6f4db8aa7d None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:33.402174 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226e70e-5cc5-4479-85ec-9d6f4db8aa7d None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:33.404679 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 365/734] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:28:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:33.409164 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b226e70e-5cc5-4479-85ec-9d6f4db8aa7d None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:33.489926 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:33.508112 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:33.537920 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b226e70e-5cc5-4479-85ec-9d6f4db8aa7d None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:33.540159 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1507c3a2-ced2-4e0f-89fa-2a7acc15e060 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:33.572523 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec9823-d3eb-43aa-a7c0-ccd1260cbc5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:33.573318 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec9823-d3eb-43aa-a7c0-ccd1260cbc5f None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:33.573600 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec9823-d3eb-43aa-a7c0-ccd1260cbc5f None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:33.573873 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec9823-d3eb-43aa-a7c0-ccd1260cbc5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:33.580092 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9585699-90bd-4934-bc7f-722df509743d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:33.581815 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9585699-90bd-4934-bc7f-722df509743d None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:33.586288 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9585699-90bd-4934-bc7f-722df509743d None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:33.586288 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9585699-90bd-4934-bc7f-722df509743d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:33.586489 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec9823-d3eb-43aa-a7c0-ccd1260cbc5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:33.586829 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec9823-d3eb-43aa-a7c0-ccd1260cbc5f None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:33.596488 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9585699-90bd-4934-bc7f-722df509743d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:28:33.604501 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-c9585699-90bd-4934-bc7f-722df509743d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:28:33.604501 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:33.604501 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:33.604501 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:33.604501 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:33.604501 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:33.604501 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:33.604501 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:33.604501 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:33.604501 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:33.604501 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:33.604501 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:33.604501 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:28:33.604501 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:28:33.604501 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:28:33.604501 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:28:33.605664 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:28:33.605664 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:28:33.605664 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:28:33.605664 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:28:33.605664 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:33.605664 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:33.605664 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:33.605664 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:33.605664 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:33.605664 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:33.605664 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:33.605664 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:33.605664 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:33.605664 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:33.605664 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:33.605664 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:33.606676 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:33.606676 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:33.606676 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:33.606676 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:33.606676 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:28:33.606676 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:28:33.606676 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:28:33.606676 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:28:33.606676 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:28:33.606676 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:28:33.606676 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:28:33.606676 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:33.607448 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-c4ec9823-d3eb-43aa-a7c0-ccd1260cbc5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:33.607448 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:33.607448 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:33.607448 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:33.607448 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:33.607448 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:33.607448 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:33.607448 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:33.607448 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:33.607448 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:33.607448 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:33.607448 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:33.607448 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:28:33.607448 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:28:33.607448 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:28:33.608433 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:28:33.608433 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:33.608433 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:33.608433 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:33.608433 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:33.608433 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:33.608433 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:33.608433 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:33.608433 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:33.608433 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:33.608433 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:33.608433 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:33.608433 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:33.608433 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:33.608433 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:33.608433 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:33.608433 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:33.609509 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:28:33.609509 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:28:33.609509 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:33.609509 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:33.609509 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 366/735] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:28:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:33.609509 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b1892-5fac-49ef-a482-e1eccd975efb None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:33.609509 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b1892-5fac-49ef-a482-e1eccd975efb None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:33.609509 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b1892-5fac-49ef-a482-e1eccd975efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:33.616553 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 370/736] 10.222.0.81 () {56 vars in 1096 bytes} [Mon Jul 18 16:28:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:33.618540 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e9a10-0b41-4a71-b028-9407e01962fb None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:33.619068 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e9a10-0b41-4a71-b028-9407e01962fb None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:33.619484 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e9a10-0b41-4a71-b028-9407e01962fb None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:33.626199 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 371/737] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:28:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:33.626199 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e9a10-0b41-4a71-b028-9407e01962fb None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:33.631938 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-581b1892-5fac-49ef-a482-e1eccd975efb None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:33.633383 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-581b1892-5fac-49ef-a482-e1eccd975efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:33.708137 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 367/738] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:33 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:28:33.709296 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581b1892-5fac-49ef-a482-e1eccd975efb None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:33.740042 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e9a10-0b41-4a71-b028-9407e01962fb None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:33.768884 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:33.772214 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:33.777445 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56789aa-ebb9-4234-bc6e-1121e9eab035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:33.778113 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56789aa-ebb9-4234-bc6e-1121e9eab035 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:33.778393 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56789aa-ebb9-4234-bc6e-1121e9eab035 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:33.778669 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56789aa-ebb9-4234-bc6e-1121e9eab035 None admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:33.779395 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56789aa-ebb9-4234-bc6e-1121e9eab035 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:33.779704 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56789aa-ebb9-4234-bc6e-1121e9eab035 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:33.781105 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56789aa-ebb9-4234-bc6e-1121e9eab035 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:33.793050 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 372/739] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:28:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:33.794420 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0f351-7562-40f7-be2d-036bbdd990f1 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:33.794641 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0f351-7562-40f7-be2d-036bbdd990f1 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:33.794913 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0f351-7562-40f7-be2d-036bbdd990f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:33.813248 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-fde0f351-7562-40f7-be2d-036bbdd990f1 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:33.814462 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-fde0f351-7562-40f7-be2d-036bbdd990f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:33.837146 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581b1892-5fac-49ef-a482-e1eccd975efb None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:33.873795 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b73891a-93d1-42b9-82b3-b5337a75f147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:33.874487 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73891a-93d1-42b9-82b3-b5337a75f147 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:33.874736 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73891a-93d1-42b9-82b3-b5337a75f147 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:33.875005 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73891a-93d1-42b9-82b3-b5337a75f147 None admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:33.875769 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b73891a-93d1-42b9-82b3-b5337a75f147 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:33.876076 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b73891a-93d1-42b9-82b3-b5337a75f147 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:33.877420 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b73891a-93d1-42b9-82b3-b5337a75f147 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:33.886385 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 368/740] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Jul 18 16:28:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:33.887658 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b73891a-93d1-42b9-82b3-b5337a75f147 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:33.894915 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 373/741] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:33 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:28:33.895693 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde0f351-7562-40f7-be2d-036bbdd990f1 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:34.003274 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b73891a-93d1-42b9-82b3-b5337a75f147 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:34.009581 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde0f351-7562-40f7-be2d-036bbdd990f1 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:34.012578 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:34.031653 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:34.040842 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bfcd3f-2250-440c-8c16-ebf14c2980c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:34.041641 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bfcd3f-2250-440c-8c16-ebf14c2980c9 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:34.041926 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bfcd3f-2250-440c-8c16-ebf14c2980c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:34.042300 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bfcd3f-2250-440c-8c16-ebf14c2980c9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:34.042812 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb9b6b-565a-4c26-b15d-e5343eecfd91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:34.044211 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb9b6b-565a-4c26-b15d-e5343eecfd91 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:34.044555 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb9b6b-565a-4c26-b15d-e5343eecfd91 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:34.044912 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb9b6b-565a-4c26-b15d-e5343eecfd91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:34.051477 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fb9b6b-565a-4c26-b15d-e5343eecfd91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:34.052946 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fb9b6b-565a-4c26-b15d-e5343eecfd91 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:34.055034 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bfcd3f-2250-440c-8c16-ebf14c2980c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:28:34.063130 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-83bfcd3f-2250-440c-8c16-ebf14c2980c9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:28:34.063130 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:34.063130 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:34.063130 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:34.063130 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:34.063130 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:34.063130 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:34.063130 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:34.063130 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:34.063130 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:34.063130 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:34.063130 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:34.063130 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:28:34.063130 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:28:34.063130 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:28:34.063130 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:28:34.064729 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:28:34.064729 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:28:34.064729 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:28:34.064729 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:28:34.064729 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:34.064729 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:34.064729 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:34.064729 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:34.064729 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:34.064729 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:34.064729 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:34.064729 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:34.064729 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:34.064729 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:34.064729 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:34.064729 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:34.065756 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:34.065756 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:34.065756 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:34.065756 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:34.065756 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:28:34.065756 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:28:34.065756 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:28:34.065756 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:28:34.065756 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:28:34.065756 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:28:34.065756 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:28:34.065756 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:34.066917 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 369/742] 10.222.0.81 () {56 vars in 1102 bytes} [Mon Jul 18 16:28:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:34.067229 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bfcd3f-2250-440c-8c16-ebf14c2980c9 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:34.068339 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-d3fb9b6b-565a-4c26-b15d-e5343eecfd91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:28:34.068339 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:34.068339 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:34.068339 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:34.068339 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:34.068339 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:34.068339 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:34.068339 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:34.068339 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:34.068339 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:34.068339 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:34.068339 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:34.068339 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:28:34.068339 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:28:34.068339 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:28:34.069384 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:28:34.069384 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:34.069384 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:34.069384 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:34.069384 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:34.069384 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:34.069384 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:34.069384 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:34.069384 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:34.069384 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:34.069384 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:34.069384 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:34.069384 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:34.069384 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:34.069384 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:34.069384 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:34.069384 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:34.070547 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:28:34.070547 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:28:34.070547 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:28:34.070547 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:28:34.070547 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:28:34.070547 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:28:34.070547 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:28:34.070547 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:34.074051 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 374/743] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Jul 18 16:28:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:34.075523 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb9b6b-565a-4c26-b15d-e5343eecfd91 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:34.183269 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb9b6b-565a-4c26-b15d-e5343eecfd91 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:34.184996 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bfcd3f-2250-440c-8c16-ebf14c2980c9 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:34.218039 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e4692-1c3b-454e-9219-90ce782efb85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:34.218629 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7332abfa-3078-4d94-9dfd-3b8b298b54ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:34.218761 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e4692-1c3b-454e-9219-90ce782efb85 None admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:34.218955 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e4692-1c3b-454e-9219-90ce782efb85 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:34.219225 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e4692-1c3b-454e-9219-90ce782efb85 None admin] PATH_INFO: `/v3/services` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:34.219794 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7332abfa-3078-4d94-9dfd-3b8b298b54ec None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:34.219959 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92e4692-1c3b-454e-9219-90ce782efb85 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:34.220246 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7332abfa-3078-4d94-9dfd-3b8b298b54ec None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:34.220613 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7332abfa-3078-4d94-9dfd-3b8b298b54ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:34.221310 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92e4692-1c3b-454e-9219-90ce782efb85 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:34.232428 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7332abfa-3078-4d94-9dfd-3b8b298b54ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:34.233886 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7332abfa-3078-4d94-9dfd-3b8b298b54ec None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:34.250603 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-7332abfa-3078-4d94-9dfd-3b8b298b54ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:34.250603 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:34.250603 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:34.250603 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:34.250603 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:34.250603 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:34.250603 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:34.250603 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:34.250603 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:34.250603 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:34.250603 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:34.250603 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:34.250603 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:28:34.250603 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:28:34.250603 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:28:34.251733 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:28:34.251733 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:34.251733 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:34.251733 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:34.251733 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:34.251733 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:34.251733 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:34.251733 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:34.251733 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:34.251733 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:34.251733 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:34.251733 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:34.251733 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:34.251733 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:34.251733 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:34.251733 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:34.251733 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:34.252704 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:28:34.252704 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:28:34.252704 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:34.252704 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:34.252704 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 370/744] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:28:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:34.252988 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7332abfa-3078-4d94-9dfd-3b8b298b54ec None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:34.273409 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:34.298130 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 375/745] 10.222.0.81 () {60 vars in 1141 bytes} [Mon Jul 18 16:28:34 2022] POST /identity/v3/services => generated 240 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:28:34.299185 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e4692-1c3b-454e-9219-90ce782efb85 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:34.356774 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:34.378801 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7332abfa-3078-4d94-9dfd-3b8b298b54ec None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:34.434935 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca3b575-8a50-4ac5-94fd-0d3d1023e733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:34.435639 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca3b575-8a50-4ac5-94fd-0d3d1023e733 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:34.435965 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca3b575-8a50-4ac5-94fd-0d3d1023e733 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:34.436235 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca3b575-8a50-4ac5-94fd-0d3d1023e733 None admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:34.436981 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca3b575-8a50-4ac5-94fd-0d3d1023e733 None admin] RBAC: Adding query filter params (name=service) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:34.437287 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca3b575-8a50-4ac5-94fd-0d3d1023e733 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:34.438662 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca3b575-8a50-4ac5-94fd-0d3d1023e733 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:34.445252 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e4692-1c3b-454e-9219-90ce782efb85 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:34.455882 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 371/746] 10.222.0.81 () {56 vars in 1103 bytes} [Mon Jul 18 16:28:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:34.456894 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca3b575-8a50-4ac5-94fd-0d3d1023e733 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:34.500063 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaaa49f-2f7b-41be-8f09-06c492cb6295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:34.501121 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaaa49f-2f7b-41be-8f09-06c492cb6295 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:34.501484 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaaa49f-2f7b-41be-8f09-06c492cb6295 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:34.501866 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaaa49f-2f7b-41be-8f09-06c492cb6295 None admin] PATH_INFO: `/v3/projects` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:34.503513 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaaa49f-2f7b-41be-8f09-06c492cb6295 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:34.503963 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaaa49f-2f7b-41be-8f09-06c492cb6295 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:34.505488 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaaa49f-2f7b-41be-8f09-06c492cb6295 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:34.519278 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 376/747] 10.222.0.81 () {56 vars in 1148 bytes} [Mon Jul 18 16:28:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:34.520389 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaaa49f-2f7b-41be-8f09-06c492cb6295 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:34.549180 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:34.577616 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca3b575-8a50-4ac5-94fd-0d3d1023e733 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:34.613026 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f2b833-3890-4796-a0c9-1d64f0259e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:34.614530 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2b833-3890-4796-a0c9-1d64f0259e40 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:34.614530 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2b833-3890-4796-a0c9-1d64f0259e40 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:34.614530 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2b833-3890-4796-a0c9-1d64f0259e40 None admin] PATH_INFO: `/v3/domains` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:34.615503 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f2b833-3890-4796-a0c9-1d64f0259e40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:34.615933 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f2b833-3890-4796-a0c9-1d64f0259e40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:34.617401 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f2b833-3890-4796-a0c9-1d64f0259e40 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:34.631343 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 372/748] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:28:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:34.632695 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f2b833-3890-4796-a0c9-1d64f0259e40 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:34.652091 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:34.656959 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaaa49f-2f7b-41be-8f09-06c492cb6295 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:34.697721 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac271d73-4bec-4746-be2e-91a27628d314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:34.698652 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac271d73-4bec-4746-be2e-91a27628d314 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:34.699038 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac271d73-4bec-4746-be2e-91a27628d314 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:34.700020 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac271d73-4bec-4746-be2e-91a27628d314 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:34.712064 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac271d73-4bec-4746-be2e-91a27628d314 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:34.713770 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac271d73-4bec-4746-be2e-91a27628d314 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:34.734390 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-ac271d73-4bec-4746-be2e-91a27628d314 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:34.734390 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:34.734390 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:34.734390 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:34.734390 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:34.734390 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:34.734390 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:34.734390 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:34.734390 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:34.734390 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:34.734390 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:34.734390 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:34.734390 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:28:34.734390 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:28:34.734390 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:28:34.735533 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:28:34.735533 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:34.735533 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:34.735533 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:34.735533 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:34.735533 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:34.735533 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:34.735533 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:34.735533 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:34.735533 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:34.735533 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:34.735533 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:34.735533 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:34.735533 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:34.735533 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:34.735533 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:34.735533 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:34.736679 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:28:34.736679 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:28:34.736679 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:34.736679 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:34.738068 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 377/749] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:28:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:34.739034 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac271d73-4bec-4746-be2e-91a27628d314 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:34.764859 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f2b833-3890-4796-a0c9-1d64f0259e40 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:34.812073 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ca3bc-c782-424f-92d0-0f992ef8a122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:34.813227 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ca3bc-c782-424f-92d0-0f992ef8a122 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:34.813660 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ca3bc-c782-424f-92d0-0f992ef8a122 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:34.814323 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ca3bc-c782-424f-92d0-0f992ef8a122 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:34.815854 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4ca3bc-c782-424f-92d0-0f992ef8a122 None admin] RBAC: Adding query filter params (role.id=fd83eab44cb343a2b532ce32a2ac31d8, scope.project.id=9d1d84bf334d47e6bfba1141c1fc6f59, user.id=251475c53ac64cd48ae84567d8c2ee87) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:34.816420 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4ca3bc-c782-424f-92d0-0f992ef8a122 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:34.818654 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4ca3bc-c782-424f-92d0-0f992ef8a122 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:34.822834 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:34.827396 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 373/750] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Jul 18 16:28:34 2022] GET /identity/v3/role_assignments?user.id=251475c53ac64cd48ae84567d8c2ee87&scope.project.id=9d1d84bf334d47e6bfba1141c1fc6f59&role.id=fd83eab44cb343a2b532ce32a2ac31d8 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:34.828483 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ca3bc-c782-424f-92d0-0f992ef8a122 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:34.964656 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac271d73-4bec-4746-be2e-91a27628d314 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:34.997969 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ca3bc-c782-424f-92d0-0f992ef8a122 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:35.036221 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d1569-db17-44f9-b725-c43f8d96cd0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:35.037401 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d1569-db17-44f9-b725-c43f8d96cd0c None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:35.037788 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d1569-db17-44f9-b725-c43f8d96cd0c None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:35.038169 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d1569-db17-44f9-b725-c43f8d96cd0c None admin] PATH_INFO: `/v3/domains` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:35.039190 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9d1569-db17-44f9-b725-c43f8d96cd0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:35.039730 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9d1569-db17-44f9-b725-c43f8d96cd0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:35.041225 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9d1569-db17-44f9-b725-c43f8d96cd0c None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:35.055767 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 374/751] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:28:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:35.064828 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d1569-db17-44f9-b725-c43f8d96cd0c None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:35.085856 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd030f74-f304-497a-a0f4-802cf26e5b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:35.087392 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd030f74-f304-497a-a0f4-802cf26e5b76 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:35.088105 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd030f74-f304-497a-a0f4-802cf26e5b76 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:35.088750 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd030f74-f304-497a-a0f4-802cf26e5b76 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:35.119863 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd030f74-f304-497a-a0f4-802cf26e5b76 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:35.122898 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd030f74-f304-497a-a0f4-802cf26e5b76 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:35.151899 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-dd030f74-f304-497a-a0f4-802cf26e5b76 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 16:28:35.151899 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:35.151899 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:35.151899 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:35.151899 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:35.151899 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:35.151899 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:35.151899 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:35.151899 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:35.151899 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:35.151899 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:35.151899 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:35.151899 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:28:35.151899 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:28:35.151899 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:28:35.151899 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:28:35.153657 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:35.153657 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:35.153657 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:28:35.153657 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:28:35.153657 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:28:35.153657 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:28:35.153657 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:35.153657 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:35.153657 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:35.153657 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:35.153657 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:35.153657 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:35.153657 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:35.153657 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:35.153657 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:35.153657 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:35.153657 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:35.153657 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:35.154771 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:35.154771 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:35.154771 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:28:35.154771 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:28:35.154771 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:28:35.154771 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:28:35.154771 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:28:35.154771 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:28:35.154771 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 16:28:35.154771 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:35.157012 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 378/752] 10.222.0.81 () {56 vars in 1093 bytes} [Mon Jul 18 16:28:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 418 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:35.165838 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd030f74-f304-497a-a0f4-802cf26e5b76 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:35.188121 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:35.220147 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:35.282757 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd030f74-f304-497a-a0f4-802cf26e5b76 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:35.315593 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d1569-db17-44f9-b725-c43f8d96cd0c None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:35.320984 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c5178-f727-4ef7-a1f1-40aa9d1e0796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:35.321733 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c5178-f727-4ef7-a1f1-40aa9d1e0796 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:35.322089 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c5178-f727-4ef7-a1f1-40aa9d1e0796 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:35.323253 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c5178-f727-4ef7-a1f1-40aa9d1e0796 None admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:35.324236 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0c5178-f727-4ef7-a1f1-40aa9d1e0796 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:35.325137 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0c5178-f727-4ef7-a1f1-40aa9d1e0796 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:35.326689 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0c5178-f727-4ef7-a1f1-40aa9d1e0796 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:35.347077 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 379/753] 10.222.0.81 () {56 vars in 1133 bytes} [Mon Jul 18 16:28:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:35.353006 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c5178-f727-4ef7-a1f1-40aa9d1e0796 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:35.398310 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504fcfb6-f503-4f5f-9f74-a2c1a967534b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:35.399433 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504fcfb6-f503-4f5f-9f74-a2c1a967534b None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:35.399952 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504fcfb6-f503-4f5f-9f74-a2c1a967534b None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:35.400424 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504fcfb6-f503-4f5f-9f74-a2c1a967534b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:35.408406 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504fcfb6-f503-4f5f-9f74-a2c1a967534b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:35.410175 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504fcfb6-f503-4f5f-9f74-a2c1a967534b None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:35.425552 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-504fcfb6-f503-4f5f-9f74-a2c1a967534b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 16:28:35.425552 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:35.425552 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:35.425552 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:35.425552 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:35.425552 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:35.425552 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:35.425552 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:35.425552 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:35.425552 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:35.425552 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:35.425552 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:35.425552 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:28:35.425552 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:28:35.425552 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:28:35.425552 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:28:35.426530 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:35.426530 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:35.426530 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:28:35.426530 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:28:35.426530 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:28:35.426530 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:28:35.426530 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:35.426530 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:35.426530 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:35.426530 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:35.426530 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:35.426530 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:35.426530 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:35.426530 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:35.426530 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:35.426530 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:35.426530 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:35.426530 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:35.427500 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:35.427500 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:35.427500 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:28:35.427500 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:28:35.427500 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:28:35.427500 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:28:35.427500 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:28:35.427500 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:28:35.427500 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 16:28:35.427500 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:35.430079 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 375/754] 10.222.0.81 () {56 vars in 1117 bytes} [Mon Jul 18 16:28:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:35.431516 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f2539-cb66-4c2e-8dce-b1b6f3d0f538 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:35.432047 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f2539-cb66-4c2e-8dce-b1b6f3d0f538 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:35.432151 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:35.432612 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f2539-cb66-4c2e-8dce-b1b6f3d0f538 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:35.438835 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 376/755] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:28:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:35.439936 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27f2539-cb66-4c2e-8dce-b1b6f3d0f538 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:35.471337 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c5178-f727-4ef7-a1f1-40aa9d1e0796 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:35.516068 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1243f22e-15d3-44bb-a19c-37d5163299f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:35.517422 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243f22e-15d3-44bb-a19c-37d5163299f9 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:35.517858 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243f22e-15d3-44bb-a19c-37d5163299f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:35.518416 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243f22e-15d3-44bb-a19c-37d5163299f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:35.532835 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1243f22e-15d3-44bb-a19c-37d5163299f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:35.535443 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1243f22e-15d3-44bb-a19c-37d5163299f9 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:35.557987 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-1243f22e-15d3-44bb-a19c-37d5163299f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:35.557987 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:35.557987 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:35.557987 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:35.557987 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:35.557987 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:35.557987 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:35.557987 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:35.557987 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:35.557987 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:35.557987 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:35.557987 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:35.557987 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:28:35.557987 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:28:35.557987 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:28:35.559722 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:28:35.559722 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:35.559722 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:35.559722 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:35.559722 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:35.559722 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:35.559722 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:35.559722 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:35.559722 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:35.559722 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:35.559722 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:35.559722 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:35.559722 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:35.559722 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:35.559722 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:35.559722 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:35.559722 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:35.560854 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:28:35.560854 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:28:35.560854 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:35.560854 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:35.567899 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 380/756] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:28:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:28:35.567899 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1eacd-9c7e-4100-935a-e397b6fb7d9c None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:35.567899 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1eacd-9c7e-4100-935a-e397b6fb7d9c None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:35.567899 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1eacd-9c7e-4100-935a-e397b6fb7d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:35.575009 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27f2539-cb66-4c2e-8dce-b1b6f3d0f538 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:35.586363 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-1bb1eacd-9c7e-4100-935a-e397b6fb7d9c None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:35.587661 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-1bb1eacd-9c7e-4100-935a-e397b6fb7d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:35.597711 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:35.613116 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa31c3-fab1-4aad-aa9e-5aa700e264b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:35.621871 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa31c3-fab1-4aad-aa9e-5aa700e264b5 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:35.621871 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa31c3-fab1-4aad-aa9e-5aa700e264b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:35.621871 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa31c3-fab1-4aad-aa9e-5aa700e264b5 None admin] PATH_INFO: `/v3/users` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:35.621871 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaa31c3-fab1-4aad-aa9e-5aa700e264b5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:35.621871 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaa31c3-fab1-4aad-aa9e-5aa700e264b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:35.621871 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaa31c3-fab1-4aad-aa9e-5aa700e264b5 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:35.642918 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 377/757] 10.222.0.81 () {56 vars in 1149 bytes} [Mon Jul 18 16:28:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:35.644086 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa31c3-fab1-4aad-aa9e-5aa700e264b5 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:35.668685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 381/758] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:28:35.669761 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1eacd-9c7e-4100-935a-e397b6fb7d9c None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:35.759660 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:35.762819 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa31c3-fab1-4aad-aa9e-5aa700e264b5 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:35.810756 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d85371-f655-46ef-8d7e-5814e51a3670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:35.811900 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d85371-f655-46ef-8d7e-5814e51a3670 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:35.812198 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d85371-f655-46ef-8d7e-5814e51a3670 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:35.812479 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d85371-f655-46ef-8d7e-5814e51a3670 None admin] PATH_INFO: `/v3/domains` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:35.813489 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d85371-f655-46ef-8d7e-5814e51a3670 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:35.813798 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d85371-f655-46ef-8d7e-5814e51a3670 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:35.815162 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d85371-f655-46ef-8d7e-5814e51a3670 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:35.815534 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1eacd-9c7e-4100-935a-e397b6fb7d9c None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:35.835314 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 378/759] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:28:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:35.835314 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d85371-f655-46ef-8d7e-5814e51a3670 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:35.866121 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0332f25-00d6-47b1-bcfd-e88ed887e373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:35.867191 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0332f25-00d6-47b1-bcfd-e88ed887e373 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:35.867479 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0332f25-00d6-47b1-bcfd-e88ed887e373 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:35.867785 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0332f25-00d6-47b1-bcfd-e88ed887e373 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:35.899962 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:35.965890 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d85371-f655-46ef-8d7e-5814e51a3670 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:35.971775 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0332f25-00d6-47b1-bcfd-e88ed887e373 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:35.973567 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0332f25-00d6-47b1-bcfd-e88ed887e373 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:36.015217 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13995ae-1cb5-4dd0-878e-d07ddd0cf1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:36.016632 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13995ae-1cb5-4dd0-878e-d07ddd0cf1ad None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:36.016924 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13995ae-1cb5-4dd0-878e-d07ddd0cf1ad None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:36.017499 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13995ae-1cb5-4dd0-878e-d07ddd0cf1ad None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:36.018201 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13995ae-1cb5-4dd0-878e-d07ddd0cf1ad None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:36.019576 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13995ae-1cb5-4dd0-878e-d07ddd0cf1ad None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:36.036502 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-b13995ae-1cb5-4dd0-878e-d07ddd0cf1ad None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 16:28:36.036502 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:36.036502 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 16:28:36.036502 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 16:28:36.036502 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 16:28:36.036502 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 16:28:36.036502 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 16:28:36.036502 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:28:36.036502 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 16:28:36.036502 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:36.036502 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 16:28:36.036502 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:36.036502 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:36.036502 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:36.036502 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:36.036502 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:36.037528 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:36.037528 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:36.037528 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:36.037528 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:36.037528 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:36.037528 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:36.037528 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:36.037528 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 16:28:36.037528 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 16:28:36.037528 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 16:28:36.037528 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 16:28:36.037528 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:36.037528 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:36.037528 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:36.037528 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:36.037528 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:36.038405 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:36.038405 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:36.038405 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:36.038405 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:36.038405 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:36.038405 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:36.038405 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:36.038405 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:36.038405 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:36.038405 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:36.038405 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:36.038405 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 16:28:36.038405 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:28:36.038405 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 16:28:36.038405 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:36.038405 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 379/760] 10.222.0.81 () {56 vars in 1129 bytes} [Mon Jul 18 16:28:35 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:36.039281 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13995ae-1cb5-4dd0-878e-d07ddd0cf1ad None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:36.040955 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:36.107054 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 382/761] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Jul 18 16:28:35 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 16:28:36.107054 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0332f25-00d6-47b1-bcfd-e88ed887e373 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:36.178251 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13995ae-1cb5-4dd0-878e-d07ddd0cf1ad None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:36.180522 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:36.220541 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0332f25-00d6-47b1-bcfd-e88ed887e373 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:36.220751 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d08f11-18c1-4e0d-b1ac-c7e578925d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:36.221407 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d08f11-18c1-4e0d-b1ac-c7e578925d1a None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:36.221685 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d08f11-18c1-4e0d-b1ac-c7e578925d1a None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:36.221954 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d08f11-18c1-4e0d-b1ac-c7e578925d1a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:36.235117 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d08f11-18c1-4e0d-b1ac-c7e578925d1a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:36.236782 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d08f11-18c1-4e0d-b1ac-c7e578925d1a None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:36.257036 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-f5d08f11-18c1-4e0d-b1ac-c7e578925d1a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:28:36.257036 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:36.257036 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:36.257036 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:36.257036 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:36.257036 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:36.257036 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:36.257036 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:36.257036 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:36.257036 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:36.257036 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:36.257036 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:36.257036 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:28:36.257036 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:28:36.257036 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:28:36.258253 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:28:36.258253 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:36.258253 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:36.258253 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:36.258253 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:36.258253 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:36.258253 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:36.258253 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:36.258253 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:36.258253 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:36.258253 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:36.258253 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:36.258253 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:36.258253 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:36.258253 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:36.258253 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:36.258253 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:36.259177 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:28:36.259177 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:28:36.259177 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:28:36.259177 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:28:36.259177 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:28:36.259177 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:28:36.259177 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:28:36.259177 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:36.260783 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc32f8d-1ef6-4632-b713-b82e7e3eb461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:36.261557 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc32f8d-1ef6-4632-b713-b82e7e3eb461 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:36.261964 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc32f8d-1ef6-4632-b713-b82e7e3eb461 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:36.262351 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc32f8d-1ef6-4632-b713-b82e7e3eb461 None admin] PATH_INFO: `/v3/services` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:36.263205 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc32f8d-1ef6-4632-b713-b82e7e3eb461 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:36.263323 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 380/762] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Jul 18 16:28:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:36.263675 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc32f8d-1ef6-4632-b713-b82e7e3eb461 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:36.264067 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d08f11-18c1-4e0d-b1ac-c7e578925d1a None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:36.265397 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc32f8d-1ef6-4632-b713-b82e7e3eb461 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:36.271157 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 383/763] 10.222.0.81 () {56 vars in 1124 bytes} [Mon Jul 18 16:28:36 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:36.272202 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc32f8d-1ef6-4632-b713-b82e7e3eb461 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:36.288089 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:36.377370 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d08f11-18c1-4e0d-b1ac-c7e578925d1a None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:36.399491 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc32f8d-1ef6-4632-b713-b82e7e3eb461 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:36.422759 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db45511-652c-445a-b70c-36072e2d828f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:36.423851 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db45511-652c-445a-b70c-36072e2d828f None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:36.424144 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db45511-652c-445a-b70c-36072e2d828f None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:36.424422 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db45511-652c-445a-b70c-36072e2d828f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:36.437050 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d904719-a7db-4529-9b28-28aca4406e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:36.437261 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db45511-652c-445a-b70c-36072e2d828f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:36.437939 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d904719-a7db-4529-9b28-28aca4406e09 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:36.438317 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d904719-a7db-4529-9b28-28aca4406e09 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:36.438602 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db45511-652c-445a-b70c-36072e2d828f None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:36.438764 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d904719-a7db-4529-9b28-28aca4406e09 None admin] PATH_INFO: `/v3/projects` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:36.439641 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d904719-a7db-4529-9b28-28aca4406e09 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:36.440070 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d904719-a7db-4529-9b28-28aca4406e09 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:36.442199 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d904719-a7db-4529-9b28-28aca4406e09 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:36.456677 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 384/764] 10.222.0.81 () {56 vars in 1148 bytes} [Mon Jul 18 16:28:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:36.457697 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d904719-a7db-4529-9b28-28aca4406e09 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:36.467555 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-8db45511-652c-445a-b70c-36072e2d828f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:36.467555 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:36.467555 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:36.467555 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:36.467555 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:36.467555 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:36.467555 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:36.467555 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:36.467555 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:36.467555 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:36.467555 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:36.467555 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:36.467555 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:28:36.467555 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:28:36.467555 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:28:36.469368 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:28:36.469368 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:36.469368 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:36.469368 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:36.469368 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:36.469368 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:36.469368 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:36.469368 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:36.469368 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:36.469368 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:36.469368 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:36.469368 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:36.469368 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:36.469368 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:36.469368 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:36.469368 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:36.469368 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:36.471319 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:28:36.471319 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:28:36.471319 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:36.471319 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:36.471319 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 381/765] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:28:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:36.480697 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db45511-652c-445a-b70c-36072e2d828f None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:36.502074 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:36.569440 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:36.598053 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d904719-a7db-4529-9b28-28aca4406e09 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:36.603435 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db45511-652c-445a-b70c-36072e2d828f None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:36.640191 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e9ad75-3a1d-4580-a5ac-f6e0fb41d3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:36.640384 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce26fc3e-3876-454b-8c38-0dd25d19f75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:36.640795 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce26fc3e-3876-454b-8c38-0dd25d19f75c None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:36.640997 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9ad75-3a1d-4580-a5ac-f6e0fb41d3a4 None admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:36.641095 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce26fc3e-3876-454b-8c38-0dd25d19f75c None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:36.641272 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9ad75-3a1d-4580-a5ac-f6e0fb41d3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:36.641379 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce26fc3e-3876-454b-8c38-0dd25d19f75c None admin] PATH_INFO: `/v3/services` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:36.641544 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9ad75-3a1d-4580-a5ac-f6e0fb41d3a4 None admin] PATH_INFO: `/v3/projects/9d1d84bf334d47e6bfba1141c1fc6f59/users/07f0c5bf1bee48a0bafdf7a9e4537c70/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:36.642030 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce26fc3e-3876-454b-8c38-0dd25d19f75c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:36.642335 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce26fc3e-3876-454b-8c38-0dd25d19f75c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:36.643506 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e9ad75-3a1d-4580-a5ac-f6e0fb41d3a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=9d1d84bf334d47e6bfba1141c1fc6f59, user_id=07f0c5bf1bee48a0bafdf7a9e4537c70, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:36.643701 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce26fc3e-3876-454b-8c38-0dd25d19f75c None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:36.644958 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e9ad75-3a1d-4580-a5ac-f6e0fb41d3a4 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:36.649538 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 385/766] 10.222.0.81 () {56 vars in 1124 bytes} [Mon Jul 18 16:28:36 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:36.650355 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce26fc3e-3876-454b-8c38-0dd25d19f75c None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:36.748955 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 382/767] 10.222.0.81 () {58 vars in 1439 bytes} [Mon Jul 18 16:28:36 2022] PUT /identity/v3/projects/9d1d84bf334d47e6bfba1141c1fc6f59/users/07f0c5bf1bee48a0bafdf7a9e4537c70/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:28:36.750725 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678b5a3-2d9a-415f-9f92-ca18166fffd1 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:36.751056 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678b5a3-2d9a-415f-9f92-ca18166fffd1 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:36.751339 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678b5a3-2d9a-415f-9f92-ca18166fffd1 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:36.752581 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce26fc3e-3876-454b-8c38-0dd25d19f75c None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:36.760203 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 383/768] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:28:36 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:36.761422 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7678b5a3-2d9a-415f-9f92-ca18166fffd1 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:36.798130 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d97d5fa-1d42-410e-ae95-9177807ef2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:36.799164 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d97d5fa-1d42-410e-ae95-9177807ef2c8 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:36.799335 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d97d5fa-1d42-410e-ae95-9177807ef2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:36.799754 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d97d5fa-1d42-410e-ae95-9177807ef2c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:36.804363 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d97d5fa-1d42-410e-ae95-9177807ef2c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:36.804363 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d97d5fa-1d42-410e-ae95-9177807ef2c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:36.804363 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d97d5fa-1d42-410e-ae95-9177807ef2c8 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:36.816277 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:36.824958 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 386/769] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:28:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:36.826703 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d7871-72b3-483b-a8f3-6edf062da8d6 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:36.827226 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d7871-72b3-483b-a8f3-6edf062da8d6 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:36.827724 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d7871-72b3-483b-a8f3-6edf062da8d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:36.849080 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-375d7871-72b3-483b-a8f3-6edf062da8d6 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:36.850824 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-375d7871-72b3-483b-a8f3-6edf062da8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:36.891002 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:36.927345 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7678b5a3-2d9a-415f-9f92-ca18166fffd1 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:36.932776 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 387/770] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:28:36.934428 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d7871-72b3-483b-a8f3-6edf062da8d6 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:36.981048 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f26a77-7950-40be-b56a-6d07cba04a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:36.982313 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f26a77-7950-40be-b56a-6d07cba04a6c None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:36.982867 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f26a77-7950-40be-b56a-6d07cba04a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:36.983358 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f26a77-7950-40be-b56a-6d07cba04a6c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:36.985291 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f26a77-7950-40be-b56a-6d07cba04a6c None admin] RBAC: Adding query filter params (interface=public, service_id=424f2162ece64e47b995eaf3df13947c, region_id=RegionOne) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:36.985827 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f26a77-7950-40be-b56a-6d07cba04a6c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:36.987960 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f26a77-7950-40be-b56a-6d07cba04a6c None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:37.001087 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 384/771] 10.222.0.81 () {56 vars in 1251 bytes} [Mon Jul 18 16:28:36 2022] GET /identity/v3/endpoints?service_id=424f2162ece64e47b995eaf3df13947c&interface=public®ion_id=RegionOne => generated 194 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:37.002682 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f26a77-7950-40be-b56a-6d07cba04a6c None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:37.055356 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d7871-72b3-483b-a8f3-6edf062da8d6 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:37.084141 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:37.097055 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70729b55-d8e2-4f00-8b04-cd0e84e2b0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:37.099169 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70729b55-d8e2-4f00-8b04-cd0e84e2b0d8 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:37.099691 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70729b55-d8e2-4f00-8b04-cd0e84e2b0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:37.100194 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70729b55-d8e2-4f00-8b04-cd0e84e2b0d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:37.110479 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70729b55-d8e2-4f00-8b04-cd0e84e2b0d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:37.113066 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70729b55-d8e2-4f00-8b04-cd0e84e2b0d8 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:37.131171 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-70729b55-d8e2-4f00-8b04-cd0e84e2b0d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:28:37.131171 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:37.131171 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:37.131171 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:37.131171 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:37.131171 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:37.131171 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:37.131171 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:37.131171 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:37.131171 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:37.131171 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:37.131171 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:37.131171 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:28:37.131171 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:28:37.131171 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:28:37.132446 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:28:37.132446 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:37.132446 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:37.132446 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:37.132446 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:37.132446 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:37.132446 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:37.132446 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:37.132446 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:37.132446 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:37.132446 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:37.132446 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:37.132446 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:37.132446 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:37.132446 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:37.132446 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:37.132446 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:37.133393 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:28:37.133393 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:28:37.133393 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:28:37.133393 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:28:37.133393 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:28:37.133393 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:28:37.133393 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:28:37.133393 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:37.135998 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 388/772] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Jul 18 16:28:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:37.137549 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70729b55-d8e2-4f00-8b04-cd0e84e2b0d8 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:37.149644 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f26a77-7950-40be-b56a-6d07cba04a6c None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:37.187494 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a84443-53f5-41ca-87f9-5457f53a33b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:37.188409 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a84443-53f5-41ca-87f9-5457f53a33b5 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:37.188693 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a84443-53f5-41ca-87f9-5457f53a33b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:37.188966 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a84443-53f5-41ca-87f9-5457f53a33b5 None admin] PATH_INFO: `/v3/services/network` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:37.189619 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a84443-53f5-41ca-87f9-5457f53a33b5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:37.190984 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a84443-53f5-41ca-87f9-5457f53a33b5 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:37.203203 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-b9a84443-53f5-41ca-87f9-5457f53a33b5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 16:28:37.203203 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:37.203203 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 16:28:37.203203 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 16:28:37.203203 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 16:28:37.203203 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 16:28:37.203203 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 16:28:37.203203 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:28:37.203203 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 16:28:37.203203 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:37.203203 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 16:28:37.203203 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:37.203203 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:37.203203 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:37.203203 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:37.203203 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:37.203203 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:37.204391 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:37.204391 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:37.204391 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:37.204391 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:37.204391 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:37.204391 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:37.204391 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 16:28:37.204391 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 16:28:37.204391 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 16:28:37.204391 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 16:28:37.204391 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:37.204391 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:37.204391 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:37.204391 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:37.204391 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:37.204391 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:37.205380 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:37.205380 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:37.205380 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:37.205380 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:37.205380 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:37.205380 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:37.205380 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:37.205380 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:37.205380 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:37.205380 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:37.205380 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 16:28:37.205380 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:28:37.205380 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 16:28:37.205380 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:37.205380 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 385/773] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Jul 18 16:28:37 2022] GET /identity/v3/services/network => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:37.206356 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14108377-5c52-43c2-aca0-e887e60e7a7b None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:37.206356 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14108377-5c52-43c2-aca0-e887e60e7a7b None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:37.206356 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14108377-5c52-43c2-aca0-e887e60e7a7b None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:37.207578 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 386/774] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:28:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:37.210925 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14108377-5c52-43c2-aca0-e887e60e7a7b None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:37.216022 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:37.255899 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70729b55-d8e2-4f00-8b04-cd0e84e2b0d8 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:37.293701 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa5645-b0e5-43b7-88a4-0e981eafce80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:37.294364 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa5645-b0e5-43b7-88a4-0e981eafce80 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:37.294648 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa5645-b0e5-43b7-88a4-0e981eafce80 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:37.294924 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa5645-b0e5-43b7-88a4-0e981eafce80 None admin] PATH_INFO: `/v3/services` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:37.295587 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aa5645-b0e5-43b7-88a4-0e981eafce80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:37.296960 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aa5645-b0e5-43b7-88a4-0e981eafce80 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:37.308208 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 389/775] 10.222.0.81 () {56 vars in 1087 bytes} [Mon Jul 18 16:28:37 2022] GET /identity/v3/services => generated 772 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:37.309030 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa5645-b0e5-43b7-88a4-0e981eafce80 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:37.330210 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14108377-5c52-43c2-aca0-e887e60e7a7b None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:37.370289 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1fa8f8-769a-4f60-a07f-5f776f4f64e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:37.371606 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1fa8f8-769a-4f60-a07f-5f776f4f64e7 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:37.371959 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1fa8f8-769a-4f60-a07f-5f776f4f64e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:37.372236 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1fa8f8-769a-4f60-a07f-5f776f4f64e7 None admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:37.373100 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1fa8f8-769a-4f60-a07f-5f776f4f64e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:37.373410 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1fa8f8-769a-4f60-a07f-5f776f4f64e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:37.374999 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1fa8f8-769a-4f60-a07f-5f776f4f64e7 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:37.393559 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 387/776] 10.222.0.81 () {56 vars in 1148 bytes} [Mon Jul 18 16:28:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:37.393559 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160bd454-87e6-4053-bf45-311e7c0f3dad None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:37.393559 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160bd454-87e6-4053-bf45-311e7c0f3dad None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:37.393559 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160bd454-87e6-4053-bf45-311e7c0f3dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:37.403161 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:37.412897 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-160bd454-87e6-4053-bf45-311e7c0f3dad None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:37.414501 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-160bd454-87e6-4053-bf45-311e7c0f3dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:37.478763 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa5645-b0e5-43b7-88a4-0e981eafce80 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:37.486830 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:37.505468 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 388/777] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:28:37.505468 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160bd454-87e6-4053-bf45-311e7c0f3dad None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:37.536633 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20261cd-c650-4b9c-a3d3-42ecf2cb00fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:37.537661 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20261cd-c650-4b9c-a3d3-42ecf2cb00fe None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:37.538159 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20261cd-c650-4b9c-a3d3-42ecf2cb00fe None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:37.539200 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20261cd-c650-4b9c-a3d3-42ecf2cb00fe None admin] PATH_INFO: `/v3/services` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:37.540438 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20261cd-c650-4b9c-a3d3-42ecf2cb00fe None admin] RBAC: Adding query filter params (name=network) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:37.540932 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20261cd-c650-4b9c-a3d3-42ecf2cb00fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:37.543479 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20261cd-c650-4b9c-a3d3-42ecf2cb00fe None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:37.550751 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 390/778] 10.222.0.81 () {56 vars in 1112 bytes} [Mon Jul 18 16:28:37 2022] GET /identity/v3/services?name=network => generated 124 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:37.552054 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20261cd-c650-4b9c-a3d3-42ecf2cb00fe None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:37.628387 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160bd454-87e6-4053-bf45-311e7c0f3dad None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:37.669571 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d31f52-faf5-4535-bf5f-30932dac5f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:37.670235 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d31f52-faf5-4535-bf5f-30932dac5f79 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:37.670580 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d31f52-faf5-4535-bf5f-30932dac5f79 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:37.670923 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d31f52-faf5-4535-bf5f-30932dac5f79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:37.671841 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d31f52-faf5-4535-bf5f-30932dac5f79 None admin] RBAC: Adding query filter params (role.id=a716f51ae5b44c918918ed808ad2b2b0, scope.project.id=9d1d84bf334d47e6bfba1141c1fc6f59, user.id=ea2a096c4b964f03aed533d1e5e96db7) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:37.672235 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d31f52-faf5-4535-bf5f-30932dac5f79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:37.673767 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d31f52-faf5-4535-bf5f-30932dac5f79 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:37.680528 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 389/779] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Jul 18 16:28:37 2022] GET /identity/v3/role_assignments?user.id=ea2a096c4b964f03aed533d1e5e96db7&scope.project.id=9d1d84bf334d47e6bfba1141c1fc6f59&role.id=a716f51ae5b44c918918ed808ad2b2b0 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:37.681340 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d31f52-faf5-4535-bf5f-30932dac5f79 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:37.689866 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20261cd-c650-4b9c-a3d3-42ecf2cb00fe None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:37.720096 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:37.741298 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d13e963-1ddc-4c6f-9cd6-50a1b1f1d2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:37.742124 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d13e963-1ddc-4c6f-9cd6-50a1b1f1d2d4 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:37.742401 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d13e963-1ddc-4c6f-9cd6-50a1b1f1d2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:37.742673 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d13e963-1ddc-4c6f-9cd6-50a1b1f1d2d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:37.776451 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d13e963-1ddc-4c6f-9cd6-50a1b1f1d2d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:28:37.786808 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-9d13e963-1ddc-4c6f-9cd6-50a1b1f1d2d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:28:37.786808 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:37.786808 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:37.786808 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:37.786808 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:37.786808 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:37.786808 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:37.786808 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:37.786808 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:37.786808 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:37.786808 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:37.786808 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:37.786808 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:28:37.786808 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:28:37.786808 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:28:37.786808 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:28:37.787980 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:28:37.787980 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:28:37.787980 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:28:37.787980 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:28:37.787980 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:37.787980 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:37.787980 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:37.787980 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:37.787980 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:37.787980 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:37.787980 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:37.787980 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:37.787980 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:37.787980 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:37.787980 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:37.787980 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:37.788852 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:37.788852 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:37.788852 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:37.788852 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:37.788852 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:28:37.788852 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:28:37.788852 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:28:37.788852 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:28:37.788852 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:28:37.788852 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:28:37.788852 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:28:37.788852 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:37.794453 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 391/780] 10.222.0.81 () {56 vars in 1096 bytes} [Mon Jul 18 16:28:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:37.801165 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d13e963-1ddc-4c6f-9cd6-50a1b1f1d2d4 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:37.820001 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:37.886258 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d31f52-faf5-4535-bf5f-30932dac5f79 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:37.943659 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d13e963-1ddc-4c6f-9cd6-50a1b1f1d2d4 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:37.944454 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b55ea7b-81f3-46d7-b2d5-86ec5eb5e266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:37.945149 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55ea7b-81f3-46d7-b2d5-86ec5eb5e266 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:37.945433 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55ea7b-81f3-46d7-b2d5-86ec5eb5e266 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:37.945712 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55ea7b-81f3-46d7-b2d5-86ec5eb5e266 None admin] PATH_INFO: `/v3/services` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:37.946424 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b55ea7b-81f3-46d7-b2d5-86ec5eb5e266 None admin] RBAC: Adding query filter params (type=network) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:37.946734 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b55ea7b-81f3-46d7-b2d5-86ec5eb5e266 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:37.948157 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b55ea7b-81f3-46d7-b2d5-86ec5eb5e266 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:37.955496 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 390/781] 10.222.0.81 () {56 vars in 1112 bytes} [Mon Jul 18 16:28:37 2022] GET /identity/v3/services?type=network => generated 350 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:37.961151 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b55ea7b-81f3-46d7-b2d5-86ec5eb5e266 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:37.989531 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8403bcd6-e2d3-4a56-a2ef-a93f9d92982b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:37.990267 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403bcd6-e2d3-4a56-a2ef-a93f9d92982b None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:37.990549 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403bcd6-e2d3-4a56-a2ef-a93f9d92982b None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:37.990825 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403bcd6-e2d3-4a56-a2ef-a93f9d92982b None admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:37.991634 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8403bcd6-e2d3-4a56-a2ef-a93f9d92982b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:37.991972 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8403bcd6-e2d3-4a56-a2ef-a93f9d92982b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:37.993499 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8403bcd6-e2d3-4a56-a2ef-a93f9d92982b None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:38.016577 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 392/782] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Jul 18 16:28:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:38.022257 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8403bcd6-e2d3-4a56-a2ef-a93f9d92982b None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:38.099812 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:38.112702 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b55ea7b-81f3-46d7-b2d5-86ec5eb5e266 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:38.140319 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:38.164103 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cc730f-da0b-468d-8004-5dc33ca76f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:38.164793 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc730f-da0b-468d-8004-5dc33ca76f04 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:38.165077 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc730f-da0b-468d-8004-5dc33ca76f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:38.165352 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc730f-da0b-468d-8004-5dc33ca76f04 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:38.166152 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cc730f-da0b-468d-8004-5dc33ca76f04 None admin] RBAC: Adding query filter params (interface=public, service_id=12f72881399341308a98bf98067ae32d, region_id=RegionOne) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:38.166462 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cc730f-da0b-468d-8004-5dc33ca76f04 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:38.168026 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cc730f-da0b-468d-8004-5dc33ca76f04 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:38.185461 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 391/783] 10.222.0.81 () {56 vars in 1251 bytes} [Mon Jul 18 16:28:37 2022] GET /identity/v3/endpoints?service_id=12f72881399341308a98bf98067ae32d&interface=public®ion_id=RegionOne => generated 194 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:38.188042 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cc730f-da0b-468d-8004-5dc33ca76f04 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:38.232037 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8403bcd6-e2d3-4a56-a2ef-a93f9d92982b None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:38.306822 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce3cbd-9bc8-4449-b330-9e437b0dcf1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:38.307625 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce3cbd-9bc8-4449-b330-9e437b0dcf1c None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:38.307934 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce3cbd-9bc8-4449-b330-9e437b0dcf1c None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:38.308192 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce3cbd-9bc8-4449-b330-9e437b0dcf1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:38.330992 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ce3cbd-9bc8-4449-b330-9e437b0dcf1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:38.332475 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ce3cbd-9bc8-4449-b330-9e437b0dcf1c None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:38.366914 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-65ce3cbd-9bc8-4449-b330-9e437b0dcf1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:38.366914 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:38.366914 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:38.366914 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:38.366914 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:38.366914 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:38.366914 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:38.366914 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:38.366914 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:38.366914 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:38.366914 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:38.366914 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:38.366914 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:28:38.366914 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:28:38.366914 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:28:38.367928 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:28:38.367928 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:38.367928 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:38.367928 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:38.367928 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:38.367928 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:38.367928 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:38.367928 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:38.367928 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:38.367928 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:38.367928 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:38.367928 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:38.367928 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:38.367928 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:38.367928 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:38.367928 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:38.367928 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:38.368857 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:28:38.368857 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:28:38.368857 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:38.368857 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:38.368857 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 393/784] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:28:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:38.375028 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce3cbd-9bc8-4449-b330-9e437b0dcf1c None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:38.399059 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cc730f-da0b-468d-8004-5dc33ca76f04 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:38.471159 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e89e53e-41b5-4b83-8102-007e63cec023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:38.471860 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89e53e-41b5-4b83-8102-007e63cec023 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:38.472242 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89e53e-41b5-4b83-8102-007e63cec023 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:38.472524 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89e53e-41b5-4b83-8102-007e63cec023 None admin] PATH_INFO: `/v3/services` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:38.473258 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e89e53e-41b5-4b83-8102-007e63cec023 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:38.474640 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e89e53e-41b5-4b83-8102-007e63cec023 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:38.491895 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 392/785] 10.222.0.81 () {56 vars in 1087 bytes} [Mon Jul 18 16:28:38 2022] GET /identity/v3/services => generated 772 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:38.533308 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:38.544039 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce3cbd-9bc8-4449-b330-9e437b0dcf1c None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:38.585420 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5550e0-a757-4a6d-82ce-29d8d9c4e73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:38.586111 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5550e0-a757-4a6d-82ce-29d8d9c4e73a None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:38.586390 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5550e0-a757-4a6d-82ce-29d8d9c4e73a None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:38.586664 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5550e0-a757-4a6d-82ce-29d8d9c4e73a None admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:38.587409 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5550e0-a757-4a6d-82ce-29d8d9c4e73a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:38.587960 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5550e0-a757-4a6d-82ce-29d8d9c4e73a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:38.589386 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5550e0-a757-4a6d-82ce-29d8d9c4e73a None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:38.603627 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 394/786] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:28:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:38.609069 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e89e53e-41b5-4b83-8102-007e63cec023 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:38.700083 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:38.755634 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e89e53e-41b5-4b83-8102-007e63cec023 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:38.792225 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25557d1-cd70-4390-98ae-5c4df112fe87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:38.793806 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25557d1-cd70-4390-98ae-5c4df112fe87 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:38.794092 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25557d1-cd70-4390-98ae-5c4df112fe87 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:38.794365 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25557d1-cd70-4390-98ae-5c4df112fe87 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:38.802496 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25557d1-cd70-4390-98ae-5c4df112fe87 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:38.803973 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25557d1-cd70-4390-98ae-5c4df112fe87 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:38.818882 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-b25557d1-cd70-4390-98ae-5c4df112fe87 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 18 16:28:38.818882 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:38.818882 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:38.818882 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:38.818882 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:38.818882 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:38.818882 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:38.818882 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:38.818882 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:38.818882 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:38.818882 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:38.818882 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:38.818882 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:28:38.818882 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:28:38.818882 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:28:38.818882 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:28:38.819918 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:38.819918 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:38.819918 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:28:38.819918 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:28:38.819918 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:28:38.819918 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:28:38.819918 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:38.819918 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:38.819918 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:38.819918 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:38.819918 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:38.819918 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:38.819918 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:38.819918 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:38.819918 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:38.819918 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:38.819918 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:38.819918 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:38.820872 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:38.820872 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:38.820872 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:28:38.820872 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:28:38.820872 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:28:38.820872 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:28:38.820872 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:28:38.820872 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:28:38.820872 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 18 16:28:38.820872 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:38.820872 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 393/787] 10.222.0.81 () {56 vars in 1096 bytes} [Mon Jul 18 16:28:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:38.826746 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5550e0-a757-4a6d-82ce-29d8d9c4e73a None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:38.932933 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5550e0-a757-4a6d-82ce-29d8d9c4e73a None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:38.952060 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385387c-c075-4561-8afc-f769c71722ff None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:38.952683 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385387c-c075-4561-8afc-f769c71722ff None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:38.953155 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385387c-c075-4561-8afc-f769c71722ff None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:38.955038 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 394/788] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:28:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:28:38.960685 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655699d-86e4-4e67-9e24-d2c704d8eea5 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:38.961265 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655699d-86e4-4e67-9e24-d2c704d8eea5 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:38.961740 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655699d-86e4-4e67-9e24-d2c704d8eea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:38.981388 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-a655699d-86e4-4e67-9e24-d2c704d8eea5 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:38.982604 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf95948f-62ce-4283-81c0-bc67b5cc09c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:38.983697 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf95948f-62ce-4283-81c0-bc67b5cc09c1 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:38.984242 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf95948f-62ce-4283-81c0-bc67b5cc09c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:38.984713 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf95948f-62ce-4283-81c0-bc67b5cc09c1 None admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:38.985749 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf95948f-62ce-4283-81c0-bc67b5cc09c1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:38.987320 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-a655699d-86e4-4e67-9e24-d2c704d8eea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:38.987880 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf95948f-62ce-4283-81c0-bc67b5cc09c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:38.989566 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf95948f-62ce-4283-81c0-bc67b5cc09c1 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:39.017886 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 395/789] 10.222.0.81 () {56 vars in 1135 bytes} [Mon Jul 18 16:28:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:39.026606 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf95948f-62ce-4283-81c0-bc67b5cc09c1 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:39.038584 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:39.135439 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 395/790] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 16:28:39.163464 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a655699d-86e4-4e67-9e24-d2c704d8eea5 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:39.212241 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:39.227628 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf95948f-62ce-4283-81c0-bc67b5cc09c1 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:39.280887 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba3b59-3c74-4ccf-b987-e491b6529f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:39.281992 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba3b59-3c74-4ccf-b987-e491b6529f7e None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:39.282454 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba3b59-3c74-4ccf-b987-e491b6529f7e None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:39.282902 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba3b59-3c74-4ccf-b987-e491b6529f7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:39.295436 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ba3b59-3c74-4ccf-b987-e491b6529f7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:39.297408 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ba3b59-3c74-4ccf-b987-e491b6529f7e None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:39.323371 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-18ba3b59-3c74-4ccf-b987-e491b6529f7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:39.323371 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:39.323371 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:39.323371 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:39.323371 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:39.323371 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:39.323371 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:39.323371 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:39.323371 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:39.323371 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:39.323371 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:39.323371 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:39.323371 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:28:39.323371 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:28:39.323371 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:28:39.324458 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:28:39.324458 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:39.324458 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:39.324458 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:39.324458 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:39.324458 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:39.324458 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:39.324458 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:39.324458 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:39.324458 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:39.324458 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:39.324458 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:39.324458 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:39.324458 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:39.324458 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:39.324458 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:39.324458 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:39.325399 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:28:39.325399 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:28:39.325399 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:39.325399 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:39.333714 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a655699d-86e4-4e67-9e24-d2c704d8eea5 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:39.334170 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 396/791] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:28:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:39.336181 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba3b59-3c74-4ccf-b987-e491b6529f7e None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:39.412583 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c15246c-0f9c-4a45-9632-c851b5412602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:39.416922 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15246c-0f9c-4a45-9632-c851b5412602 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:39.417371 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15246c-0f9c-4a45-9632-c851b5412602 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:39.418349 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15246c-0f9c-4a45-9632-c851b5412602 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:39.442936 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c15246c-0f9c-4a45-9632-c851b5412602 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:28:39.455044 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-5c15246c-0f9c-4a45-9632-c851b5412602 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:28:39.455044 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:39.455044 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:39.455044 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:39.455044 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:39.455044 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:39.455044 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:39.455044 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:39.455044 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:39.455044 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:39.455044 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:39.455044 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:39.455044 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:28:39.455044 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:28:39.455044 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:28:39.455044 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:28:39.456253 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:28:39.456253 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:28:39.456253 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:28:39.456253 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:28:39.456253 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:39.456253 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:39.456253 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:39.456253 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:39.456253 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:39.456253 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:39.456253 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:39.456253 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:39.456253 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:39.456253 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:39.456253 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:39.456253 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:39.457289 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:39.457289 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:39.457289 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:39.457289 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:39.457289 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:28:39.457289 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:28:39.457289 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:28:39.457289 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:28:39.457289 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:28:39.457289 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:28:39.457289 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:28:39.457289 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:39.465882 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:39.467014 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 396/792] 10.222.0.81 () {56 vars in 1096 bytes} [Mon Jul 18 16:28:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:39.485383 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c15246c-0f9c-4a45-9632-c851b5412602 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:39.567882 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba3b59-3c74-4ccf-b987-e491b6529f7e None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:39.608917 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:39.613775 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c15246c-0f9c-4a45-9632-c851b5412602 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:39.646788 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd9d074-bbd5-4e11-a6fa-5c54b8b99499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:39.647456 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9d074-bbd5-4e11-a6fa-5c54b8b99499 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:39.647757 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9d074-bbd5-4e11-a6fa-5c54b8b99499 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:39.648034 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9d074-bbd5-4e11-a6fa-5c54b8b99499 None admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:39.648854 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd9d074-bbd5-4e11-a6fa-5c54b8b99499 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:39.649170 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd9d074-bbd5-4e11-a6fa-5c54b8b99499 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:39.650644 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd9d074-bbd5-4e11-a6fa-5c54b8b99499 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:39.652070 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8fed37-3453-4c38-9ace-2bf3ed849b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:39.652739 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8fed37-3453-4c38-9ace-2bf3ed849b19 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:39.653019 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8fed37-3453-4c38-9ace-2bf3ed849b19 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:39.653294 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8fed37-3453-4c38-9ace-2bf3ed849b19 None admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:39.654099 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8fed37-3453-4c38-9ace-2bf3ed849b19 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:39.654402 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8fed37-3453-4c38-9ace-2bf3ed849b19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:39.655813 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8fed37-3453-4c38-9ace-2bf3ed849b19 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:39.662821 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 397/793] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:28:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:39.664196 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3fc51-ae2c-430f-8769-2c3abe571321 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:39.664488 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3fc51-ae2c-430f-8769-2c3abe571321 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:39.664602 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 397/794] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Jul 18 16:28:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:28:39.664770 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3fc51-ae2c-430f-8769-2c3abe571321 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:39.666254 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 398/795] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:28:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:39.669968 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8fed37-3453-4c38-9ace-2bf3ed849b19 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:39.673056 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb56b2-d0df-4ff7-9b47-1e6359ae1e1c None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:39.673348 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb56b2-d0df-4ff7-9b47-1e6359ae1e1c None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:39.673624 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb56b2-d0df-4ff7-9b47-1e6359ae1e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:39.690651 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-53fb56b2-d0df-4ff7-9b47-1e6359ae1e1c None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:39.691875 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-53fb56b2-d0df-4ff7-9b47-1e6359ae1e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:39.783740 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 399/796] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:28:39.785014 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb56b2-d0df-4ff7-9b47-1e6359ae1e1c None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:39.794242 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8fed37-3453-4c38-9ace-2bf3ed849b19 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:39.848992 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:39.850341 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c6066-c763-4594-900a-f3c6db6f24d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:39.851150 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c6066-c763-4594-900a-f3c6db6f24d1 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:39.851429 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c6066-c763-4594-900a-f3c6db6f24d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:39.851725 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c6066-c763-4594-900a-f3c6db6f24d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:39.870655 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0c6066-c763-4594-900a-f3c6db6f24d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:39.872863 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0c6066-c763-4594-900a-f3c6db6f24d1 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:39.897022 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-5e0c6066-c763-4594-900a-f3c6db6f24d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:39.897022 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:39.897022 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:39.897022 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:39.897022 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:39.897022 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:39.897022 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:39.897022 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:39.897022 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:39.897022 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:39.897022 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:39.897022 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:39.897022 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:28:39.897022 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:28:39.897022 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:28:39.898229 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:28:39.898229 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:39.898229 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:39.898229 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:39.898229 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:39.898229 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:39.898229 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:39.898229 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:39.898229 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:39.898229 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:39.898229 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:39.898229 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:39.898229 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:39.898229 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:39.898229 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:39.898229 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:39.898229 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:39.899352 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:28:39.899352 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:28:39.899352 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:39.899352 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:39.903124 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 398/797] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:28:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:28:39.908369 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c6066-c763-4594-900a-f3c6db6f24d1 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:39.912650 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb56b2-d0df-4ff7-9b47-1e6359ae1e1c None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:39.926828 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:39.950783 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28678a06-685d-47d7-8cea-f9cc66216df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:39.951584 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28678a06-685d-47d7-8cea-f9cc66216df9 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:39.951895 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28678a06-685d-47d7-8cea-f9cc66216df9 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:39.952188 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28678a06-685d-47d7-8cea-f9cc66216df9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:39.960269 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28678a06-685d-47d7-8cea-f9cc66216df9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:39.965653 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28678a06-685d-47d7-8cea-f9cc66216df9 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:39.977685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-28678a06-685d-47d7-8cea-f9cc66216df9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:28:39.977685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:39.977685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:39.977685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:39.977685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:39.977685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:39.977685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:39.977685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:39.977685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:39.977685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:39.977685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:39.977685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:39.977685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:28:39.977685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:28:39.977685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:28:39.978734 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:28:39.978734 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:39.978734 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:39.978734 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:39.978734 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:39.978734 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:39.978734 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:39.978734 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:39.978734 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:39.978734 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:39.978734 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:39.978734 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:39.978734 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:39.978734 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:39.978734 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:39.978734 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:39.978734 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:39.980148 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:28:39.980148 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:28:39.980148 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:28:39.980148 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:28:39.980148 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:28:39.980148 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:28:39.980148 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:28:39.980148 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:39.980148 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 400/798] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Jul 18 16:28:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:39.980148 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28678a06-685d-47d7-8cea-f9cc66216df9 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:40.040244 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c6066-c763-4594-900a-f3c6db6f24d1 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:40.077126 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b9b148-0692-4836-a066-b518e397e423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:40.077942 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9b148-0692-4836-a066-b518e397e423 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:40.078220 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9b148-0692-4836-a066-b518e397e423 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:40.078492 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9b148-0692-4836-a066-b518e397e423 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:40.079147 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b9b148-0692-4836-a066-b518e397e423 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:40.080545 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b9b148-0692-4836-a066-b518e397e423 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:40.093507 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-b5b9b148-0692-4836-a066-b518e397e423 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 16:28:40.093507 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:40.093507 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 16:28:40.093507 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 16:28:40.093507 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 16:28:40.093507 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 16:28:40.093507 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 16:28:40.093507 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:28:40.093507 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 16:28:40.093507 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:40.093507 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 16:28:40.093507 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:40.093507 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:40.093507 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:40.093507 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:40.093507 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:40.095965 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:40.095965 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:40.095965 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:40.095965 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:40.095965 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:40.095965 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:40.095965 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:40.095965 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 16:28:40.095965 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 16:28:40.095965 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 16:28:40.095965 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 16:28:40.095965 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:40.095965 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:40.095965 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:40.095965 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:40.095965 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:40.098121 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:40.098121 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:40.098121 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:40.098121 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:40.098121 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:40.098121 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:40.098121 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:40.098121 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:40.098121 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:40.098121 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:40.098121 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:40.098121 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 16:28:40.098121 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:28:40.098121 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 16:28:40.098121 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:40.098121 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 399/799] 10.222.0.81 () {56 vars in 1129 bytes} [Mon Jul 18 16:28:39 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:40.100358 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b9b148-0692-4836-a066-b518e397e423 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:40.106309 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28678a06-685d-47d7-8cea-f9cc66216df9 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:40.119551 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:40.151746 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba85da9-9e71-459d-a46d-5b708a623494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:40.153694 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba85da9-9e71-459d-a46d-5b708a623494 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:40.154130 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba85da9-9e71-459d-a46d-5b708a623494 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:40.154569 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba85da9-9e71-459d-a46d-5b708a623494 None admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:40.155434 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba85da9-9e71-459d-a46d-5b708a623494 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:40.155927 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba85da9-9e71-459d-a46d-5b708a623494 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:40.158183 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba85da9-9e71-459d-a46d-5b708a623494 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:40.174544 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 401/800] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:28:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:40.175639 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba85da9-9e71-459d-a46d-5b708a623494 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:40.181479 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:40.206819 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b9b148-0692-4836-a066-b518e397e423 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:40.244621 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d24dc-55b9-4bdf-893a-44e3d8027113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:40.245603 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d24dc-55b9-4bdf-893a-44e3d8027113 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:40.245929 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d24dc-55b9-4bdf-893a-44e3d8027113 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:40.246209 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d24dc-55b9-4bdf-893a-44e3d8027113 None admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:40.247014 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6d24dc-55b9-4bdf-893a-44e3d8027113 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:40.247326 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6d24dc-55b9-4bdf-893a-44e3d8027113 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:40.248790 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6d24dc-55b9-4bdf-893a-44e3d8027113 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:40.267775 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 400/801] 10.222.0.81 () {56 vars in 1148 bytes} [Mon Jul 18 16:28:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:40.267775 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd15fca-d4f3-43e5-8699-d5b9afece092 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:40.267775 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd15fca-d4f3-43e5-8699-d5b9afece092 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:40.267775 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd15fca-d4f3-43e5-8699-d5b9afece092 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:40.267775 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 401/802] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:28:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:40.267775 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd15fca-d4f3-43e5-8699-d5b9afece092 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:40.306843 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba85da9-9e71-459d-a46d-5b708a623494 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:40.342941 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c07709d-4961-4d20-bb2d-e51ff35d81c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:40.343614 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07709d-4961-4d20-bb2d-e51ff35d81c8 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:40.343951 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07709d-4961-4d20-bb2d-e51ff35d81c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:40.344220 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07709d-4961-4d20-bb2d-e51ff35d81c8 None admin] PATH_INFO: `/v3/services` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:40.344924 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c07709d-4961-4d20-bb2d-e51ff35d81c8 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:40.345232 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c07709d-4961-4d20-bb2d-e51ff35d81c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:40.346683 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c07709d-4961-4d20-bb2d-e51ff35d81c8 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:40.351565 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 402/803] 10.222.0.81 () {56 vars in 1124 bytes} [Mon Jul 18 16:28:40 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:40.352302 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c07709d-4961-4d20-bb2d-e51ff35d81c8 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:40.384368 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd15fca-d4f3-43e5-8699-d5b9afece092 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:40.392807 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:40.421374 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27eff79-a9eb-4326-9331-e3fa5fc9e3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:40.422266 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27eff79-a9eb-4326-9331-e3fa5fc9e3a6 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:40.422622 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27eff79-a9eb-4326-9331-e3fa5fc9e3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:40.423021 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27eff79-a9eb-4326-9331-e3fa5fc9e3a6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:40.425949 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:40.430919 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27eff79-a9eb-4326-9331-e3fa5fc9e3a6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:40.432599 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27eff79-a9eb-4326-9331-e3fa5fc9e3a6 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:40.448131 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-d27eff79-a9eb-4326-9331-e3fa5fc9e3a6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 16:28:40.448131 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:40.448131 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:40.448131 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:40.448131 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:40.448131 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:40.448131 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:40.448131 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:40.448131 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:40.448131 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:40.448131 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:40.448131 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:40.448131 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:28:40.448131 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:28:40.448131 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:28:40.448131 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:28:40.449373 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:40.449373 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:40.449373 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:28:40.449373 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:28:40.449373 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:28:40.449373 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:28:40.449373 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:40.449373 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:40.449373 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:40.449373 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:40.449373 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:40.449373 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:40.449373 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:40.449373 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:40.449373 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:40.449373 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:40.449373 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:40.449373 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:40.450516 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:40.450516 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:40.450516 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:28:40.450516 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:28:40.450516 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:28:40.450516 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:28:40.450516 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:28:40.450516 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:28:40.450516 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 16:28:40.450516 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:40.451444 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 402/804] 10.222.0.81 () {56 vars in 1093 bytes} [Mon Jul 18 16:28:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:40.452670 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ea341-0e8d-4eea-bead-ce2a444458d4 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:40.452963 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ea341-0e8d-4eea-bead-ce2a444458d4 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:40.453238 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ea341-0e8d-4eea-bead-ce2a444458d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:40.477581 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-3a2ea341-0e8d-4eea-bead-ce2a444458d4 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:40.478736 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c07709d-4961-4d20-bb2d-e51ff35d81c8 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:40.478853 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-3a2ea341-0e8d-4eea-bead-ce2a444458d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:40.516744 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7364e5-26c5-4e96-8f42-7ee89ca662d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:40.517631 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7364e5-26c5-4e96-8f42-7ee89ca662d1 None admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:40.517912 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7364e5-26c5-4e96-8f42-7ee89ca662d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:40.518182 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7364e5-26c5-4e96-8f42-7ee89ca662d1 None admin] PATH_INFO: `/v3/projects/9d1d84bf334d47e6bfba1141c1fc6f59/users/251475c53ac64cd48ae84567d8c2ee87/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:40.520173 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7364e5-26c5-4e96-8f42-7ee89ca662d1 None admin] RBAC: Authorizing `identity:create_grant(project_id=9d1d84bf334d47e6bfba1141c1fc6f59, user_id=251475c53ac64cd48ae84567d8c2ee87, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:40.521627 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7364e5-26c5-4e96-8f42-7ee89ca662d1 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:40.549034 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 403/805] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:28:40.550129 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ea341-0e8d-4eea-bead-ce2a444458d4 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:40.623763 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 403/806] 10.222.0.81 () {58 vars in 1439 bytes} [Mon Jul 18 16:28:40 2022] PUT /identity/v3/projects/9d1d84bf334d47e6bfba1141c1fc6f59/users/251475c53ac64cd48ae84567d8c2ee87/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:28:40.636774 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7364e5-26c5-4e96-8f42-7ee89ca662d1 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:40.664601 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ea341-0e8d-4eea-bead-ce2a444458d4 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:40.696167 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:40.706523 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b94feb5-94dc-469c-ad1c-a9ae28dd7a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:40.707222 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94feb5-94dc-469c-ad1c-a9ae28dd7a1d None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:40.707650 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94feb5-94dc-469c-ad1c-a9ae28dd7a1d None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:40.708078 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94feb5-94dc-469c-ad1c-a9ae28dd7a1d None admin] PATH_INFO: `/v3/services` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:40.708971 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b94feb5-94dc-469c-ad1c-a9ae28dd7a1d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:40.709437 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b94feb5-94dc-469c-ad1c-a9ae28dd7a1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:40.710934 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b94feb5-94dc-469c-ad1c-a9ae28dd7a1d None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:40.722462 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 404/807] 10.222.0.81 () {56 vars in 1124 bytes} [Mon Jul 18 16:28:40 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:40.729883 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b94feb5-94dc-469c-ad1c-a9ae28dd7a1d None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:40.782391 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:40.791067 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7364e5-26c5-4e96-8f42-7ee89ca662d1 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:40.834635 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b2717-575b-4257-8f30-4795ff965cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:40.838365 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b2717-575b-4257-8f30-4795ff965cf8 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:40.838365 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b2717-575b-4257-8f30-4795ff965cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:40.838365 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b2717-575b-4257-8f30-4795ff965cf8 None admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:40.838365 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304b2717-575b-4257-8f30-4795ff965cf8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:40.838780 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304b2717-575b-4257-8f30-4795ff965cf8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:40.840310 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304b2717-575b-4257-8f30-4795ff965cf8 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:40.856200 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b94feb5-94dc-469c-ad1c-a9ae28dd7a1d None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:40.861424 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 404/808] 10.222.0.81 () {56 vars in 1133 bytes} [Mon Jul 18 16:28:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:40.862249 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b2717-575b-4257-8f30-4795ff965cf8 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:40.900867 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24d4aec-497f-4e0f-8b1b-c92cbc9a9a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:40.901585 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d4aec-497f-4e0f-8b1b-c92cbc9a9a46 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:40.901863 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d4aec-497f-4e0f-8b1b-c92cbc9a9a46 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:40.902321 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d4aec-497f-4e0f-8b1b-c92cbc9a9a46 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:40.916512 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24d4aec-497f-4e0f-8b1b-c92cbc9a9a46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:28:40.927338 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-e24d4aec-497f-4e0f-8b1b-c92cbc9a9a46 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:28:40.927338 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:40.927338 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:40.927338 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:40.927338 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:40.927338 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:40.927338 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:40.927338 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:40.927338 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:40.927338 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:40.927338 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:40.927338 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:40.927338 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:28:40.927338 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:28:40.927338 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:28:40.927338 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:28:40.929419 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:28:40.929419 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:28:40.929419 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:28:40.929419 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:28:40.929419 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:40.929419 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:40.929419 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:40.929419 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:40.929419 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:40.929419 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:40.929419 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:40.929419 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:40.929419 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:40.929419 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:40.929419 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:40.929419 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:40.931248 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:40.931248 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:40.931248 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:40.931248 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:40.931248 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:28:40.931248 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:28:40.931248 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:28:40.931248 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:28:40.931248 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:28:40.931248 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:28:40.931248 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:28:40.931248 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:40.933693 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 405/809] 10.222.0.81 () {56 vars in 1102 bytes} [Mon Jul 18 16:28:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:40.935077 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24d4aec-497f-4e0f-8b1b-c92cbc9a9a46 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:40.972285 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b2717-575b-4257-8f30-4795ff965cf8 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:40.990920 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:41.012406 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714fa2bf-dae0-4a69-9f03-55cb134fb637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:41.015956 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714fa2bf-dae0-4a69-9f03-55cb134fb637 None admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:41.015956 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714fa2bf-dae0-4a69-9f03-55cb134fb637 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:41.015956 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714fa2bf-dae0-4a69-9f03-55cb134fb637 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:41.015956 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714fa2bf-dae0-4a69-9f03-55cb134fb637 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:41.016530 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714fa2bf-dae0-4a69-9f03-55cb134fb637 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:41.043985 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24d4aec-497f-4e0f-8b1b-c92cbc9a9a46 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:41.077013 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f87d58-9f88-4030-b326-7fcfc6730c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:41.077649 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f87d58-9f88-4030-b326-7fcfc6730c16 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:41.077927 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f87d58-9f88-4030-b326-7fcfc6730c16 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:41.078197 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f87d58-9f88-4030-b326-7fcfc6730c16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:41.152744 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f87d58-9f88-4030-b326-7fcfc6730c16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:41.154113 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f87d58-9f88-4030-b326-7fcfc6730c16 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:41.194847 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 405/810] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Jul 18 16:28:40 2022] POST /identity/v3/endpoints => generated 346 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:28:41.196835 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613cdbe-b476-424c-bc20-315415886ac2 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:41.197346 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613cdbe-b476-424c-bc20-315415886ac2 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:41.197628 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613cdbe-b476-424c-bc20-315415886ac2 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:41.199283 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 406/811] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:28:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:41.200048 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a613cdbe-b476-424c-bc20-315415886ac2 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:41.210513 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:41.234446 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:41.275822 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 406/812] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Jul 18 16:28:40 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 16:28:41.277863 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b843cf5-cc28-43a7-838b-7273baefdfa2 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:41.278154 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b843cf5-cc28-43a7-838b-7273baefdfa2 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:41.278433 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b843cf5-cc28-43a7-838b-7273baefdfa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:41.301842 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-6b843cf5-cc28-43a7-838b-7273baefdfa2 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:41.303450 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-6b843cf5-cc28-43a7-838b-7273baefdfa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:41.387327 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a613cdbe-b476-424c-bc20-315415886ac2 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:41.393196 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 407/813] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:28:41.394304 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b843cf5-cc28-43a7-838b-7273baefdfa2 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:41.424834 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a05da30-4172-4efd-a85a-e1756ca0dd22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:41.425483 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a05da30-4172-4efd-a85a-e1756ca0dd22 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:41.425759 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a05da30-4172-4efd-a85a-e1756ca0dd22 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:41.426024 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a05da30-4172-4efd-a85a-e1756ca0dd22 None admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:41.427647 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a05da30-4172-4efd-a85a-e1756ca0dd22 None admin] RBAC: Adding query filter params (name=service) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:41.428040 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a05da30-4172-4efd-a85a-e1756ca0dd22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:41.429411 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a05da30-4172-4efd-a85a-e1756ca0dd22 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:41.440548 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 407/814] 10.222.0.81 () {56 vars in 1103 bytes} [Mon Jul 18 16:28:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:41.440548 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a05da30-4172-4efd-a85a-e1756ca0dd22 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:41.501427 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:41.524496 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b843cf5-cc28-43a7-838b-7273baefdfa2 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:41.525541 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:41.564534 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a05da30-4172-4efd-a85a-e1756ca0dd22 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:41.574951 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf9a5f0-9d63-4fb3-bf5a-b3dc18a3f614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:41.576139 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9a5f0-9d63-4fb3-bf5a-b3dc18a3f614 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:41.576139 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9a5f0-9d63-4fb3-bf5a-b3dc18a3f614 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:41.576328 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9a5f0-9d63-4fb3-bf5a-b3dc18a3f614 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:41.587505 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf9a5f0-9d63-4fb3-bf5a-b3dc18a3f614 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:41.589111 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf9a5f0-9d63-4fb3-bf5a-b3dc18a3f614 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:41.604811 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e19f5-e2a3-45de-b76c-ec48ac432012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:41.606596 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e19f5-e2a3-45de-b76c-ec48ac432012 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:41.607075 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e19f5-e2a3-45de-b76c-ec48ac432012 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:41.607544 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e19f5-e2a3-45de-b76c-ec48ac432012 None admin] PATH_INFO: `/v3/services/network` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:41.608423 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400e19f5-e2a3-45de-b76c-ec48ac432012 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:41.608611 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-ddf9a5f0-9d63-4fb3-bf5a-b3dc18a3f614 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:41.608611 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:41.608611 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:41.608611 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:41.608611 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:41.608611 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:41.608611 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:41.608611 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:41.608611 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:41.608611 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:41.608611 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:41.608611 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:41.608611 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:28:41.608611 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:28:41.608611 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:28:41.609471 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:28:41.609471 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:41.609471 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:41.609471 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:41.609471 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:41.609471 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:41.609471 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:41.609471 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:41.609471 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:41.609471 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:41.609471 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:41.609471 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:41.609471 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:41.609471 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:41.609471 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:41.609471 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:41.609471 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:41.610387 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:28:41.610387 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:28:41.610387 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:41.610387 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:41.610387 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 408/815] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:28:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:41.611154 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf9a5f0-9d63-4fb3-bf5a-b3dc18a3f614 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:41.613523 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400e19f5-e2a3-45de-b76c-ec48ac432012 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:41.629171 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-400e19f5-e2a3-45de-b76c-ec48ac432012 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 16:28:41.629171 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:41.629171 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 16:28:41.629171 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 16:28:41.629171 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 16:28:41.629171 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 16:28:41.629171 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 16:28:41.629171 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:28:41.629171 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 16:28:41.629171 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:41.629171 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 16:28:41.629171 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:41.629171 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:41.629171 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:41.629171 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:41.629171 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:41.629171 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:41.630236 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:41.630236 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:41.630236 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:41.630236 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:41.630236 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:41.630236 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:41.630236 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 16:28:41.630236 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 16:28:41.630236 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 16:28:41.630236 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 16:28:41.630236 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:41.630236 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:41.630236 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:41.630236 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:41.630236 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:41.630236 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:41.631107 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:41.631107 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:41.631107 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:41.631107 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:41.631107 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:41.631107 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:41.631107 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:41.631107 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:41.631107 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:41.631107 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:41.631107 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 16:28:41.631107 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:28:41.631107 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 16:28:41.631107 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:41.634284 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 408/816] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Jul 18 16:28:41 2022] GET /identity/v3/services/network => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:41.640210 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e19f5-e2a3-45de-b76c-ec48ac432012 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:41.720420 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf9a5f0-9d63-4fb3-bf5a-b3dc18a3f614 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:41.748207 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e19f5-e2a3-45de-b76c-ec48ac432012 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:41.752955 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:41.758482 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a662216c-06bc-4ba2-a73f-4977a6d6b6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:41.759038 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662216c-06bc-4ba2-a73f-4977a6d6b6dd None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:41.759328 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662216c-06bc-4ba2-a73f-4977a6d6b6dd None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:41.759606 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662216c-06bc-4ba2-a73f-4977a6d6b6dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:41.771511 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a662216c-06bc-4ba2-a73f-4977a6d6b6dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:41.773022 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a662216c-06bc-4ba2-a73f-4977a6d6b6dd None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:41.784109 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:41.788564 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a76be4-d2c5-49eb-ad3b-5641c03a0ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:41.789235 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a76be4-d2c5-49eb-ad3b-5641c03a0ffd None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:41.789510 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a76be4-d2c5-49eb-ad3b-5641c03a0ffd None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:41.789778 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a76be4-d2c5-49eb-ad3b-5641c03a0ffd None admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:41.790504 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a76be4-d2c5-49eb-ad3b-5641c03a0ffd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:41.790803 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a76be4-d2c5-49eb-ad3b-5641c03a0ffd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:41.792205 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a76be4-d2c5-49eb-ad3b-5641c03a0ffd None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:41.800686 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-a662216c-06bc-4ba2-a73f-4977a6d6b6dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:41.800686 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:41.800686 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:41.800686 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:41.800686 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:41.800686 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:41.800686 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:41.800686 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:41.800686 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:41.800686 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:41.800686 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:41.800686 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:41.800686 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:28:41.800686 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:28:41.800686 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:28:41.801629 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:28:41.801629 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:41.801629 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:41.801629 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:41.801629 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:41.801629 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:41.801629 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:41.801629 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:41.801629 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:41.801629 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:41.801629 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:41.801629 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:41.801629 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:41.801629 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:41.801629 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:41.801629 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:41.801629 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:41.802548 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:28:41.802548 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:28:41.802548 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:41.802548 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:41.802548 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 409/817] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:28:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:41.802548 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a662216c-06bc-4ba2-a73f-4977a6d6b6dd None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:41.809298 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 409/818] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:28:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:41.809905 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a76be4-d2c5-49eb-ad3b-5641c03a0ffd None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:41.921421 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a662216c-06bc-4ba2-a73f-4977a6d6b6dd None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:41.953511 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a76be4-d2c5-49eb-ad3b-5641c03a0ffd None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:41.962896 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f834c4-f093-47d0-acb9-23e1b58d1959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:41.963748 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f834c4-f093-47d0-acb9-23e1b58d1959 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:41.964129 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f834c4-f093-47d0-acb9-23e1b58d1959 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:41.965030 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f834c4-f093-47d0-acb9-23e1b58d1959 None admin] PATH_INFO: `/v3/services` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:41.965851 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f834c4-f093-47d0-acb9-23e1b58d1959 None admin] RBAC: Adding query filter params (name=network) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:41.966280 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f834c4-f093-47d0-acb9-23e1b58d1959 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:41.967788 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f834c4-f093-47d0-acb9-23e1b58d1959 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:41.973252 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 410/819] 10.222.0.81 () {56 vars in 1112 bytes} [Mon Jul 18 16:28:41 2022] GET /identity/v3/services?name=network => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:41.974350 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f834c4-f093-47d0-acb9-23e1b58d1959 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:41.998986 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8544df4-6ef2-4d97-96ba-1b58322576a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:41.999878 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8544df4-6ef2-4d97-96ba-1b58322576a8 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:42.000266 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8544df4-6ef2-4d97-96ba-1b58322576a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:42.000644 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8544df4-6ef2-4d97-96ba-1b58322576a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:42.001522 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8544df4-6ef2-4d97-96ba-1b58322576a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:42.001945 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8544df4-6ef2-4d97-96ba-1b58322576a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:42.003464 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8544df4-6ef2-4d97-96ba-1b58322576a8 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:42.021101 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 410/820] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:28:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:42.022143 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8544df4-6ef2-4d97-96ba-1b58322576a8 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:42.038631 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:42.082228 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:42.103992 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f834c4-f093-47d0-acb9-23e1b58d1959 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:42.141043 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cfebb1-a6f6-4de8-9888-34b97d1c6ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:42.141980 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cfebb1-a6f6-4de8-9888-34b97d1c6ca0 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:42.142351 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cfebb1-a6f6-4de8-9888-34b97d1c6ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:42.142779 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cfebb1-a6f6-4de8-9888-34b97d1c6ca0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:42.150546 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cfebb1-a6f6-4de8-9888-34b97d1c6ca0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:42.151118 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8544df4-6ef2-4d97-96ba-1b58322576a8 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:42.152740 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cfebb1-a6f6-4de8-9888-34b97d1c6ca0 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:42.169561 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-c0cfebb1-a6f6-4de8-9888-34b97d1c6ca0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:28:42.169561 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:42.169561 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:42.169561 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:42.169561 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:42.169561 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:42.169561 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:42.169561 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:42.169561 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:42.169561 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:42.169561 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:42.169561 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:42.169561 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:28:42.169561 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:28:42.169561 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:28:42.170776 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:28:42.170776 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:42.170776 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:42.170776 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:42.170776 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:42.170776 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:42.170776 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:42.170776 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:42.170776 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:42.170776 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:42.170776 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:42.170776 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:42.170776 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:42.170776 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:42.170776 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:42.170776 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:42.170776 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:42.171900 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:28:42.171900 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:28:42.171900 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:28:42.171900 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:28:42.171900 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:28:42.171900 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:28:42.171900 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:28:42.171900 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:42.173058 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 411/821] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Jul 18 16:28:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:42.174031 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cfebb1-a6f6-4de8-9888-34b97d1c6ca0 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:42.197095 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924d42a5-dc1c-43ad-9031-0f0424f775b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:42.198318 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d42a5-dc1c-43ad-9031-0f0424f775b2 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:42.198952 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d42a5-dc1c-43ad-9031-0f0424f775b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:42.199702 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d42a5-dc1c-43ad-9031-0f0424f775b2 None admin] PATH_INFO: `/v3/services` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:42.201024 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924d42a5-dc1c-43ad-9031-0f0424f775b2 None admin] RBAC: Adding query filter params (type=network) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:42.201776 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924d42a5-dc1c-43ad-9031-0f0424f775b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:42.203972 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924d42a5-dc1c-43ad-9031-0f0424f775b2 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:42.217634 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 411/822] 10.222.0.81 () {56 vars in 1112 bytes} [Mon Jul 18 16:28:42 2022] GET /identity/v3/services?type=network => generated 350 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:42.218818 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924d42a5-dc1c-43ad-9031-0f0424f775b2 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:42.290293 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cfebb1-a6f6-4de8-9888-34b97d1c6ca0 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:42.303603 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:42.340527 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da83c1d0-c967-441a-a074-aa5b56c130f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:42.342328 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83c1d0-c967-441a-a074-aa5b56c130f8 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:42.342913 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83c1d0-c967-441a-a074-aa5b56c130f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:42.343366 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83c1d0-c967-441a-a074-aa5b56c130f8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:42.353785 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924d42a5-dc1c-43ad-9031-0f0424f775b2 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:42.356092 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da83c1d0-c967-441a-a074-aa5b56c130f8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:42.358664 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da83c1d0-c967-441a-a074-aa5b56c130f8 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:42.369999 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:42.380213 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-da83c1d0-c967-441a-a074-aa5b56c130f8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 16:28:42.380213 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:42.380213 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:42.380213 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:42.380213 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:42.380213 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:42.380213 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:42.380213 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:42.380213 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:42.380213 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:42.380213 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:42.380213 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:42.380213 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:28:42.380213 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:28:42.380213 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:28:42.380213 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:28:42.381197 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:42.381197 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:42.381197 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:28:42.381197 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:28:42.381197 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:28:42.381197 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:28:42.381197 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:42.381197 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:42.381197 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:42.381197 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:42.381197 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:42.381197 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:42.381197 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:42.381197 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:42.381197 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:42.381197 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:42.381197 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:42.381197 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:42.382430 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:42.382430 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:42.382430 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:28:42.382430 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:28:42.382430 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:28:42.382430 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:28:42.382430 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:28:42.382430 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:28:42.382430 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 16:28:42.382430 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:42.385878 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 412/823] 10.222.0.81 () {56 vars in 1117 bytes} [Mon Jul 18 16:28:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:42.387048 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da83c1d0-c967-441a-a074-aa5b56c130f8 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:42.400880 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077804e2-d495-4718-bc2a-1fe81ad56611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:42.401544 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077804e2-d495-4718-bc2a-1fe81ad56611 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:42.401819 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077804e2-d495-4718-bc2a-1fe81ad56611 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:42.402391 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077804e2-d495-4718-bc2a-1fe81ad56611 None admin] PATH_INFO: `/v3/projects` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:42.402982 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077804e2-d495-4718-bc2a-1fe81ad56611 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:42.403285 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077804e2-d495-4718-bc2a-1fe81ad56611 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:42.404833 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077804e2-d495-4718-bc2a-1fe81ad56611 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:42.418303 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 412/824] 10.222.0.81 () {56 vars in 1148 bytes} [Mon Jul 18 16:28:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:42.419154 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077804e2-d495-4718-bc2a-1fe81ad56611 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:42.522118 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da83c1d0-c967-441a-a074-aa5b56c130f8 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:42.558257 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077804e2-d495-4718-bc2a-1fe81ad56611 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:42.558445 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c29c177-d59d-4d09-89c6-a356f664fdb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:42.559077 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29c177-d59d-4d09-89c6-a356f664fdb9 None admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:42.559514 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29c177-d59d-4d09-89c6-a356f664fdb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:42.559960 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29c177-d59d-4d09-89c6-a356f664fdb9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:42.560828 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c29c177-d59d-4d09-89c6-a356f664fdb9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:42.562464 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c29c177-d59d-4d09-89c6-a356f664fdb9 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:42.599851 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c96fc3-cf90-4b89-8c6d-454a64480df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:42.600534 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c96fc3-cf90-4b89-8c6d-454a64480df5 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:42.600813 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c96fc3-cf90-4b89-8c6d-454a64480df5 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:42.601085 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c96fc3-cf90-4b89-8c6d-454a64480df5 None admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:42.601918 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c96fc3-cf90-4b89-8c6d-454a64480df5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:42.602229 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c96fc3-cf90-4b89-8c6d-454a64480df5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:42.603758 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c96fc3-cf90-4b89-8c6d-454a64480df5 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:42.624815 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 413/825] 10.222.0.81 () {56 vars in 1149 bytes} [Mon Jul 18 16:28:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:42.628425 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c96fc3-cf90-4b89-8c6d-454a64480df5 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:42.661173 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 413/826] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Jul 18 16:28:42 2022] POST /identity/v3/endpoints => generated 327 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:28:42.662419 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c29c177-d59d-4d09-89c6-a356f664fdb9 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:42.666972 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:42.696328 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:42.804803 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c96fc3-cf90-4b89-8c6d-454a64480df5 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:42.835029 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c29c177-d59d-4d09-89c6-a356f664fdb9 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:42.848314 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632e866c-4009-49f1-91b6-b43775632bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:42.849339 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e866c-4009-49f1-91b6-b43775632bd0 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:42.849834 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e866c-4009-49f1-91b6-b43775632bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:42.850355 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e866c-4009-49f1-91b6-b43775632bd0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:42.851410 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632e866c-4009-49f1-91b6-b43775632bd0 None admin] RBAC: Adding query filter params (role.id=fd83eab44cb343a2b532ce32a2ac31d8, scope.project.id=9d1d84bf334d47e6bfba1141c1fc6f59, user.id=07f0c5bf1bee48a0bafdf7a9e4537c70) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:42.851959 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632e866c-4009-49f1-91b6-b43775632bd0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:42.853618 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632e866c-4009-49f1-91b6-b43775632bd0 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:42.860699 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 414/827] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Jul 18 16:28:42 2022] GET /identity/v3/role_assignments?user.id=07f0c5bf1bee48a0bafdf7a9e4537c70&scope.project.id=9d1d84bf334d47e6bfba1141c1fc6f59&role.id=fd83eab44cb343a2b532ce32a2ac31d8 => generated 608 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:42.862352 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23df8e-5c88-4fe8-a2f2-7921e2f0b6f9 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:42.862845 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23df8e-5c88-4fe8-a2f2-7921e2f0b6f9 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:42.863336 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23df8e-5c88-4fe8-a2f2-7921e2f0b6f9 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:42.865231 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 415/828] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:28:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:42.874752 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3aa04-41d7-42c9-84c9-4e32bf8b6af4 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:42.875429 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3aa04-41d7-42c9-84c9-4e32bf8b6af4 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:42.875954 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3aa04-41d7-42c9-84c9-4e32bf8b6af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:42.885622 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa5b50-0dc0-45bd-8241-fbb438d1b42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:42.886510 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa5b50-0dc0-45bd-8241-fbb438d1b42d None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:42.886795 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa5b50-0dc0-45bd-8241-fbb438d1b42d None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:42.887071 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa5b50-0dc0-45bd-8241-fbb438d1b42d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:42.897369 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-4bb3aa04-41d7-42c9-84c9-4e32bf8b6af4 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:42.899050 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-4bb3aa04-41d7-42c9-84c9-4e32bf8b6af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:42.900875 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fa5b50-0dc0-45bd-8241-fbb438d1b42d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:42.903159 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fa5b50-0dc0-45bd-8241-fbb438d1b42d None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:42.926128 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-92fa5b50-0dc0-45bd-8241-fbb438d1b42d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:42.926128 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:42.926128 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:42.926128 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:42.926128 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:42.926128 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:42.926128 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:42.926128 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:42.926128 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:42.926128 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:42.926128 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:42.926128 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:42.926128 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:28:42.926128 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:28:42.926128 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:28:42.927556 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:28:42.927556 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:42.927556 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:42.927556 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:42.927556 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:42.927556 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:42.927556 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:42.927556 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:42.927556 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:42.927556 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:42.927556 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:42.927556 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:42.927556 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:42.927556 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:42.927556 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:42.927556 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:42.927556 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:42.928629 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:28:42.928629 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:28:42.928629 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:42.928629 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:42.928629 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 414/829] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:28:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:42.935838 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa5b50-0dc0-45bd-8241-fbb438d1b42d None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:42.992392 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 416/830] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:42 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 16:28:43.026309 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:43.030292 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3aa04-41d7-42c9-84c9-4e32bf8b6af4 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:43.060186 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa5b50-0dc0-45bd-8241-fbb438d1b42d None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:43.078277 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:43.099592 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c1f61-de5a-4b38-9d89-2e928d399bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:43.100212 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c1f61-de5a-4b38-9d89-2e928d399bad None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:43.100495 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c1f61-de5a-4b38-9d89-2e928d399bad None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:43.100819 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c1f61-de5a-4b38-9d89-2e928d399bad None admin] PATH_INFO: `/v3/domains` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:43.101720 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4c1f61-de5a-4b38-9d89-2e928d399bad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:43.102029 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4c1f61-de5a-4b38-9d89-2e928d399bad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:43.103401 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4c1f61-de5a-4b38-9d89-2e928d399bad None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:43.117334 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 415/831] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:28:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:43.124290 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c1f61-de5a-4b38-9d89-2e928d399bad None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:43.178793 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3aa04-41d7-42c9-84c9-4e32bf8b6af4 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:43.235631 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7958adf-09c0-416d-8645-7db03d5e1225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:43.236471 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7958adf-09c0-416d-8645-7db03d5e1225 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:43.237013 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7958adf-09c0-416d-8645-7db03d5e1225 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:43.237013 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7958adf-09c0-416d-8645-7db03d5e1225 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:43.247729 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c1f61-de5a-4b38-9d89-2e928d399bad None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:43.247914 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7958adf-09c0-416d-8645-7db03d5e1225 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:28:43.255630 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-e7958adf-09c0-416d-8645-7db03d5e1225 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:28:43.255630 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:43.255630 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:43.255630 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:43.255630 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:43.255630 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:43.255630 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:43.255630 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:43.255630 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:43.255630 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:43.255630 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:43.255630 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:43.255630 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:28:43.255630 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:28:43.255630 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:28:43.255630 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:28:43.256724 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:28:43.256724 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:28:43.256724 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:28:43.256724 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:28:43.256724 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:43.256724 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:43.256724 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:43.256724 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:43.256724 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:43.256724 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:43.256724 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:43.256724 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:43.256724 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:43.256724 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:43.256724 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:43.256724 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:43.257844 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:43.257844 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:43.257844 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:43.257844 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:43.257844 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:28:43.257844 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:28:43.257844 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:28:43.257844 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:28:43.257844 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:28:43.257844 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:28:43.257844 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:28:43.257844 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:43.257844 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 417/832] 10.222.0.81 () {56 vars in 1096 bytes} [Mon Jul 18 16:28:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:43.265919 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7958adf-09c0-416d-8645-7db03d5e1225 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:43.289280 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:43.297243 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be230d90-db98-4267-b654-a52194c72eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:43.298348 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be230d90-db98-4267-b654-a52194c72eaa None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:43.298630 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be230d90-db98-4267-b654-a52194c72eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:43.299020 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be230d90-db98-4267-b654-a52194c72eaa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:43.306643 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be230d90-db98-4267-b654-a52194c72eaa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:43.308274 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be230d90-db98-4267-b654-a52194c72eaa None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:43.323555 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-be230d90-db98-4267-b654-a52194c72eaa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:28:43.323555 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:43.323555 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:43.323555 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:43.323555 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:43.323555 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:43.323555 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:43.323555 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:43.323555 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:43.323555 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:43.323555 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:43.323555 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:43.323555 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:28:43.323555 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:28:43.323555 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:28:43.328919 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:28:43.328919 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:43.328919 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:43.328919 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:43.328919 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:43.328919 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:43.328919 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:43.328919 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:43.328919 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:43.328919 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:43.328919 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:43.328919 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:43.328919 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:43.328919 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:43.328919 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:43.328919 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:43.328919 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:43.329834 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:28:43.329834 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:28:43.329834 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:28:43.329834 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:28:43.329834 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:28:43.329834 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:28:43.329834 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:28:43.329834 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:43.329834 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 416/833] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Jul 18 16:28:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:28:43.331891 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be230d90-db98-4267-b654-a52194c72eaa None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:43.380123 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:43.395458 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7958adf-09c0-416d-8645-7db03d5e1225 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:43.435192 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ed5ef-d758-416f-80f9-b98aba1da155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:43.435924 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ed5ef-d758-416f-80f9-b98aba1da155 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:43.436174 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ed5ef-d758-416f-80f9-b98aba1da155 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:43.436446 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ed5ef-d758-416f-80f9-b98aba1da155 None admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:43.437203 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2ed5ef-d758-416f-80f9-b98aba1da155 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:43.437537 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2ed5ef-d758-416f-80f9-b98aba1da155 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:43.438905 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2ed5ef-d758-416f-80f9-b98aba1da155 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:43.448229 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 418/834] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Jul 18 16:28:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:43.450129 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1543ba7a-922d-442a-a519-6e5af9e313df None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:43.450416 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1543ba7a-922d-442a-a519-6e5af9e313df None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:43.450691 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1543ba7a-922d-442a-a519-6e5af9e313df None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:43.452112 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 419/835] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:28:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:43.454963 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1543ba7a-922d-442a-a519-6e5af9e313df None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:43.457268 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be230d90-db98-4267-b654-a52194c72eaa None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:43.502324 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9694eeb0-3180-49f6-8ca7-dbd9b89eeb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:43.503306 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694eeb0-3180-49f6-8ca7-dbd9b89eeb36 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:43.503766 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694eeb0-3180-49f6-8ca7-dbd9b89eeb36 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:43.504051 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694eeb0-3180-49f6-8ca7-dbd9b89eeb36 None admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:43.504840 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9694eeb0-3180-49f6-8ca7-dbd9b89eeb36 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:43.505148 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9694eeb0-3180-49f6-8ca7-dbd9b89eeb36 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:43.506562 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9694eeb0-3180-49f6-8ca7-dbd9b89eeb36 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:43.519874 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 417/836] 10.222.0.81 () {56 vars in 1148 bytes} [Mon Jul 18 16:28:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:43.520980 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e89e66-fad2-49ac-82ec-6c4e6c501f01 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:43.521266 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e89e66-fad2-49ac-82ec-6c4e6c501f01 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:43.521540 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e89e66-fad2-49ac-82ec-6c4e6c501f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:43.542160 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-93e89e66-fad2-49ac-82ec-6c4e6c501f01 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:43.543468 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-93e89e66-fad2-49ac-82ec-6c4e6c501f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:43.569491 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1543ba7a-922d-442a-a519-6e5af9e313df None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:43.597159 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:43.604821 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af692cf1-437c-4074-8fca-c251dcce5c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:43.609833 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af692cf1-437c-4074-8fca-c251dcce5c72 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:43.609833 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af692cf1-437c-4074-8fca-c251dcce5c72 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:43.609833 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af692cf1-437c-4074-8fca-c251dcce5c72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:43.617838 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af692cf1-437c-4074-8fca-c251dcce5c72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:43.623965 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 418/837] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:43 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:28:43.623965 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e89e66-fad2-49ac-82ec-6c4e6c501f01 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:43.624216 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af692cf1-437c-4074-8fca-c251dcce5c72 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:43.639777 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:43.651136 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-af692cf1-437c-4074-8fca-c251dcce5c72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:43.651136 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:43.651136 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:43.651136 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:43.651136 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:43.651136 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:43.651136 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:43.651136 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:43.651136 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:43.651136 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:43.651136 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:43.651136 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:43.651136 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:28:43.651136 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:28:43.651136 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:28:43.658138 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:28:43.658138 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:43.658138 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:43.658138 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:43.658138 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:43.658138 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:43.658138 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:43.658138 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:43.658138 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:43.658138 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:43.658138 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:43.658138 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:43.658138 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:43.658138 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:43.658138 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:43.658138 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:43.658138 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:43.659038 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:28:43.659038 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:28:43.659038 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:43.659038 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:43.659038 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 420/838] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:28:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:28:43.659038 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af692cf1-437c-4074-8fca-c251dcce5c72 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:43.735248 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e89e66-fad2-49ac-82ec-6c4e6c501f01 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:43.760467 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af692cf1-437c-4074-8fca-c251dcce5c72 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:43.772709 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51af1990-6cf9-4b00-8939-bccd7ac18950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:43.773600 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af1990-6cf9-4b00-8939-bccd7ac18950 None admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:43.773882 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af1990-6cf9-4b00-8939-bccd7ac18950 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:43.774162 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af1990-6cf9-4b00-8939-bccd7ac18950 None admin] PATH_INFO: `/v3/projects/9d1d84bf334d47e6bfba1141c1fc6f59/users/ea2a096c4b964f03aed533d1e5e96db7/roles/a716f51ae5b44c918918ed808ad2b2b0` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:43.790097 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51af1990-6cf9-4b00-8939-bccd7ac18950 None admin] RBAC: Authorizing `identity:create_grant(project_id=9d1d84bf334d47e6bfba1141c1fc6f59, user_id=ea2a096c4b964f03aed533d1e5e96db7, role_id=a716f51ae5b44c918918ed808ad2b2b0)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:43.791537 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51af1990-6cf9-4b00-8939-bccd7ac18950 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:43.795886 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e81137-b4d4-42f0-8c01-d6bac7137dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:43.796791 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e81137-b4d4-42f0-8c01-d6bac7137dca None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:43.797092 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e81137-b4d4-42f0-8c01-d6bac7137dca None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:43.797305 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e81137-b4d4-42f0-8c01-d6bac7137dca None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:43.797950 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e81137-b4d4-42f0-8c01-d6bac7137dca None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:43.799302 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e81137-b4d4-42f0-8c01-d6bac7137dca None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:43.811049 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-55e81137-b4d4-42f0-8c01-d6bac7137dca None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 16:28:43.811049 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:43.811049 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 16:28:43.811049 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 16:28:43.811049 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 16:28:43.811049 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 16:28:43.811049 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 16:28:43.811049 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:28:43.811049 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 16:28:43.811049 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:43.811049 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 16:28:43.811049 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:43.811049 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:43.811049 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:43.811049 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:43.811049 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:43.811049 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:43.812107 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:43.812107 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:43.812107 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:43.812107 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:43.812107 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:43.812107 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:43.812107 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 16:28:43.812107 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 16:28:43.812107 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 16:28:43.812107 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 16:28:43.812107 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:43.812107 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:43.812107 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:43.812107 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:43.812107 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:43.812107 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:43.812951 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:43.812951 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:43.812951 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:43.812951 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:43.812951 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:43.812951 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:43.812951 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:43.812951 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:43.812951 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:43.812951 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:43.812951 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 16:28:43.812951 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:28:43.812951 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 16:28:43.812951 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:43.812951 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 421/839] 10.222.0.81 () {56 vars in 1114 bytes} [Mon Jul 18 16:28:43 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:43.813759 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e81137-b4d4-42f0-8c01-d6bac7137dca None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:43.874743 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:43.888165 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 419/840] 10.222.0.81 () {58 vars in 1439 bytes} [Mon Jul 18 16:28:43 2022] PUT /identity/v3/projects/9d1d84bf334d47e6bfba1141c1fc6f59/users/ea2a096c4b964f03aed533d1e5e96db7/roles/a716f51ae5b44c918918ed808ad2b2b0 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:28:43.889621 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51af1990-6cf9-4b00-8939-bccd7ac18950 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:43.917139 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e81137-b4d4-42f0-8c01-d6bac7137dca None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:43.939559 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:43.956789 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0ebee-cd51-4420-8425-7fbe7c668c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:43.957466 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0ebee-cd51-4420-8425-7fbe7c668c47 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:43.957768 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0ebee-cd51-4420-8425-7fbe7c668c47 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:43.958029 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0ebee-cd51-4420-8425-7fbe7c668c47 None admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:43.958817 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b0ebee-cd51-4420-8425-7fbe7c668c47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:43.959140 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b0ebee-cd51-4420-8425-7fbe7c668c47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:43.960616 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b0ebee-cd51-4420-8425-7fbe7c668c47 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:43.981946 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 422/841] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:28:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:43.983344 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0ebee-cd51-4420-8425-7fbe7c668c47 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:44.052498 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51af1990-6cf9-4b00-8939-bccd7ac18950 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:44.098757 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3038383-d0fa-4e17-8926-03b68f55fac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:44.100389 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3038383-d0fa-4e17-8926-03b68f55fac1 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:44.100896 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3038383-d0fa-4e17-8926-03b68f55fac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:44.101391 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3038383-d0fa-4e17-8926-03b68f55fac1 None admin] PATH_INFO: `/v3/services` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:44.102146 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0ebee-cd51-4420-8425-7fbe7c668c47 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:44.102855 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3038383-d0fa-4e17-8926-03b68f55fac1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:44.103382 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3038383-d0fa-4e17-8926-03b68f55fac1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:44.105981 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3038383-d0fa-4e17-8926-03b68f55fac1 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:44.112115 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 420/842] 10.222.0.81 () {56 vars in 1114 bytes} [Mon Jul 18 16:28:43 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:44.119275 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3038383-d0fa-4e17-8926-03b68f55fac1 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:44.138284 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:44.149545 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a6397-bde5-4d1e-bebc-cbda1ea240df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:44.150731 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a6397-bde5-4d1e-bebc-cbda1ea240df None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:44.151180 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a6397-bde5-4d1e-bebc-cbda1ea240df None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:44.151752 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a6397-bde5-4d1e-bebc-cbda1ea240df None admin] PATH_INFO: `/v3/users/swift` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:44.160294 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400a6397-bde5-4d1e-bebc-cbda1ea240df None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:44.162079 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400a6397-bde5-4d1e-bebc-cbda1ea240df None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:44.178445 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-400a6397-bde5-4d1e-bebc-cbda1ea240df None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 18 16:28:44.178445 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:44.178445 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:44.178445 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:44.178445 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:44.178445 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:44.178445 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:44.178445 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:44.178445 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:44.178445 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:44.178445 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:44.178445 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:44.178445 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:28:44.178445 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:28:44.178445 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:28:44.178445 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:28:44.179483 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:44.179483 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:44.179483 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:28:44.179483 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:28:44.179483 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:28:44.179483 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:28:44.179483 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:44.179483 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:44.179483 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:44.179483 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:44.179483 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:44.179483 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:44.179483 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:44.179483 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:44.179483 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:44.179483 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:44.179483 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:44.179483 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:44.180524 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:44.180524 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:44.180524 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:28:44.180524 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:28:44.180524 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:28:44.180524 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:28:44.180524 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:28:44.180524 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:28:44.180524 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 18 16:28:44.180524 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:44.182925 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 423/843] 10.222.0.81 () {56 vars in 1096 bytes} [Mon Jul 18 16:28:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:44.188616 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a6397-bde5-4d1e-bebc-cbda1ea240df None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:44.232321 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:44.239118 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3038383-d0fa-4e17-8926-03b68f55fac1 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:44.278454 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff731690-7c42-4b3f-9f3a-02ae04700f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:44.279249 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff731690-7c42-4b3f-9f3a-02ae04700f58 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:44.279538 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff731690-7c42-4b3f-9f3a-02ae04700f58 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:44.279843 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff731690-7c42-4b3f-9f3a-02ae04700f58 None admin] PATH_INFO: `/v3/services` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:44.280551 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff731690-7c42-4b3f-9f3a-02ae04700f58 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:44.280855 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff731690-7c42-4b3f-9f3a-02ae04700f58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:44.282336 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff731690-7c42-4b3f-9f3a-02ae04700f58 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:44.287759 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 421/844] 10.222.0.81 () {56 vars in 1114 bytes} [Mon Jul 18 16:28:44 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:28:44.314196 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a6397-bde5-4d1e-bebc-cbda1ea240df None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:44.351130 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc07ae-f35a-4d5f-8f3f-1de41637567c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:44.351860 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc07ae-f35a-4d5f-8f3f-1de41637567c None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:44.352140 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc07ae-f35a-4d5f-8f3f-1de41637567c None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:44.352414 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc07ae-f35a-4d5f-8f3f-1de41637567c None admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:44.353261 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abc07ae-f35a-4d5f-8f3f-1de41637567c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:44.353570 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abc07ae-f35a-4d5f-8f3f-1de41637567c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:44.355070 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abc07ae-f35a-4d5f-8f3f-1de41637567c None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:44.376994 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 424/845] 10.222.0.81 () {56 vars in 1135 bytes} [Mon Jul 18 16:28:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:28:44.383122 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff731690-7c42-4b3f-9f3a-02ae04700f58 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:44.494521 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff731690-7c42-4b3f-9f3a-02ae04700f58 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:44.530569 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba47ddb-25a8-4a0c-9108-9bc9bc287d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:44.531227 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba47ddb-25a8-4a0c-9108-9bc9bc287d68 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:44.531510 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba47ddb-25a8-4a0c-9108-9bc9bc287d68 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:44.531812 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba47ddb-25a8-4a0c-9108-9bc9bc287d68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:44.564235 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:44.603546 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba47ddb-25a8-4a0c-9108-9bc9bc287d68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:44.605072 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba47ddb-25a8-4a0c-9108-9bc9bc287d68 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:44.709092 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 422/846] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Jul 18 16:28:44 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 16:28:44.714804 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc07ae-f35a-4d5f-8f3f-1de41637567c None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:44.763018 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:44.829053 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc07ae-f35a-4d5f-8f3f-1de41637567c None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:44.871880 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d680c2e1-442c-410f-9dbc-4e77b39b6fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:44.872701 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680c2e1-442c-410f-9dbc-4e77b39b6fd1 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:44.872983 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680c2e1-442c-410f-9dbc-4e77b39b6fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:44.873258 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680c2e1-442c-410f-9dbc-4e77b39b6fd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:44.884960 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d680c2e1-442c-410f-9dbc-4e77b39b6fd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:44.886456 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d680c2e1-442c-410f-9dbc-4e77b39b6fd1 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:44.910908 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-d680c2e1-442c-410f-9dbc-4e77b39b6fd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:44.910908 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:44.910908 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:44.910908 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:44.910908 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:44.910908 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:44.910908 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:44.910908 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:44.910908 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:44.910908 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:44.910908 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:44.910908 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:44.910908 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:28:44.910908 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:28:44.910908 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:28:44.911927 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:28:44.911927 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:44.911927 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:44.911927 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:44.911927 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:44.911927 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:44.911927 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:44.911927 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:44.911927 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:44.911927 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:44.911927 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:44.911927 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:44.911927 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:44.911927 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:44.911927 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:44.911927 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:44.911927 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:44.912872 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:28:44.912872 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:28:44.912872 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:44.912872 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:44.912872 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 425/847] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:28:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:44.917966 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba47ddb-25a8-4a0c-9108-9bc9bc287d68 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:44.980247 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:45.023328 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba47ddb-25a8-4a0c-9108-9bc9bc287d68 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:45.061363 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997616a8-a898-4159-a325-9ab81bce44a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:45.062037 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997616a8-a898-4159-a325-9ab81bce44a1 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:45.062319 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997616a8-a898-4159-a325-9ab81bce44a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:45.062595 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997616a8-a898-4159-a325-9ab81bce44a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:45.063327 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997616a8-a898-4159-a325-9ab81bce44a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:45.063630 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997616a8-a898-4159-a325-9ab81bce44a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:45.065046 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997616a8-a898-4159-a325-9ab81bce44a1 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:45.077276 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a4838-fe18-4abf-a310-d159c0cbce4f None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:45.077589 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a4838-fe18-4abf-a310-d159c0cbce4f None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:45.077822 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a4838-fe18-4abf-a310-d159c0cbce4f None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:45.078899 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 423/848] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:28:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:45.079581 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 426/849] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:28:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:45.085131 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919bbf4-7130-4fe7-9a6c-348409944307 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:45.085419 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919bbf4-7130-4fe7-9a6c-348409944307 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:45.085740 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919bbf4-7130-4fe7-9a6c-348409944307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:45.088212 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6a4838-fe18-4abf-a310-d159c0cbce4f None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:45.104566 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-2919bbf4-7130-4fe7-9a6c-348409944307 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:45.106651 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-2919bbf4-7130-4fe7-9a6c-348409944307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:45.181574 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 424/850] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:45 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 16:28:45.210482 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2919bbf4-7130-4fe7-9a6c-348409944307 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:45.211062 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:45.219526 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6a4838-fe18-4abf-a310-d159c0cbce4f None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:45.259787 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f5578-5e0a-4e4a-80fc-89b2847e80cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:45.260511 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f5578-5e0a-4e4a-80fc-89b2847e80cf None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:45.260792 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f5578-5e0a-4e4a-80fc-89b2847e80cf None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:45.261066 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f5578-5e0a-4e4a-80fc-89b2847e80cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:45.269047 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344f5578-5e0a-4e4a-80fc-89b2847e80cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:45.270488 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344f5578-5e0a-4e4a-80fc-89b2847e80cf None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:45.284304 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:45.286722 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-344f5578-5e0a-4e4a-80fc-89b2847e80cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:28:45.286722 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:45.286722 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:45.286722 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:45.286722 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:45.286722 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:45.286722 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:45.286722 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:45.286722 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:45.286722 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:45.286722 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:45.286722 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:45.286722 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:28:45.286722 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:28:45.286722 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:28:45.287847 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:28:45.287847 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:45.287847 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:45.287847 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:45.287847 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:45.287847 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:45.287847 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:45.287847 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:45.287847 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:45.287847 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:45.287847 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:45.287847 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:45.287847 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:45.287847 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:45.287847 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:45.287847 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:45.287847 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:45.288939 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:28:45.288939 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:28:45.288939 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:28:45.288939 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:28:45.288939 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:28:45.288939 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:28:45.288939 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:28:45.288939 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:45.291452 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 427/851] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Jul 18 16:28:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:45.298432 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f5578-5e0a-4e4a-80fc-89b2847e80cf None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:45.373638 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2919bbf4-7130-4fe7-9a6c-348409944307 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:45.436734 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65119261-6072-4557-aebc-c2decc4f9d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:45.438267 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65119261-6072-4557-aebc-c2decc4f9d34 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:45.438840 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65119261-6072-4557-aebc-c2decc4f9d34 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:45.439413 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65119261-6072-4557-aebc-c2decc4f9d34 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:45.440772 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65119261-6072-4557-aebc-c2decc4f9d34 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:45.443481 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65119261-6072-4557-aebc-c2decc4f9d34 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:45.452920 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f5578-5e0a-4e4a-80fc-89b2847e80cf None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:45.468341 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-65119261-6072-4557-aebc-c2decc4f9d34 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 16:28:45.468341 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:45.468341 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 16:28:45.468341 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 16:28:45.468341 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 16:28:45.468341 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 16:28:45.468341 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 16:28:45.468341 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:28:45.468341 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 16:28:45.468341 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:45.468341 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 16:28:45.468341 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:45.468341 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:45.468341 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:45.468341 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:45.468341 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:45.470310 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:45.470310 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:45.470310 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:45.470310 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:45.470310 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:45.470310 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:45.470310 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:45.470310 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 16:28:45.470310 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 16:28:45.470310 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 16:28:45.470310 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 16:28:45.470310 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:45.470310 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:45.470310 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:45.470310 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:45.470310 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:45.472221 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:45.472221 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:45.472221 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:45.472221 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:45.472221 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:45.472221 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:45.472221 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:45.472221 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:45.472221 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:45.472221 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:45.472221 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:45.472221 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 16:28:45.472221 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:28:45.472221 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 16:28:45.472221 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:45.483747 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 425/852] 10.222.0.81 () {56 vars in 1132 bytes} [Mon Jul 18 16:28:45 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:45.483747 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65119261-6072-4557-aebc-c2decc4f9d34 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:45.496780 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39a5980-da51-4f3c-81c5-03409224b6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:45.497455 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a5980-da51-4f3c-81c5-03409224b6a5 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:45.497780 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a5980-da51-4f3c-81c5-03409224b6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:45.498033 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a5980-da51-4f3c-81c5-03409224b6a5 None admin] PATH_INFO: `/v3/projects` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:45.498838 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39a5980-da51-4f3c-81c5-03409224b6a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:45.499144 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39a5980-da51-4f3c-81c5-03409224b6a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:45.500754 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39a5980-da51-4f3c-81c5-03409224b6a5 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:45.515049 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 428/853] 10.222.0.81 () {56 vars in 1148 bytes} [Mon Jul 18 16:28:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:45.524396 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39a5980-da51-4f3c-81c5-03409224b6a5 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:45.541514 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:45.654550 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39a5980-da51-4f3c-81c5-03409224b6a5 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:45.676306 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65119261-6072-4557-aebc-c2decc4f9d34 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:45.700315 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd208f2-f548-4de4-b64c-c84428eaad70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:45.701316 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd208f2-f548-4de4-b64c-c84428eaad70 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:45.701807 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd208f2-f548-4de4-b64c-c84428eaad70 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:45.702306 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd208f2-f548-4de4-b64c-c84428eaad70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:45.703454 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd208f2-f548-4de4-b64c-c84428eaad70 None admin] RBAC: Adding query filter params (role.id=fd83eab44cb343a2b532ce32a2ac31d8, scope.project.id=9d1d84bf334d47e6bfba1141c1fc6f59, user.id=251475c53ac64cd48ae84567d8c2ee87) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:45.704006 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd208f2-f548-4de4-b64c-c84428eaad70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:45.705013 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:45.706988 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd208f2-f548-4de4-b64c-c84428eaad70 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:45.718943 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 429/854] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Jul 18 16:28:45 2022] GET /identity/v3/role_assignments?user.id=251475c53ac64cd48ae84567d8c2ee87&scope.project.id=9d1d84bf334d47e6bfba1141c1fc6f59&role.id=fd83eab44cb343a2b532ce32a2ac31d8 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:28:45.737599 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f278b53e-69ac-4d20-8dc0-ef794c71e3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:45.738294 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f278b53e-69ac-4d20-8dc0-ef794c71e3ac None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:45.738578 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f278b53e-69ac-4d20-8dc0-ef794c71e3ac None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:45.738853 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f278b53e-69ac-4d20-8dc0-ef794c71e3ac None admin] PATH_INFO: `/v3/services` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:45.739582 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f278b53e-69ac-4d20-8dc0-ef794c71e3ac None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:45.739927 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f278b53e-69ac-4d20-8dc0-ef794c71e3ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:45.741392 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f278b53e-69ac-4d20-8dc0-ef794c71e3ac None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:45.747360 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 426/855] 10.222.0.81 () {56 vars in 1126 bytes} [Mon Jul 18 16:28:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:28:45.754336 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd208f2-f548-4de4-b64c-c84428eaad70 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:45.846811 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:45.870748 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd208f2-f548-4de4-b64c-c84428eaad70 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:45.910987 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e4ce23-7b8e-4eaa-975b-a07683c86821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:45.911675 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4ce23-7b8e-4eaa-975b-a07683c86821 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:45.911977 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4ce23-7b8e-4eaa-975b-a07683c86821 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:45.912250 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4ce23-7b8e-4eaa-975b-a07683c86821 None admin] PATH_INFO: `/v3/services` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:45.912998 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e4ce23-7b8e-4eaa-975b-a07683c86821 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:45.913274 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e4ce23-7b8e-4eaa-975b-a07683c86821 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:45.914711 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e4ce23-7b8e-4eaa-975b-a07683c86821 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:45.920567 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 430/856] 10.222.0.81 () {56 vars in 1126 bytes} [Mon Jul 18 16:28:45 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:46.258580 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda93bee-8567-45e4-9caf-0e17c41968ed None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:46.259669 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda93bee-8567-45e4-9caf-0e17c41968ed None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:46.260188 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda93bee-8567-45e4-9caf-0e17c41968ed None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:46.262616 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 427/857] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:28:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:46.267802 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61e9be-365a-413e-9d7e-7b9d24d94ed6 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:46.268249 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61e9be-365a-413e-9d7e-7b9d24d94ed6 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:46.268344 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61e9be-365a-413e-9d7e-7b9d24d94ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:46.286101 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-2f61e9be-365a-413e-9d7e-7b9d24d94ed6 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:46.287286 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-2f61e9be-365a-413e-9d7e-7b9d24d94ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:46.359019 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 431/858] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:46 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 16:28:46.383165 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda93bee-8567-45e4-9caf-0e17c41968ed None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:46.473783 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c75928-458a-4fe4-8cd4-acc18d945db2 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:46.474111 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c75928-458a-4fe4-8cd4-acc18d945db2 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:46.474346 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c75928-458a-4fe4-8cd4-acc18d945db2 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:46.475999 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 432/859] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:28:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:46.481997 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b76fe-a84d-4ef2-8523-fd6dff5741ba None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:46.482280 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b76fe-a84d-4ef2-8523-fd6dff5741ba None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:46.482528 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b76fe-a84d-4ef2-8523-fd6dff5741ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:46.500492 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda93bee-8567-45e4-9caf-0e17c41968ed None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:46.502493 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-df4b76fe-a84d-4ef2-8523-fd6dff5741ba None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:46.504632 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-df4b76fe-a84d-4ef2-8523-fd6dff5741ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:46.538374 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0070b1-8b4d-4011-8aee-d09def16807d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:46.539098 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0070b1-8b4d-4011-8aee-d09def16807d None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:46.539383 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0070b1-8b4d-4011-8aee-d09def16807d None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:46.539803 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0070b1-8b4d-4011-8aee-d09def16807d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:46.552157 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0070b1-8b4d-4011-8aee-d09def16807d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:28:46.561230 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-ac0070b1-8b4d-4011-8aee-d09def16807d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:28:46.561230 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:46.561230 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:46.561230 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:46.561230 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:46.561230 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:46.561230 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:46.561230 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:46.561230 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:46.561230 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:46.561230 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:46.561230 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:46.561230 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:28:46.561230 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:28:46.561230 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:28:46.561230 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:28:46.562242 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:28:46.562242 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:28:46.562242 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:28:46.562242 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:28:46.562242 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:46.562242 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:46.562242 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:46.562242 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:46.562242 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:46.562242 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:46.562242 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:46.562242 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:46.562242 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:46.562242 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:46.562242 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:46.562242 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:46.563742 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:46.563742 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:46.563742 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:46.563742 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:46.563742 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:28:46.563742 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:28:46.563742 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:28:46.563742 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:28:46.563742 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:28:46.563742 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:28:46.563742 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:28:46.563742 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:46.568409 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 428/860] 10.222.0.81 () {56 vars in 1102 bytes} [Mon Jul 18 16:28:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:46.569635 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0070b1-8b4d-4011-8aee-d09def16807d None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:46.589458 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 433/861] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:46 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:28:46.612713 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b76fe-a84d-4ef2-8523-fd6dff5741ba None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:46.614902 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:46.622754 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:46.700092 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0070b1-8b4d-4011-8aee-d09def16807d None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:46.735531 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b76fe-a84d-4ef2-8523-fd6dff5741ba None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:46.740626 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecd8108-90a1-4d2c-85cf-a45829af7abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:46.741677 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd8108-90a1-4d2c-85cf-a45829af7abe None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:46.742173 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd8108-90a1-4d2c-85cf-a45829af7abe None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:46.742672 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd8108-90a1-4d2c-85cf-a45829af7abe None admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:46.743770 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecd8108-90a1-4d2c-85cf-a45829af7abe None admin] RBAC: Adding query filter params (name=service) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:46.744317 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecd8108-90a1-4d2c-85cf-a45829af7abe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:46.745968 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecd8108-90a1-4d2c-85cf-a45829af7abe None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:46.761672 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 429/862] 10.222.0.81 () {56 vars in 1103 bytes} [Mon Jul 18 16:28:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:46.762848 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecd8108-90a1-4d2c-85cf-a45829af7abe None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:46.772566 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb07127-45a6-45b0-84b8-db8daf736065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:46.773535 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb07127-45a6-45b0-84b8-db8daf736065 None admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:46.773535 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb07127-45a6-45b0-84b8-db8daf736065 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:46.773818 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb07127-45a6-45b0-84b8-db8daf736065 None admin] PATH_INFO: `/v3/services` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:46.774522 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb07127-45a6-45b0-84b8-db8daf736065 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:46.775950 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb07127-45a6-45b0-84b8-db8daf736065 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:46.866764 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 434/863] 10.222.0.81 () {60 vars in 1141 bytes} [Mon Jul 18 16:28:46 2022] POST /identity/v3/services => generated 251 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:28:46.873293 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:46.876918 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecd8108-90a1-4d2c-85cf-a45829af7abe None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:46.927929 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a79c5d-28f3-444a-9a0c-810cc5278be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:46.928741 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a79c5d-28f3-444a-9a0c-810cc5278be2 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:46.929020 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a79c5d-28f3-444a-9a0c-810cc5278be2 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:46.929293 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a79c5d-28f3-444a-9a0c-810cc5278be2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:46.941975 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a79c5d-28f3-444a-9a0c-810cc5278be2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:46.943514 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a79c5d-28f3-444a-9a0c-810cc5278be2 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:46.964392 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-49a79c5d-28f3-444a-9a0c-810cc5278be2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:46.964392 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:46.964392 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:46.964392 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:46.964392 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:46.964392 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:46.964392 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:46.964392 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:46.964392 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:46.964392 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:46.964392 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:46.964392 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:46.964392 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:28:46.964392 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:28:46.964392 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:28:46.965376 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:28:46.965376 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:46.965376 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:46.965376 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:46.965376 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:46.965376 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:46.965376 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:46.965376 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:46.965376 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:46.965376 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:46.965376 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:46.965376 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:46.965376 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:46.965376 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:46.965376 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:46.965376 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:46.965376 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:46.966351 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:28:46.966351 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:28:46.966351 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:46.966351 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:46.966351 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 430/864] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:28:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:46.971602 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb07127-45a6-45b0-84b8-db8daf736065 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:47.043432 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:47.088691 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb07127-45a6-45b0-84b8-db8daf736065 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:47.126306 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb2bdb8-1e16-4326-8c3f-271de77026ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:47.126905 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb2bdb8-1e16-4326-8c3f-271de77026ea None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:47.127190 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb2bdb8-1e16-4326-8c3f-271de77026ea None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:47.127469 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb2bdb8-1e16-4326-8c3f-271de77026ea None admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:47.128233 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb2bdb8-1e16-4326-8c3f-271de77026ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:47.128545 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb2bdb8-1e16-4326-8c3f-271de77026ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:47.129920 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb2bdb8-1e16-4326-8c3f-271de77026ea None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:47.144884 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 435/865] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:28:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:47.150497 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a79c5d-28f3-444a-9a0c-810cc5278be2 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:47.255639 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a79c5d-28f3-444a-9a0c-810cc5278be2 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:47.293182 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a17b67-d362-4bab-a4f1-c0171d385006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:47.294901 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a17b67-d362-4bab-a4f1-c0171d385006 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:47.295382 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a17b67-d362-4bab-a4f1-c0171d385006 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:47.295881 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a17b67-d362-4bab-a4f1-c0171d385006 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:47.303828 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a17b67-d362-4bab-a4f1-c0171d385006 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:47.305524 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a17b67-d362-4bab-a4f1-c0171d385006 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:47.321093 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-65a17b67-d362-4bab-a4f1-c0171d385006 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 16:28:47.321093 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:47.321093 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:47.321093 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:47.321093 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:47.321093 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:47.321093 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:47.321093 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:47.321093 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:47.321093 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:47.321093 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:47.321093 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:47.321093 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:28:47.321093 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:28:47.321093 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:28:47.321093 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:28:47.322091 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:47.322091 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:47.322091 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:28:47.322091 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:28:47.322091 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:28:47.322091 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:28:47.322091 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:47.322091 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:47.322091 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:47.322091 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:47.322091 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:47.322091 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:47.322091 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:47.322091 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:47.322091 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:47.322091 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:47.322091 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:47.322091 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:47.323043 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:47.323043 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:47.323043 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:28:47.323043 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:28:47.323043 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:28:47.323043 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:28:47.323043 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:28:47.323043 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:28:47.323043 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 16:28:47.323043 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:47.325697 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 431/866] 10.222.0.81 () {56 vars in 1117 bytes} [Mon Jul 18 16:28:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:47.331552 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb2bdb8-1e16-4326-8c3f-271de77026ea None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:47.438368 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb2bdb8-1e16-4326-8c3f-271de77026ea None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:47.468080 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:47.475356 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b785a9-3b7a-4e0f-b039-cdb696fe28cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:47.476786 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b785a9-3b7a-4e0f-b039-cdb696fe28cb None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:47.476786 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b785a9-3b7a-4e0f-b039-cdb696fe28cb None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:47.476786 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b785a9-3b7a-4e0f-b039-cdb696fe28cb None admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:47.477864 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b785a9-3b7a-4e0f-b039-cdb696fe28cb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:47.478266 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b785a9-3b7a-4e0f-b039-cdb696fe28cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:47.479847 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b785a9-3b7a-4e0f-b039-cdb696fe28cb None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:47.498691 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 436/867] 10.222.0.81 () {56 vars in 1149 bytes} [Mon Jul 18 16:28:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:47.504386 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a17b67-d362-4bab-a4f1-c0171d385006 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:47.516474 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:47.612380 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a17b67-d362-4bab-a4f1-c0171d385006 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:47.647908 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45893c10-b69c-400f-bfb8-b4cedc371846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:47.648629 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45893c10-b69c-400f-bfb8-b4cedc371846 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:47.648922 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45893c10-b69c-400f-bfb8-b4cedc371846 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:47.649203 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45893c10-b69c-400f-bfb8-b4cedc371846 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:47.725303 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45893c10-b69c-400f-bfb8-b4cedc371846 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:47.726757 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45893c10-b69c-400f-bfb8-b4cedc371846 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:47.737641 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:47.834885 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 432/868] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Jul 18 16:28:47 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 16:28:47.841011 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b785a9-3b7a-4e0f-b039-cdb696fe28cb None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:47.844927 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb054b-e11e-42bd-962b-e23e52ddd3da None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:47.845220 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb054b-e11e-42bd-962b-e23e52ddd3da None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:47.845499 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb054b-e11e-42bd-962b-e23e52ddd3da None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:47.848144 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 433/869] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:28:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:28:47.852398 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20c43b-b112-400a-90ac-354684349c7c None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:47.852688 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20c43b-b112-400a-90ac-354684349c7c None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:47.852968 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20c43b-b112-400a-90ac-354684349c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:47.873645 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-5c20c43b-b112-400a-90ac-354684349c7c None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:47.875068 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-5c20c43b-b112-400a-90ac-354684349c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:47.963910 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b785a9-3b7a-4e0f-b039-cdb696fe28cb None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:47.974995 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 434/870] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:47 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 16:28:47.986187 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b874af-644a-4bc3-bb01-f08a6806dbe1 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:47.986429 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b874af-644a-4bc3-bb01-f08a6806dbe1 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:47.986668 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b874af-644a-4bc3-bb01-f08a6806dbe1 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:47.988268 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 435/871] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:28:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:47.993426 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4982c9d-6458-4cca-a370-dfecd570bdcc None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:47.993716 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4982c9d-6458-4cca-a370-dfecd570bdcc None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:47.993993 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4982c9d-6458-4cca-a370-dfecd570bdcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:48.010377 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d417d5de-289d-4c68-802e-4656b32a6c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:48.011941 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d417d5de-289d-4c68-802e-4656b32a6c4c None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:48.012227 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d417d5de-289d-4c68-802e-4656b32a6c4c None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:48.012506 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d417d5de-289d-4c68-802e-4656b32a6c4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:48.015802 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-a4982c9d-6458-4cca-a370-dfecd570bdcc None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:48.016988 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-a4982c9d-6458-4cca-a370-dfecd570bdcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:48.025663 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d417d5de-289d-4c68-802e-4656b32a6c4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:48.027157 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d417d5de-289d-4c68-802e-4656b32a6c4c None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:48.045767 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-d417d5de-289d-4c68-802e-4656b32a6c4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:48.045767 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:48.045767 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:48.045767 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:48.045767 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:48.045767 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:48.045767 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:48.045767 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:48.045767 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:48.045767 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:48.045767 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:48.045767 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:48.045767 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:28:48.045767 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:28:48.045767 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:28:48.046742 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:28:48.046742 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:48.046742 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:48.046742 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:48.046742 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:48.046742 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:48.046742 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:48.046742 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:48.046742 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:48.046742 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:48.046742 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:48.046742 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:48.046742 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:48.046742 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:48.046742 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:48.046742 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:48.046742 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:48.047659 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:28:48.047659 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:28:48.047659 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:48.047659 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:48.047659 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 437/872] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:28:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:48.048001 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d417d5de-289d-4c68-802e-4656b32a6c4c None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:48.052065 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:48.085784 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:48.091041 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 436/873] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:47 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:28:48.092027 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4982c9d-6458-4cca-a370-dfecd570bdcc None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:48.173922 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d417d5de-289d-4c68-802e-4656b32a6c4c None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:48.211578 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9850610c-a370-4fc8-b67f-e332502763b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:48.212420 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850610c-a370-4fc8-b67f-e332502763b5 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:48.212699 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850610c-a370-4fc8-b67f-e332502763b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:48.212968 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850610c-a370-4fc8-b67f-e332502763b5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:48.213620 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9850610c-a370-4fc8-b67f-e332502763b5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:48.215493 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9850610c-a370-4fc8-b67f-e332502763b5 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:48.228760 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-9850610c-a370-4fc8-b67f-e332502763b5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 16:28:48.228760 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:48.228760 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 16:28:48.228760 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 16:28:48.228760 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 16:28:48.228760 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 16:28:48.228760 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 16:28:48.228760 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:28:48.228760 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 16:28:48.228760 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:48.228760 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 16:28:48.228760 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:48.228760 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:48.228760 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:48.228760 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:48.228760 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:48.228760 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:48.230624 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:48.230624 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:48.230624 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:48.230624 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:48.230624 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:48.230624 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:48.230624 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 16:28:48.230624 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 16:28:48.230624 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 16:28:48.230624 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 16:28:48.230624 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:48.230624 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:48.230624 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:48.230624 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:48.230624 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:48.230624 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:48.231790 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:48.231790 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:48.231790 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:48.231790 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:48.231790 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:48.231790 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:48.231790 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:48.231790 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:48.231790 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:48.231790 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:48.231790 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 16:28:48.231790 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:28:48.231790 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 16:28:48.231790 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:48.235210 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 438/874] 10.222.0.81 () {56 vars in 1126 bytes} [Mon Jul 18 16:28:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:48.235464 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4982c9d-6458-4cca-a370-dfecd570bdcc None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:48.236133 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9850610c-a370-4fc8-b67f-e332502763b5 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:48.293107 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958fa66-ccd7-4c25-93f2-fdbb6f153507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:48.294472 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958fa66-ccd7-4c25-93f2-fdbb6f153507 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:48.295840 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958fa66-ccd7-4c25-93f2-fdbb6f153507 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:48.296525 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958fa66-ccd7-4c25-93f2-fdbb6f153507 None admin] PATH_INFO: `/v3/domains` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:48.297938 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e958fa66-ccd7-4c25-93f2-fdbb6f153507 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:48.299210 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e958fa66-ccd7-4c25-93f2-fdbb6f153507 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:48.302243 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e958fa66-ccd7-4c25-93f2-fdbb6f153507 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:48.328644 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 437/875] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:28:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:48.328644 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958fa66-ccd7-4c25-93f2-fdbb6f153507 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:48.367912 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:48.371903 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:48.378597 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9850610c-a370-4fc8-b67f-e332502763b5 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:48.419613 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d81da0-630f-4251-a907-22688af117eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:48.421189 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d81da0-630f-4251-a907-22688af117eb None admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:48.421623 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d81da0-630f-4251-a907-22688af117eb None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:48.422041 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d81da0-630f-4251-a907-22688af117eb None admin] PATH_INFO: `/v3/services` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:48.423078 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d81da0-630f-4251-a907-22688af117eb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:48.425286 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d81da0-630f-4251-a907-22688af117eb None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:48.441993 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958fa66-ccd7-4c25-93f2-fdbb6f153507 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:48.478522 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75207b0-576e-44aa-bef3-e1c71ffbcf3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:48.479185 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75207b0-576e-44aa-bef3-e1c71ffbcf3d None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:48.479463 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75207b0-576e-44aa-bef3-e1c71ffbcf3d None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:48.479782 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75207b0-576e-44aa-bef3-e1c71ffbcf3d None admin] PATH_INFO: `/v3/services` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:48.480477 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75207b0-576e-44aa-bef3-e1c71ffbcf3d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:48.480778 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75207b0-576e-44aa-bef3-e1c71ffbcf3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:48.482153 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75207b0-576e-44aa-bef3-e1c71ffbcf3d None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:48.486689 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 438/876] 10.222.0.81 () {56 vars in 1122 bytes} [Mon Jul 18 16:28:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:48.487475 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75207b0-576e-44aa-bef3-e1c71ffbcf3d None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:48.582604 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:48.590843 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 439/877] 10.222.0.81 () {60 vars in 1141 bytes} [Mon Jul 18 16:28:48 2022] POST /identity/v3/services => generated 269 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:28:48.592366 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75207b0-576e-44aa-bef3-e1c71ffbcf3d None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:48.597531 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d81da0-630f-4251-a907-22688af117eb None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:48.642797 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c764e4d7-2314-4b56-a8f4-aef0a3d6e3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:48.643618 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764e4d7-2314-4b56-a8f4-aef0a3d6e3aa None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:48.643928 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764e4d7-2314-4b56-a8f4-aef0a3d6e3aa None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:48.644200 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764e4d7-2314-4b56-a8f4-aef0a3d6e3aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:48.652535 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c764e4d7-2314-4b56-a8f4-aef0a3d6e3aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:48.654007 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c764e4d7-2314-4b56-a8f4-aef0a3d6e3aa None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:48.670605 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-c764e4d7-2314-4b56-a8f4-aef0a3d6e3aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:28:48.670605 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:48.670605 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:48.670605 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:48.670605 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:48.670605 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:48.670605 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:48.670605 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:48.670605 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:48.670605 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:48.670605 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:48.670605 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:48.670605 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:28:48.670605 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:28:48.670605 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:28:48.671613 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:28:48.671613 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:48.671613 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:48.671613 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:48.671613 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:48.671613 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:48.671613 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:48.671613 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:48.671613 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:48.671613 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:48.671613 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:48.671613 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:48.671613 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:48.671613 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:48.671613 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:48.671613 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:48.671613 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:48.672580 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:28:48.672580 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:28:48.672580 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:28:48.672580 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:28:48.672580 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:28:48.672580 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:28:48.672580 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:28:48.672580 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:48.676415 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 439/878] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Jul 18 16:28:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:48.678440 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c764e4d7-2314-4b56-a8f4-aef0a3d6e3aa None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:48.770926 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d81da0-630f-4251-a907-22688af117eb None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:48.798764 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c764e4d7-2314-4b56-a8f4-aef0a3d6e3aa None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:48.809843 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a4fb8b-47b7-4e8c-9d52-c946b374dd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:48.810827 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a4fb8b-47b7-4e8c-9d52-c946b374dd72 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:48.811106 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a4fb8b-47b7-4e8c-9d52-c946b374dd72 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:48.811376 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a4fb8b-47b7-4e8c-9d52-c946b374dd72 None admin] PATH_INFO: `/v3/services` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:48.812704 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a4fb8b-47b7-4e8c-9d52-c946b374dd72 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:48.812868 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a4fb8b-47b7-4e8c-9d52-c946b374dd72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:48.814223 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a4fb8b-47b7-4e8c-9d52-c946b374dd72 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:48.819036 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 440/879] 10.222.0.81 () {56 vars in 1122 bytes} [Mon Jul 18 16:28:48 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:48.842270 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a375d7d-441a-4de1-8191-17b03f2497df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:48.842868 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a375d7d-441a-4de1-8191-17b03f2497df None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:48.843147 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a375d7d-441a-4de1-8191-17b03f2497df None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:48.843416 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a375d7d-441a-4de1-8191-17b03f2497df None admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:48.844800 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a375d7d-441a-4de1-8191-17b03f2497df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:48.844800 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a375d7d-441a-4de1-8191-17b03f2497df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:48.846050 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a375d7d-441a-4de1-8191-17b03f2497df None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:48.862605 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 440/880] 10.222.0.81 () {56 vars in 1148 bytes} [Mon Jul 18 16:28:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:48.868614 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a4fb8b-47b7-4e8c-9d52-c946b374dd72 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:48.897889 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:48.994025 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a4fb8b-47b7-4e8c-9d52-c946b374dd72 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:49.020554 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6493e-fd1c-436d-9570-56077ce9af2b None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:49.020837 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6493e-fd1c-436d-9570-56077ce9af2b None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:49.022463 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6493e-fd1c-436d-9570-56077ce9af2b None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:49.022576 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 441/881] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:28:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:49.028188 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a3d8f-f265-4ead-bd76-b3740df8b6dd None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:49.028481 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a3d8f-f265-4ead-bd76-b3740df8b6dd None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:49.028745 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a3d8f-f265-4ead-bd76-b3740df8b6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:49.044155 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8254b6a-b8a3-4fb5-b2e6-7c4f4324cdfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:49.045110 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8254b6a-b8a3-4fb5-b2e6-7c4f4324cdfe None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:49.045569 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8254b6a-b8a3-4fb5-b2e6-7c4f4324cdfe None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:49.046043 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8254b6a-b8a3-4fb5-b2e6-7c4f4324cdfe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:49.047138 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8254b6a-b8a3-4fb5-b2e6-7c4f4324cdfe None admin] RBAC: Adding query filter params (role.id=a716f51ae5b44c918918ed808ad2b2b0, scope.project.id=9d1d84bf334d47e6bfba1141c1fc6f59, user.id=ea2a096c4b964f03aed533d1e5e96db7) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:49.047626 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8254b6a-b8a3-4fb5-b2e6-7c4f4324cdfe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:49.047956 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-864a3d8f-f265-4ead-bd76-b3740df8b6dd None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:49.049169 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-864a3d8f-f265-4ead-bd76-b3740df8b6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:49.049649 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8254b6a-b8a3-4fb5-b2e6-7c4f4324cdfe None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:49.051276 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:49.057582 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 441/882] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Jul 18 16:28:48 2022] GET /identity/v3/role_assignments?user.id=ea2a096c4b964f03aed533d1e5e96db7&scope.project.id=9d1d84bf334d47e6bfba1141c1fc6f59&role.id=a716f51ae5b44c918918ed808ad2b2b0 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:49.148972 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 442/883] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:49 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:28:49.171834 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8254b6a-b8a3-4fb5-b2e6-7c4f4324cdfe None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:49.266898 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:49.282582 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8254b6a-b8a3-4fb5-b2e6-7c4f4324cdfe None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:49.319156 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad15b055-093f-419e-a375-3540503adf40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:49.320005 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15b055-093f-419e-a375-3540503adf40 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:49.320277 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15b055-093f-419e-a375-3540503adf40 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:49.320545 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15b055-093f-419e-a375-3540503adf40 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:49.321196 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad15b055-093f-419e-a375-3540503adf40 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:49.322550 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad15b055-093f-419e-a375-3540503adf40 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:49.335080 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-ad15b055-093f-419e-a375-3540503adf40 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 16:28:49.335080 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:49.335080 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 16:28:49.335080 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 16:28:49.335080 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 16:28:49.335080 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 16:28:49.335080 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 16:28:49.335080 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:28:49.335080 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 16:28:49.335080 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:49.335080 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 16:28:49.335080 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:49.335080 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:49.335080 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:49.335080 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:49.335080 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:49.335080 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:49.336217 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:49.336217 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:49.336217 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:49.336217 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:49.336217 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:49.336217 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:49.336217 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 16:28:49.336217 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 16:28:49.336217 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 16:28:49.336217 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 16:28:49.336217 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:49.336217 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:49.336217 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:49.336217 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:49.336217 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:49.336217 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:49.337106 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:49.337106 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:49.337106 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:49.337106 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:49.337106 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:49.337106 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:49.337106 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:49.337106 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:49.337106 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:49.337106 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:49.337106 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 16:28:49.337106 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:28:49.337106 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 16:28:49.337106 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:49.337106 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 442/884] 10.222.0.81 () {56 vars in 1114 bytes} [Mon Jul 18 16:28:49 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:49.343032 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864a3d8f-f265-4ead-bd76-b3740df8b6dd None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:49.463380 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864a3d8f-f265-4ead-bd76-b3740df8b6dd None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:49.502197 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e9e4de-b740-4038-910f-f32076b1c76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:49.502874 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e9e4de-b740-4038-910f-f32076b1c76b None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:49.503158 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e9e4de-b740-4038-910f-f32076b1c76b None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:49.503435 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e9e4de-b740-4038-910f-f32076b1c76b None admin] PATH_INFO: `/v3/services` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:49.504189 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e9e4de-b740-4038-910f-f32076b1c76b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:49.504499 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e9e4de-b740-4038-910f-f32076b1c76b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:49.505887 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e9e4de-b740-4038-910f-f32076b1c76b None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:49.511981 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 443/885] 10.222.0.81 () {56 vars in 1114 bytes} [Mon Jul 18 16:28:49 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:49.517310 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad15b055-093f-419e-a375-3540503adf40 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:49.623434 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad15b055-093f-419e-a375-3540503adf40 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:49.660657 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e4fd97-cd02-42f7-93c6-2a1a51c47d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:49.661335 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e4fd97-cd02-42f7-93c6-2a1a51c47d6c None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:49.661614 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e4fd97-cd02-42f7-93c6-2a1a51c47d6c None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:49.661887 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e4fd97-cd02-42f7-93c6-2a1a51c47d6c None admin] PATH_INFO: `/v3/services` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:49.662596 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e4fd97-cd02-42f7-93c6-2a1a51c47d6c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:49.662898 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e4fd97-cd02-42f7-93c6-2a1a51c47d6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:49.664292 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e4fd97-cd02-42f7-93c6-2a1a51c47d6c None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:49.670186 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 443/886] 10.222.0.81 () {56 vars in 1114 bytes} [Mon Jul 18 16:28:49 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:49.676163 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e9e4de-b740-4038-910f-f32076b1c76b None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:49.680985 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:49.789732 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e9e4de-b740-4038-910f-f32076b1c76b None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:49.828349 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c07e2e-4cac-4593-bbf9-a965f003a22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:49.829028 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c07e2e-4cac-4593-bbf9-a965f003a22a None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:49.829312 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c07e2e-4cac-4593-bbf9-a965f003a22a None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:49.829589 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c07e2e-4cac-4593-bbf9-a965f003a22a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:49.830483 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c07e2e-4cac-4593-bbf9-a965f003a22a None admin] RBAC: Adding query filter params (interface=public, service_id=25d4dab8a90f456ba3d96d7e583176ab, region_id=RegionOne) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:49.830795 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c07e2e-4cac-4593-bbf9-a965f003a22a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:49.832203 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c07e2e-4cac-4593-bbf9-a965f003a22a None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:49.838499 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 444/887] 10.222.0.81 () {56 vars in 1251 bytes} [Mon Jul 18 16:28:49 2022] GET /identity/v3/endpoints?service_id=25d4dab8a90f456ba3d96d7e583176ab&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:49.843682 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e4fd97-cd02-42f7-93c6-2a1a51c47d6c None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:49.860267 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:49.951295 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e4fd97-cd02-42f7-93c6-2a1a51c47d6c None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:49.987813 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6836b430-3b70-4329-95ba-3fa20cb6f6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:49.988486 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836b430-3b70-4329-95ba-3fa20cb6f6dd None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:49.988765 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836b430-3b70-4329-95ba-3fa20cb6f6dd None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:49.989037 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836b430-3b70-4329-95ba-3fa20cb6f6dd None admin] PATH_INFO: `/v3/services` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:49.989734 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6836b430-3b70-4329-95ba-3fa20cb6f6dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:49.991093 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6836b430-3b70-4329-95ba-3fa20cb6f6dd None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:49.998283 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 444/888] 10.222.0.81 () {56 vars in 1087 bytes} [Mon Jul 18 16:28:49 2022] GET /identity/v3/services => generated 1268 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:28:50.762134 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7fa45-846d-49e8-b79e-6aa9fd294258 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:50.763170 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7fa45-846d-49e8-b79e-6aa9fd294258 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:50.763655 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7fa45-846d-49e8-b79e-6aa9fd294258 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:50.765675 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 445/889] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:28:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:50.771641 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d782e-e4c6-4c8f-8a83-b7824bcedee0 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:50.772546 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d782e-e4c6-4c8f-8a83-b7824bcedee0 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:50.773036 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d782e-e4c6-4c8f-8a83-b7824bcedee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:50.791091 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-b02d782e-e4c6-4c8f-8a83-b7824bcedee0 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:50.796200 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-b02d782e-e4c6-4c8f-8a83-b7824bcedee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:50.869812 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 445/890] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:50 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:28:50.910175 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d7fa45-846d-49e8-b79e-6aa9fd294258 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:51.001740 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7af561-7a02-4def-b5c9-e239d763838e None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:51.002242 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7af561-7a02-4def-b5c9-e239d763838e None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:51.002724 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7af561-7a02-4def-b5c9-e239d763838e None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:51.005663 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 446/891] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:28:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:28:51.011205 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f214d-f3ec-424a-9a8a-16dac8c4a670 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:51.011524 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f214d-f3ec-424a-9a8a-16dac8c4a670 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:51.011788 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f214d-f3ec-424a-9a8a-16dac8c4a670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:51.022379 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:51.023802 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:51.030596 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-cc4f214d-f3ec-424a-9a8a-16dac8c4a670 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:51.031852 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-cc4f214d-f3ec-424a-9a8a-16dac8c4a670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:51.078450 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d7fa45-846d-49e8-b79e-6aa9fd294258 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:51.123649 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77edfaaa-f264-407f-a0bc-64df8b51f2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:51.124873 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77edfaaa-f264-407f-a0bc-64df8b51f2f8 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:51.125163 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77edfaaa-f264-407f-a0bc-64df8b51f2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:51.125440 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77edfaaa-f264-407f-a0bc-64df8b51f2f8 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:51.126707 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77edfaaa-f264-407f-a0bc-64df8b51f2f8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:51.128492 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77edfaaa-f264-407f-a0bc-64df8b51f2f8 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:51.144161 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-77edfaaa-f264-407f-a0bc-64df8b51f2f8 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 16:28:51.144161 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:51.144161 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 16:28:51.144161 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 16:28:51.144161 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 16:28:51.144161 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 16:28:51.144161 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 16:28:51.144161 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:28:51.144161 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 16:28:51.144161 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:51.144161 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 16:28:51.144161 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:51.144161 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:51.144161 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:51.144161 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:51.144161 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:51.145185 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:51.145185 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:51.145185 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:51.145185 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:51.145185 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:51.145185 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:51.145185 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:51.145185 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 16:28:51.145185 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 16:28:51.145185 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 16:28:51.145185 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 16:28:51.145185 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:51.145185 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:51.145185 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:51.145185 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:51.145185 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:51.146484 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:51.146484 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:51.146484 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:51.146484 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:51.146484 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:51.146484 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:51.146484 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:51.146484 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:51.146484 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:51.146484 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:51.146484 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:51.146484 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 16:28:51.146484 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:28:51.146484 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 16:28:51.146484 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:51.146484 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 446/892] 10.222.0.81 () {56 vars in 1132 bytes} [Mon Jul 18 16:28:50 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:51.147649 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 447/893] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:51 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:28:51.154591 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77edfaaa-f264-407f-a0bc-64df8b51f2f8 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:51.190590 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f214d-f3ec-424a-9a8a-16dac8c4a670 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:51.297076 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77edfaaa-f264-407f-a0bc-64df8b51f2f8 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:51.330513 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:51.337845 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e74100-9ca3-4b5c-85f5-dc20d3561919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:51.342616 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e74100-9ca3-4b5c-85f5-dc20d3561919 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:51.342616 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e74100-9ca3-4b5c-85f5-dc20d3561919 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:51.342616 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e74100-9ca3-4b5c-85f5-dc20d3561919 None admin] PATH_INFO: `/v3/services` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:51.342616 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e74100-9ca3-4b5c-85f5-dc20d3561919 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:51.342616 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e74100-9ca3-4b5c-85f5-dc20d3561919 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:51.342616 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e74100-9ca3-4b5c-85f5-dc20d3561919 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:51.348694 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f214d-f3ec-424a-9a8a-16dac8c4a670 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:51.350467 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 447/894] 10.222.0.81 () {56 vars in 1126 bytes} [Mon Jul 18 16:28:51 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:51.352294 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e4000-2fa8-44ec-bc78-924fe6371cf2 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:51.353464 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e4000-2fa8-44ec-bc78-924fe6371cf2 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:51.353924 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e4000-2fa8-44ec-bc78-924fe6371cf2 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:51.360480 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 448/895] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:28:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:51.360480 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e4000-2fa8-44ec-bc78-924fe6371cf2 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:51.404886 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04163594-ba29-483c-88c7-7816314375fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:51.405892 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04163594-ba29-483c-88c7-7816314375fa None admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:51.406284 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04163594-ba29-483c-88c7-7816314375fa None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:51.406672 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04163594-ba29-483c-88c7-7816314375fa None admin] PATH_INFO: `/v3/services` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:51.408441 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04163594-ba29-483c-88c7-7816314375fa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:51.409706 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04163594-ba29-483c-88c7-7816314375fa None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:51.414057 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:51.486567 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e4000-2fa8-44ec-bc78-924fe6371cf2 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:51.517651 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 448/896] 10.222.0.81 () {60 vars in 1141 bytes} [Mon Jul 18 16:28:51 2022] POST /identity/v3/services => generated 241 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:28:51.517651 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059e857-6162-481c-9a2b-3f8b4a912d93 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:51.517651 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059e857-6162-481c-9a2b-3f8b4a912d93 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:51.517651 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059e857-6162-481c-9a2b-3f8b4a912d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:51.541881 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-d059e857-6162-481c-9a2b-3f8b4a912d93 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:51.543988 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-d059e857-6162-481c-9a2b-3f8b4a912d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:51.553755 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f247f87e-21cf-4435-9028-68b1d7073db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:51.554836 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247f87e-21cf-4435-9028-68b1d7073db7 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:51.555583 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247f87e-21cf-4435-9028-68b1d7073db7 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:51.555885 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247f87e-21cf-4435-9028-68b1d7073db7 None admin] PATH_INFO: `/v3/services` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:51.557131 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f247f87e-21cf-4435-9028-68b1d7073db7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:51.557725 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f247f87e-21cf-4435-9028-68b1d7073db7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:51.560320 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f247f87e-21cf-4435-9028-68b1d7073db7 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:51.575366 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 449/897] 10.222.0.81 () {56 vars in 1126 bytes} [Mon Jul 18 16:28:51 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:51.579209 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f247f87e-21cf-4435-9028-68b1d7073db7 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:51.643982 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 449/898] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:28:51.668483 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d059e857-6162-481c-9a2b-3f8b4a912d93 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:51.678950 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:51.738131 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f247f87e-21cf-4435-9028-68b1d7073db7 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:51.789343 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca26a26-f4fb-4606-b76b-2e0a0f8dd76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:51.791096 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca26a26-f4fb-4606-b76b-2e0a0f8dd76a None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:51.791582 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca26a26-f4fb-4606-b76b-2e0a0f8dd76a None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:51.792183 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca26a26-f4fb-4606-b76b-2e0a0f8dd76a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:51.793164 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca26a26-f4fb-4606-b76b-2e0a0f8dd76a None admin] RBAC: Adding query filter params (interface=public, service_id=6f86be97492d4a05881e8f002891c525, region_id=RegionOne) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:51.793838 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca26a26-f4fb-4606-b76b-2e0a0f8dd76a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:51.795543 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca26a26-f4fb-4606-b76b-2e0a0f8dd76a None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:51.800183 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d059e857-6162-481c-9a2b-3f8b4a912d93 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:51.802657 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 450/899] 10.222.0.81 () {56 vars in 1251 bytes} [Mon Jul 18 16:28:51 2022] GET /identity/v3/endpoints?service_id=6f86be97492d4a05881e8f002891c525&interface=public®ion_id=RegionOne => generated 194 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:28:51.808788 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca26a26-f4fb-4606-b76b-2e0a0f8dd76a None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:51.832529 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:51.842564 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1513674-1ba0-4c3a-b8b4-24ebfed67325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:51.843503 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1513674-1ba0-4c3a-b8b4-24ebfed67325 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:51.843881 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1513674-1ba0-4c3a-b8b4-24ebfed67325 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:51.844230 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1513674-1ba0-4c3a-b8b4-24ebfed67325 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:51.856088 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1513674-1ba0-4c3a-b8b4-24ebfed67325 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:28:51.865084 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-e1513674-1ba0-4c3a-b8b4-24ebfed67325 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 16:28:51.865084 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:51.865084 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:51.865084 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:51.865084 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:51.865084 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:51.865084 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:51.865084 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:51.865084 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:51.865084 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:51.865084 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:51.865084 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:51.865084 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:28:51.865084 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:28:51.865084 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:28:51.865084 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:28:51.866084 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:28:51.866084 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:28:51.866084 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:28:51.866084 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:28:51.866084 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:51.866084 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:51.866084 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:51.866084 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:51.866084 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:51.866084 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:51.866084 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:51.866084 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:51.866084 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:51.866084 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:51.866084 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:51.866084 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:51.866951 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:51.866951 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:51.866951 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:51.866951 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:51.866951 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:28:51.866951 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:28:51.866951 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:28:51.866951 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:28:51.866951 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:28:51.866951 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:28:51.866951 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 16:28:51.866951 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:51.871898 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 450/900] 10.222.0.81 () {56 vars in 1120 bytes} [Mon Jul 18 16:28:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:28:51.874795 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1513674-1ba0-4c3a-b8b4-24ebfed67325 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:51.927083 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca26a26-f4fb-4606-b76b-2e0a0f8dd76a None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:51.965971 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944c6c3-ea78-4853-9fd5-64727cbda4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:51.966678 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944c6c3-ea78-4853-9fd5-64727cbda4ef None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:51.966969 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944c6c3-ea78-4853-9fd5-64727cbda4ef None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:51.967262 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944c6c3-ea78-4853-9fd5-64727cbda4ef None admin] PATH_INFO: `/v3/services` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:51.967983 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1944c6c3-ea78-4853-9fd5-64727cbda4ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:51.969608 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1944c6c3-ea78-4853-9fd5-64727cbda4ef None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:51.980153 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:51.982139 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 451/901] 10.222.0.81 () {56 vars in 1087 bytes} [Mon Jul 18 16:28:51 2022] GET /identity/v3/services => generated 1497 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:28:51.990175 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1513674-1ba0-4c3a-b8b4-24ebfed67325 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:52.033593 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b44b87-14b5-43d7-bffb-346935a59892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:52.034298 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b44b87-14b5-43d7-bffb-346935a59892 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:52.034614 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b44b87-14b5-43d7-bffb-346935a59892 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:52.034895 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b44b87-14b5-43d7-bffb-346935a59892 None admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:52.035677 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b44b87-14b5-43d7-bffb-346935a59892 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:52.036022 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b44b87-14b5-43d7-bffb-346935a59892 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:52.037499 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b44b87-14b5-43d7-bffb-346935a59892 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:52.052981 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 451/902] 10.222.0.81 () {56 vars in 1115 bytes} [Mon Jul 18 16:28:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:28:52.054512 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944c6c3-ea78-4853-9fd5-64727cbda4ef None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:52.150315 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf756ae-f10c-4511-9748-daf468c3c0fd None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:52.150611 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf756ae-f10c-4511-9748-daf468c3c0fd None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:52.150803 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf756ae-f10c-4511-9748-daf468c3c0fd None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:52.152276 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 452/903] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:28:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:52.157296 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0700b6b-4392-4db5-bf1c-df0c0db4b087 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:52.157585 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0700b6b-4392-4db5-bf1c-df0c0db4b087 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:52.157866 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0700b6b-4392-4db5-bf1c-df0c0db4b087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:52.172244 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944c6c3-ea78-4853-9fd5-64727cbda4ef None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:52.178692 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-b0700b6b-4392-4db5-bf1c-df0c0db4b087 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:52.180008 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-b0700b6b-4392-4db5-bf1c-df0c0db4b087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:52.208869 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63218629-f07a-480b-a293-009367af70da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:52.209715 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63218629-f07a-480b-a293-009367af70da None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:52.209999 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63218629-f07a-480b-a293-009367af70da None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:52.210276 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63218629-f07a-480b-a293-009367af70da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:52.224378 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63218629-f07a-480b-a293-009367af70da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:52.225815 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63218629-f07a-480b-a293-009367af70da None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:52.248105 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:52.248439 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-63218629-f07a-480b-a293-009367af70da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:52.248439 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:52.248439 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:52.248439 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:52.248439 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:52.248439 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:52.248439 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:52.248439 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:52.248439 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:52.248439 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:52.248439 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:52.248439 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:52.248439 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:28:52.248439 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:28:52.248439 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:28:52.249304 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:28:52.249304 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:52.249304 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:52.249304 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:52.249304 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:52.249304 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:52.249304 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:52.249304 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:52.249304 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:52.249304 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:52.249304 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:52.249304 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:52.249304 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:52.249304 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:52.249304 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:52.249304 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:52.249304 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:52.250241 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:28:52.250241 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:28:52.250241 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:52.250241 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:52.254508 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 452/904] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:28:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:28:52.255845 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63218629-f07a-480b-a293-009367af70da None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:52.270084 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 453/905] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 16:28:52.292783 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0700b6b-4392-4db5-bf1c-df0c0db4b087 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:52.306064 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:52.383763 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63218629-f07a-480b-a293-009367af70da None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:52.404772 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0700b6b-4392-4db5-bf1c-df0c0db4b087 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:52.435922 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d13b0ab-f9c4-4c73-a3cb-9d952560aff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:52.437044 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13b0ab-f9c4-4c73-a3cb-9d952560aff7 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:52.437329 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13b0ab-f9c4-4c73-a3cb-9d952560aff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:52.437875 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13b0ab-f9c4-4c73-a3cb-9d952560aff7 None admin] PATH_INFO: `/v3/domains` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:52.438690 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d13b0ab-f9c4-4c73-a3cb-9d952560aff7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:52.439007 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d13b0ab-f9c4-4c73-a3cb-9d952560aff7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:52.440438 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d13b0ab-f9c4-4c73-a3cb-9d952560aff7 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:52.442564 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c6e9f-a759-43fa-83df-23dbf605f584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:52.443818 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c6e9f-a759-43fa-83df-23dbf605f584 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:52.444329 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c6e9f-a759-43fa-83df-23dbf605f584 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:52.444879 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c6e9f-a759-43fa-83df-23dbf605f584 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:52.445793 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00c6e9f-a759-43fa-83df-23dbf605f584 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:52.447362 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00c6e9f-a759-43fa-83df-23dbf605f584 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:52.458587 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 453/906] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:28:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:52.460063 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d13b0ab-f9c4-4c73-a3cb-9d952560aff7 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:52.461010 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-b00c6e9f-a759-43fa-83df-23dbf605f584 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 16:28:52.461010 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:52.461010 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 16:28:52.461010 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 16:28:52.461010 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 16:28:52.461010 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 16:28:52.461010 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 16:28:52.461010 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:28:52.461010 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 16:28:52.461010 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:52.461010 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 16:28:52.461010 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:52.461010 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:52.461010 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:52.461010 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:52.461010 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:52.461010 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:52.462155 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:52.462155 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:52.462155 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:52.462155 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:52.462155 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:52.462155 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:52.462155 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 16:28:52.462155 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 16:28:52.462155 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 16:28:52.462155 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 16:28:52.462155 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:52.462155 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:52.462155 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:52.462155 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:52.462155 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:52.462155 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:52.463057 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:52.463057 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:52.463057 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:52.463057 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:52.463057 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:52.463057 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:52.463057 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:52.463057 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:52.463057 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:52.463057 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:52.463057 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 16:28:52.463057 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:28:52.463057 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 16:28:52.463057 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:52.472081 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 454/907] 10.222.0.81 () {56 vars in 1114 bytes} [Mon Jul 18 16:28:52 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:28:52.473409 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c6e9f-a759-43fa-83df-23dbf605f584 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:52.522629 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:52.564255 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:52.571598 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d13b0ab-f9c4-4c73-a3cb-9d952560aff7 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:52.590490 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c6e9f-a759-43fa-83df-23dbf605f584 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:52.613977 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18ed662-f5a2-4c2d-826c-44010fc94177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:52.615088 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ed662-f5a2-4c2d-826c-44010fc94177 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:52.615558 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ed662-f5a2-4c2d-826c-44010fc94177 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:52.616086 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ed662-f5a2-4c2d-826c-44010fc94177 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:52.624882 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18ed662-f5a2-4c2d-826c-44010fc94177 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:52.626628 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18ed662-f5a2-4c2d-826c-44010fc94177 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:52.629294 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a3af75-d91a-4954-851d-a3924fbc5db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:52.630287 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3af75-d91a-4954-851d-a3924fbc5db9 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:52.630450 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3af75-d91a-4954-851d-a3924fbc5db9 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:52.630823 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3af75-d91a-4954-851d-a3924fbc5db9 None admin] PATH_INFO: `/v3/services` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:52.631615 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a3af75-d91a-4954-851d-a3924fbc5db9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:52.632271 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a3af75-d91a-4954-851d-a3924fbc5db9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:52.633757 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a3af75-d91a-4954-851d-a3924fbc5db9 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:52.644166 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 455/908] 10.222.0.81 () {56 vars in 1114 bytes} [Mon Jul 18 16:28:52 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:52.645191 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a3af75-d91a-4954-851d-a3924fbc5db9 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:52.645452 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-e18ed662-f5a2-4c2d-826c-44010fc94177 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 16:28:52.645452 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:52.645452 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:52.645452 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:52.645452 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:52.645452 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:52.645452 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:52.645452 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:52.645452 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:52.645452 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:52.645452 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:52.645452 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:52.645452 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:28:52.645452 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:28:52.645452 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:28:52.645452 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:28:52.646376 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:52.646376 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:52.646376 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:28:52.646376 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:28:52.646376 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:28:52.646376 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:28:52.646376 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:52.646376 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:52.646376 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:52.646376 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:52.646376 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:52.646376 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:52.646376 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:52.646376 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:52.646376 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:52.646376 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:52.646376 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:52.646376 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:52.647343 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:52.647343 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:52.647343 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:28:52.647343 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:28:52.647343 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:28:52.647343 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:28:52.647343 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:28:52.647343 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:28:52.647343 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 16:28:52.647343 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:52.655264 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 454/909] 10.222.0.81 () {56 vars in 1117 bytes} [Mon Jul 18 16:28:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:28:52.656920 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18ed662-f5a2-4c2d-826c-44010fc94177 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:52.763544 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a3af75-d91a-4954-851d-a3924fbc5db9 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:52.771644 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:52.773657 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18ed662-f5a2-4c2d-826c-44010fc94177 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:52.805457 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa44e8-2905-4aca-a3d8-c5f0d1dbe8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:52.806476 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa44e8-2905-4aca-a3d8-c5f0d1dbe8d5 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:52.806838 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa44e8-2905-4aca-a3d8-c5f0d1dbe8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:52.807186 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa44e8-2905-4aca-a3d8-c5f0d1dbe8d5 None admin] PATH_INFO: `/v3/services` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:52.808788 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa44e8-2905-4aca-a3d8-c5f0d1dbe8d5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:52.809101 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa44e8-2905-4aca-a3d8-c5f0d1dbe8d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:52.810505 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa44e8-2905-4aca-a3d8-c5f0d1dbe8d5 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:52.822807 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44629692-07ba-4f90-920f-b9a37afaff49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:52.823358 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 456/910] 10.222.0.81 () {56 vars in 1114 bytes} [Mon Jul 18 16:28:52 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:52.823444 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44629692-07ba-4f90-920f-b9a37afaff49 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:52.823444 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44629692-07ba-4f90-920f-b9a37afaff49 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:52.823444 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44629692-07ba-4f90-920f-b9a37afaff49 None admin] PATH_INFO: `/v3/users` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:52.823444 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44629692-07ba-4f90-920f-b9a37afaff49 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:52.823444 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44629692-07ba-4f90-920f-b9a37afaff49 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:52.824312 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44629692-07ba-4f90-920f-b9a37afaff49 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:52.824834 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa44e8-2905-4aca-a3d8-c5f0d1dbe8d5 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:52.844933 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 455/911] 10.222.0.81 () {56 vars in 1149 bytes} [Mon Jul 18 16:28:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:28:52.850641 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44629692-07ba-4f90-920f-b9a37afaff49 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:52.866983 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:52.959539 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa44e8-2905-4aca-a3d8-c5f0d1dbe8d5 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:52.963808 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44629692-07ba-4f90-920f-b9a37afaff49 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:52.999435 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2850e82b-c5b4-43c5-bc51-cffe13a974bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:53.000158 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850e82b-c5b4-43c5-bc51-cffe13a974bb None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:53.000422 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850e82b-c5b4-43c5-bc51-cffe13a974bb None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:53.000700 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850e82b-c5b4-43c5-bc51-cffe13a974bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:53.006485 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee095d-c674-426f-8813-ff44509ddf89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:53.007742 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee095d-c674-426f-8813-ff44509ddf89 None admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:53.008253 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee095d-c674-426f-8813-ff44509ddf89 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:53.008731 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee095d-c674-426f-8813-ff44509ddf89 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:53.010161 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ee095d-c674-426f-8813-ff44509ddf89 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:53.012752 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ee095d-c674-426f-8813-ff44509ddf89 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:53.071845 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2850e82b-c5b4-43c5-bc51-cffe13a974bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:53.073309 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2850e82b-c5b4-43c5-bc51-cffe13a974bb None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:53.087321 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:53.152706 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 457/912] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Jul 18 16:28:52 2022] POST /identity/v3/endpoints => generated 346 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:28:53.185179 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 456/913] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Jul 18 16:28:52 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 16:28:53.190843 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee095d-c674-426f-8813-ff44509ddf89 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:53.225498 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:53.332085 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee095d-c674-426f-8813-ff44509ddf89 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:53.372443 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bca5a87-40df-4d76-85ca-23958c932957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:53.373249 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca5a87-40df-4d76-85ca-23958c932957 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:53.373529 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca5a87-40df-4d76-85ca-23958c932957 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:53.373799 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca5a87-40df-4d76-85ca-23958c932957 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:53.387615 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bca5a87-40df-4d76-85ca-23958c932957 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:53.389520 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bca5a87-40df-4d76-85ca-23958c932957 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:53.411069 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-0bca5a87-40df-4d76-85ca-23958c932957 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:53.411069 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:53.411069 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:53.411069 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:53.411069 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:53.411069 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:53.411069 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:53.411069 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:53.411069 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:53.411069 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:53.411069 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:53.411069 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:53.411069 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:28:53.411069 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:28:53.411069 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:28:53.412112 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:28:53.412112 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:53.412112 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:53.412112 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:53.412112 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:53.412112 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:53.412112 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:53.412112 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:53.412112 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:53.412112 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:53.412112 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:53.412112 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:53.412112 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:53.412112 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:53.412112 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:53.412112 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:53.412112 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:53.413042 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:28:53.413042 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:28:53.413042 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:53.413042 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:53.415785 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 458/914] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:28:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:28:53.418973 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2850e82b-c5b4-43c5-bc51-cffe13a974bb None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:53.531263 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2850e82b-c5b4-43c5-bc51-cffe13a974bb None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:53.544689 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:53.567070 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb15275-252a-42b9-af6a-245e97b4eec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:53.567770 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb15275-252a-42b9-af6a-245e97b4eec3 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:53.568055 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb15275-252a-42b9-af6a-245e97b4eec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:53.568331 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb15275-252a-42b9-af6a-245e97b4eec3 None admin] PATH_INFO: `/v3/domains` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:53.569058 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb15275-252a-42b9-af6a-245e97b4eec3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:53.569365 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb15275-252a-42b9-af6a-245e97b4eec3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:53.570943 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb15275-252a-42b9-af6a-245e97b4eec3 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:53.585317 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 457/915] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:28:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:53.591022 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bca5a87-40df-4d76-85ca-23958c932957 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:53.677743 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:53.705392 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bca5a87-40df-4d76-85ca-23958c932957 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:53.720452 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161fcc06-45d8-438f-804a-f4ad44fc489a None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:53.720764 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161fcc06-45d8-438f-804a-f4ad44fc489a None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:53.721153 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161fcc06-45d8-438f-804a-f4ad44fc489a None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:53.723110 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 458/916] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:28:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:28:53.729013 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d80f3d7-e66d-49a7-8140-de2c6c1bb62b None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:53.729303 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d80f3d7-e66d-49a7-8140-de2c6c1bb62b None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:53.729597 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d80f3d7-e66d-49a7-8140-de2c6c1bb62b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:53.750698 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-2d80f3d7-e66d-49a7-8140-de2c6c1bb62b None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:53.751953 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-2d80f3d7-e66d-49a7-8140-de2c6c1bb62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:53.752764 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf546ca-6b98-4627-b561-458da538159d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:53.753571 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf546ca-6b98-4627-b561-458da538159d None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:53.753882 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf546ca-6b98-4627-b561-458da538159d None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:53.754239 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf546ca-6b98-4627-b561-458da538159d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:53.763000 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf546ca-6b98-4627-b561-458da538159d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:53.764659 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf546ca-6b98-4627-b561-458da538159d None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:53.781905 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-7cf546ca-6b98-4627-b561-458da538159d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:28:53.781905 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:53.781905 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:53.781905 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:53.781905 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:53.781905 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:53.781905 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:53.781905 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:53.781905 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:53.781905 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:53.781905 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:53.781905 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:53.781905 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:28:53.781905 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:28:53.781905 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:28:53.784113 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:28:53.784113 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:53.784113 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:53.784113 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:53.784113 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:53.784113 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:53.784113 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:53.784113 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:53.784113 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:53.784113 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:53.784113 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:53.784113 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:53.784113 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:53.784113 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:53.784113 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:53.784113 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:53.784113 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:53.785435 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:28:53.785435 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:28:53.785435 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:28:53.785435 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:28:53.785435 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:28:53.785435 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:28:53.785435 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:28:53.785435 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:53.785435 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 459/917] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Jul 18 16:28:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:53.791742 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf546ca-6b98-4627-b561-458da538159d None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:53.851534 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 459/918] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 16:28:53.892045 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d80f3d7-e66d-49a7-8140-de2c6c1bb62b None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:53.936444 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf546ca-6b98-4627-b561-458da538159d None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:53.981505 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d0475-83a9-4025-9244-b3527f66779d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:53.982215 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d0475-83a9-4025-9244-b3527f66779d None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:53.982498 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d0475-83a9-4025-9244-b3527f66779d None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:53.982776 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d0475-83a9-4025-9244-b3527f66779d None admin] PATH_INFO: `/v3/projects` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:53.983576 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99d0475-83a9-4025-9244-b3527f66779d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:53.983961 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99d0475-83a9-4025-9244-b3527f66779d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:53.985930 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99d0475-83a9-4025-9244-b3527f66779d None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:53.988651 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:54.005025 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 460/919] 10.222.0.81 () {56 vars in 1148 bytes} [Mon Jul 18 16:28:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:54.010573 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d0475-83a9-4025-9244-b3527f66779d None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:54.056147 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d80f3d7-e66d-49a7-8140-de2c6c1bb62b None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:54.058275 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:54.094173 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6915af6-c6b6-4b46-beb3-6d2d2316191a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:54.094982 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6915af6-c6b6-4b46-beb3-6d2d2316191a None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:54.095397 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6915af6-c6b6-4b46-beb3-6d2d2316191a None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:54.095675 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6915af6-c6b6-4b46-beb3-6d2d2316191a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:54.096357 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6915af6-c6b6-4b46-beb3-6d2d2316191a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:54.097801 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6915af6-c6b6-4b46-beb3-6d2d2316191a None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:54.110839 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-e6915af6-c6b6-4b46-beb3-6d2d2316191a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 16:28:54.110839 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:54.110839 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 16:28:54.110839 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 16:28:54.110839 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 16:28:54.110839 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 16:28:54.110839 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 16:28:54.110839 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:28:54.110839 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 16:28:54.110839 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:54.110839 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 16:28:54.110839 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:54.110839 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:54.110839 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:54.110839 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:54.110839 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:54.110839 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:54.112119 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:54.112119 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:54.112119 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:54.112119 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:54.112119 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:54.112119 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:54.112119 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 16:28:54.112119 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 16:28:54.112119 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 16:28:54.112119 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 16:28:54.112119 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:54.112119 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:54.112119 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:54.112119 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:54.112119 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:54.112119 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:54.113056 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:54.113056 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:54.113056 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:54.113056 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:54.113056 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:54.113056 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:54.113056 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:54.113056 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:54.113056 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:54.113056 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:54.113056 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 16:28:54.113056 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:28:54.113056 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 16:28:54.113056 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:54.113995 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 460/920] 10.222.0.81 () {56 vars in 1126 bytes} [Mon Jul 18 16:28:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:28:54.118194 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6915af6-c6b6-4b46-beb3-6d2d2316191a None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:54.140253 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d0475-83a9-4025-9244-b3527f66779d None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:54.187649 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d052f1b3-9c50-40e1-80a9-0644f9a45632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:54.188826 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052f1b3-9c50-40e1-80a9-0644f9a45632 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:54.189118 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052f1b3-9c50-40e1-80a9-0644f9a45632 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:54.189503 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052f1b3-9c50-40e1-80a9-0644f9a45632 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:54.190473 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d052f1b3-9c50-40e1-80a9-0644f9a45632 None admin] RBAC: Adding query filter params (role.id=98b55727d5284c6e92f21b06e332215f, scope.project.id=9d1d84bf334d47e6bfba1141c1fc6f59, user.id=ea2a096c4b964f03aed533d1e5e96db7) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:54.191094 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d052f1b3-9c50-40e1-80a9-0644f9a45632 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:54.192728 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d052f1b3-9c50-40e1-80a9-0644f9a45632 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:54.211680 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 461/921] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Jul 18 16:28:54 2022] GET /identity/v3/role_assignments?user.id=ea2a096c4b964f03aed533d1e5e96db7&scope.project.id=9d1d84bf334d47e6bfba1141c1fc6f59&role.id=98b55727d5284c6e92f21b06e332215f => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:28:54.211680 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b1554c-16c6-487c-a562-7c8e1d4f445d None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:54.211680 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b1554c-16c6-487c-a562-7c8e1d4f445d None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:54.211680 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b1554c-16c6-487c-a562-7c8e1d4f445d None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:54.211680 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 462/922] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:28:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:54.219819 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195445cc-93ab-4209-8e4a-e9e8b0a36170 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:54.220036 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195445cc-93ab-4209-8e4a-e9e8b0a36170 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:54.220317 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195445cc-93ab-4209-8e4a-e9e8b0a36170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:54.240818 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-195445cc-93ab-4209-8e4a-e9e8b0a36170 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:54.242939 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-195445cc-93ab-4209-8e4a-e9e8b0a36170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:54.249902 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6915af6-c6b6-4b46-beb3-6d2d2316191a None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:54.299294 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a3fe4f-b45b-47df-8f8e-2cf3a072632a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:54.300025 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a3fe4f-b45b-47df-8f8e-2cf3a072632a None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:54.300305 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a3fe4f-b45b-47df-8f8e-2cf3a072632a None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:54.300584 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a3fe4f-b45b-47df-8f8e-2cf3a072632a None admin] PATH_INFO: `/v3/services` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:54.301314 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a3fe4f-b45b-47df-8f8e-2cf3a072632a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:54.301622 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a3fe4f-b45b-47df-8f8e-2cf3a072632a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:54.303810 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a3fe4f-b45b-47df-8f8e-2cf3a072632a None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:54.314755 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 461/923] 10.222.0.81 () {56 vars in 1122 bytes} [Mon Jul 18 16:28:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:28:54.317732 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a3fe4f-b45b-47df-8f8e-2cf3a072632a None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:54.326547 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:54.343754 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 463/924] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:28:54.366916 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195445cc-93ab-4209-8e4a-e9e8b0a36170 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:54.369555 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:54.487492 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a3fe4f-b45b-47df-8f8e-2cf3a072632a None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:54.520647 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195445cc-93ab-4209-8e4a-e9e8b0a36170 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:54.533305 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe56cac-2b05-4ea7-b67d-50b87f0af4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:54.535575 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe56cac-2b05-4ea7-b67d-50b87f0af4a9 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:54.536977 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe56cac-2b05-4ea7-b67d-50b87f0af4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:54.537687 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe56cac-2b05-4ea7-b67d-50b87f0af4a9 None admin] PATH_INFO: `/v3/services` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:54.540584 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe56cac-2b05-4ea7-b67d-50b87f0af4a9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:54.541712 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe56cac-2b05-4ea7-b67d-50b87f0af4a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:54.545144 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe56cac-2b05-4ea7-b67d-50b87f0af4a9 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:54.553592 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 462/925] 10.222.0.81 () {56 vars in 1122 bytes} [Mon Jul 18 16:28:54 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:28:54.560440 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe56cac-2b05-4ea7-b67d-50b87f0af4a9 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:54.573015 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb7b40-74f0-4654-932b-7d77f776e199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:54.573899 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb7b40-74f0-4654-932b-7d77f776e199 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:54.574251 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb7b40-74f0-4654-932b-7d77f776e199 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:54.574603 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb7b40-74f0-4654-932b-7d77f776e199 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:54.575358 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abb7b40-74f0-4654-932b-7d77f776e199 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:54.576900 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abb7b40-74f0-4654-932b-7d77f776e199 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:54.591646 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-2abb7b40-74f0-4654-932b-7d77f776e199 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 16:28:54.591646 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:54.591646 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 16:28:54.591646 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 16:28:54.591646 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 16:28:54.591646 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 16:28:54.591646 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 16:28:54.591646 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:28:54.591646 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 16:28:54.591646 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:54.591646 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 16:28:54.591646 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:54.591646 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:54.591646 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:54.591646 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:54.591646 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:54.592975 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:54.592975 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:54.592975 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:54.592975 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:54.592975 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:54.592975 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:54.592975 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:54.592975 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 16:28:54.592975 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 16:28:54.592975 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 16:28:54.592975 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 16:28:54.592975 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:54.592975 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:54.592975 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:54.592975 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:54.592975 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:54.594069 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:54.594069 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:54.594069 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:54.594069 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:54.594069 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:54.594069 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:54.594069 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:54.594069 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:54.594069 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:54.594069 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:54.594069 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:54.594069 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 16:28:54.594069 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:28:54.594069 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 16:28:54.594069 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:54.600500 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 464/926] 10.222.0.81 () {56 vars in 1132 bytes} [Mon Jul 18 16:28:54 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:54.601726 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb7b40-74f0-4654-932b-7d77f776e199 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:54.686450 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:54.711778 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:54.720617 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe56cac-2b05-4ea7-b67d-50b87f0af4a9 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:54.743911 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb7b40-74f0-4654-932b-7d77f776e199 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:54.764943 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35ea4c0-64aa-4460-bb05-e44496e305ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:54.765608 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ea4c0-64aa-4460-bb05-e44496e305ed None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:54.765885 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ea4c0-64aa-4460-bb05-e44496e305ed None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:54.766154 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ea4c0-64aa-4460-bb05-e44496e305ed None admin] PATH_INFO: `/v3/endpoints` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:54.766939 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35ea4c0-64aa-4460-bb05-e44496e305ed None admin] RBAC: Adding query filter params (interface=public, service_id=bcfd1d81fc974c9cb11f63225ee7cc3c, region_id=RegionOne) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:54.767247 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35ea4c0-64aa-4460-bb05-e44496e305ed None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:54.769161 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35ea4c0-64aa-4460-bb05-e44496e305ed None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:54.781337 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 463/927] 10.222.0.81 () {56 vars in 1251 bytes} [Mon Jul 18 16:28:54 2022] GET /identity/v3/endpoints?service_id=bcfd1d81fc974c9cb11f63225ee7cc3c&interface=public®ion_id=RegionOne => generated 194 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:54.783023 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35ea4c0-64aa-4460-bb05-e44496e305ed None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:54.797949 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d986fddc-f99f-4315-b8b7-23f05efd3f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:54.800035 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986fddc-f99f-4315-b8b7-23f05efd3f50 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:54.800035 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986fddc-f99f-4315-b8b7-23f05efd3f50 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:54.800035 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986fddc-f99f-4315-b8b7-23f05efd3f50 None admin] PATH_INFO: `/v3/services` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:54.800896 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d986fddc-f99f-4315-b8b7-23f05efd3f50 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:54.801519 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d986fddc-f99f-4315-b8b7-23f05efd3f50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:54.803149 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d986fddc-f99f-4315-b8b7-23f05efd3f50 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:54.814498 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 465/928] 10.222.0.81 () {56 vars in 1126 bytes} [Mon Jul 18 16:28:54 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:54.816563 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d986fddc-f99f-4315-b8b7-23f05efd3f50 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:54.890976 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35ea4c0-64aa-4460-bb05-e44496e305ed None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:54.929216 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6dc03d-8101-451b-b2e7-e71e5f58d9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:54.929886 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6dc03d-8101-451b-b2e7-e71e5f58d9b0 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:54.930164 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6dc03d-8101-451b-b2e7-e71e5f58d9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:54.930436 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6dc03d-8101-451b-b2e7-e71e5f58d9b0 None admin] PATH_INFO: `/v3/services` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:54.931279 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6dc03d-8101-451b-b2e7-e71e5f58d9b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:54.933804 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6dc03d-8101-451b-b2e7-e71e5f58d9b0 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:54.938828 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d986fddc-f99f-4315-b8b7-23f05efd3f50 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:54.946334 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 464/929] 10.222.0.81 () {56 vars in 1087 bytes} [Mon Jul 18 16:28:54 2022] GET /identity/v3/services => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:28:54.968142 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:54.985695 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df0bdf-b954-44db-b2b9-c1a7cdb84f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:54.986653 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df0bdf-b954-44db-b2b9-c1a7cdb84f2e None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:54.988998 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df0bdf-b954-44db-b2b9-c1a7cdb84f2e None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:54.988998 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df0bdf-b954-44db-b2b9-c1a7cdb84f2e None admin] PATH_INFO: `/v3/services` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:54.988998 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86df0bdf-b954-44db-b2b9-c1a7cdb84f2e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:54.988998 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86df0bdf-b954-44db-b2b9-c1a7cdb84f2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:54.990077 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86df0bdf-b954-44db-b2b9-c1a7cdb84f2e None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:54.997242 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 466/930] 10.222.0.81 () {56 vars in 1126 bytes} [Mon Jul 18 16:28:54 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:55.003144 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6dc03d-8101-451b-b2e7-e71e5f58d9b0 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:55.036405 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:55.125659 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6dc03d-8101-451b-b2e7-e71e5f58d9b0 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:55.164911 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68994c9b-2767-40eb-9a37-c17a1af27c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:55.165495 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68994c9b-2767-40eb-9a37-c17a1af27c09 None admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:55.165772 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68994c9b-2767-40eb-9a37-c17a1af27c09 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:55.166044 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68994c9b-2767-40eb-9a37-c17a1af27c09 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:55.166819 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68994c9b-2767-40eb-9a37-c17a1af27c09 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:55.168512 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68994c9b-2767-40eb-9a37-c17a1af27c09 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:55.298691 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 465/931] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Jul 18 16:28:55 2022] POST /identity/v3/endpoints => generated 347 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:28:55.435548 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a6489-2360-4fc5-8860-0b64c037b0b9 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:55.435786 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a6489-2360-4fc5-8860-0b64c037b0b9 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:55.436186 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a6489-2360-4fc5-8860-0b64c037b0b9 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:55.437697 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 467/932] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:28:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:55.443706 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044c560-2d3d-4ef5-9432-7aabd1baa049 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:55.444060 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044c560-2d3d-4ef5-9432-7aabd1baa049 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:55.444297 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044c560-2d3d-4ef5-9432-7aabd1baa049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:55.464309 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-1044c560-2d3d-4ef5-9432-7aabd1baa049 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:55.464309 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-1044c560-2d3d-4ef5-9432-7aabd1baa049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:55.546200 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 466/933] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:28:55.570164 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232a6489-2360-4fc5-8860-0b64c037b0b9 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:55.688416 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232a6489-2360-4fc5-8860-0b64c037b0b9 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:55.725400 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f680b5a-d591-4166-8828-e65663339895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:55.726195 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f680b5a-d591-4166-8828-e65663339895 None admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:55.726483 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f680b5a-d591-4166-8828-e65663339895 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:55.726758 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f680b5a-d591-4166-8828-e65663339895 None admin] PATH_INFO: `/v3/projects` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:55.727462 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f680b5a-d591-4166-8828-e65663339895 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:55.729159 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f680b5a-d591-4166-8828-e65663339895 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:55.731165 dv-cinder-846173-3-smb devstack@keystone.service[80544]: WARNING keystone.server.flask.common [None req-8f680b5a-d591-4166-8828-e65663339895 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 18 16:28:55.800269 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.sql.core [None req-8f680b5a-d591-4166-8828-e65663339895 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 18 16:28:55.800269 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 18 16:28:55.800269 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [parameters: {'id': 'af4d1ff625cd4c018356b7ffe2ae5228', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 18 16:28:55.800269 dv-cinder-846173-3-smb devstack@keystone.service[80544]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80544) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 18 16:28:55.817809 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-8f680b5a-d591-4166-8828-e65663339895 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id af4d1ff625cd4c018356b7ffe2ae5228.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id af4d1ff625cd4c018356b7ffe2ae5228. Jul 18 16:28:55.817809 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:55.817809 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 18 16:28:55.817809 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 18 16:28:55.817809 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 18 16:28:55.817809 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 18 16:28:55.817809 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 18 16:28:55.817809 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application result = self._query(query) Jul 18 16:28:55.817809 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 18 16:28:55.817809 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application conn.query(q) Jul 18 16:28:55.817809 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 18 16:28:55.817809 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 18 16:28:55.817809 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 18 16:28:55.818760 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application result.read() Jul 18 16:28:55.818760 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 18 16:28:55.818760 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 18 16:28:55.818760 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 18 16:28:55.818760 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 18 16:28:55.818760 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 18 16:28:55.818760 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 18 16:28:55.818760 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 18 16:28:55.818760 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 18 16:28:55.818760 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 18 16:28:55.818760 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:55.818760 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 18 16:28:55.818760 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:55.818760 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:55.818760 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 18 16:28:55.818760 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 18 16:28:55.818760 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 18 16:28:55.818760 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 18 16:28:55.819785 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 18 16:28:55.819785 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application next(self.gen) Jul 18 16:28:55.819785 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 18 16:28:55.819785 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application yield resource Jul 18 16:28:55.819785 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 18 16:28:55.819785 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application next(self.gen) Jul 18 16:28:55.819785 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 18 16:28:55.819785 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application self.session.rollback() Jul 18 16:28:55.819785 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 16:28:55.819785 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application self.force_reraise() Jul 18 16:28:55.819785 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 16:28:55.819785 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise self.value Jul 18 16:28:55.819785 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 18 16:28:55.819785 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 18 16:28:55.819785 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 18 16:28:55.819785 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application session.commit() Jul 18 16:28:55.819785 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 18 16:28:55.820719 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 18 16:28:55.820719 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 18 16:28:55.820719 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application self._prepare_impl() Jul 18 16:28:55.820719 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 18 16:28:55.820719 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application self.session.flush() Jul 18 16:28:55.820719 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 18 16:28:55.820719 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application self._flush(objects) Jul 18 16:28:55.820719 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 18 16:28:55.820719 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 18 16:28:55.820719 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 18 16:28:55.820719 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application compat.raise_( Jul 18 16:28:55.820719 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 18 16:28:55.820719 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception Jul 18 16:28:55.820719 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 18 16:28:55.820719 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application flush_context.execute() Jul 18 16:28:55.820719 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 18 16:28:55.820719 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rec.execute(self) Jul 18 16:28:55.822656 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 18 16:28:55.822656 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 18 16:28:55.822656 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 18 16:28:55.822656 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 18 16:28:55.822656 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 18 16:28:55.822656 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 18 16:28:55.822656 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 18 16:28:55.822656 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 18 16:28:55.822656 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 18 16:28:55.822656 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 18 16:28:55.822656 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 18 16:28:55.822656 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 18 16:28:55.822656 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 18 16:28:55.822656 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 18 16:28:55.822656 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 18 16:28:55.824614 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 18 16:28:55.824614 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 18 16:28:55.824614 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception Jul 18 16:28:55.824614 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 18 16:28:55.824614 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 18 16:28:55.824614 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 18 16:28:55.824614 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 18 16:28:55.824614 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 18 16:28:55.824614 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application result = self._query(query) Jul 18 16:28:55.824614 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 18 16:28:55.824614 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application conn.query(q) Jul 18 16:28:55.824614 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 18 16:28:55.824614 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 18 16:28:55.824614 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 18 16:28:55.824614 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application result.read() Jul 18 16:28:55.824614 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 18 16:28:55.824614 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 18 16:28:55.825857 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 18 16:28:55.825857 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 18 16:28:55.825857 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 18 16:28:55.825857 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 18 16:28:55.825857 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 18 16:28:55.825857 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 18 16:28:55.825857 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 18 16:28:55.825857 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 18 16:28:55.825857 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [parameters: {'id': 'af4d1ff625cd4c018356b7ffe2ae5228', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 18 16:28:55.825857 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 18 16:28:55.825857 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:55.825857 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 16:28:55.825857 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:55.825857 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:55.825857 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 18 16:28:55.826845 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 18 16:28:55.826845 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 18 16:28:55.826845 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 18 16:28:55.826845 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 18 16:28:55.826845 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:55.826845 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 16:28:55.826845 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:55.826845 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:55.826845 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:55.826845 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:55.826845 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:55.826845 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:55.826845 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:55.826845 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:55.826845 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:55.826845 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:55.826845 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:55.828148 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:55.828148 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 18 16:28:55.828148 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 18 16:28:55.828148 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:55.828148 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:55.828148 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 18 16:28:55.828148 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 18 16:28:55.828148 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id af4d1ff625cd4c018356b7ffe2ae5228. Jul 18 16:28:55.828148 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:55.828148 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 468/934] 10.222.0.81 () {60 vars in 1140 bytes} [Mon Jul 18 16:28:55 2022] POST /identity/v3/projects => generated 262 bytes in 250 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:55.828846 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1044c560-2d3d-4ef5-9432-7aabd1baa049 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:55.830199 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:55.948126 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1044c560-2d3d-4ef5-9432-7aabd1baa049 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:55.983565 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f63d1e-dce6-4319-9723-12a43dacb49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:55.984405 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f63d1e-dce6-4319-9723-12a43dacb49e None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:55.984752 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f63d1e-dce6-4319-9723-12a43dacb49e None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:55.985029 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f63d1e-dce6-4319-9723-12a43dacb49e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:55.993067 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f63d1e-dce6-4319-9723-12a43dacb49e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:55.994584 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f63d1e-dce6-4319-9723-12a43dacb49e None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:56.010929 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-65f63d1e-dce6-4319-9723-12a43dacb49e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:28:56.010929 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:56.010929 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:56.010929 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:56.010929 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:56.010929 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:56.010929 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:56.010929 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:56.010929 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:56.010929 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:56.010929 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:56.010929 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:56.010929 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:28:56.010929 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:28:56.010929 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:28:56.011942 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:28:56.011942 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:56.011942 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:56.011942 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:56.011942 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:56.011942 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:56.011942 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:56.011942 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:56.011942 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:56.011942 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:56.011942 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:56.011942 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:56.011942 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:56.011942 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:56.011942 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:56.011942 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:56.011942 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:56.013326 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:28:56.013326 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:28:56.013326 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:28:56.013326 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:28:56.013326 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:28:56.013326 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:28:56.013326 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:28:56.013326 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:56.013326 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 467/935] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Jul 18 16:28:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:56.021043 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f680b5a-d591-4166-8828-e65663339895 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:56.062822 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:56.137083 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f680b5a-d591-4166-8828-e65663339895 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:56.174132 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebe24f6-fe55-44fd-9f39-e49de737533e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:56.174816 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe24f6-fe55-44fd-9f39-e49de737533e None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:56.175104 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe24f6-fe55-44fd-9f39-e49de737533e None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:56.175382 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe24f6-fe55-44fd-9f39-e49de737533e None admin] PATH_INFO: `/v3/projects` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:56.176186 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebe24f6-fe55-44fd-9f39-e49de737533e None admin] RBAC: Adding query filter params (name=service) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:56.176500 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebe24f6-fe55-44fd-9f39-e49de737533e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:56.178178 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebe24f6-fe55-44fd-9f39-e49de737533e None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:56.202412 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 469/936] 10.222.0.81 () {56 vars in 1112 bytes} [Mon Jul 18 16:28:56 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:56.522225 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63484e9-8fbb-4b3a-99c4-da473707ec01 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:56.522505 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63484e9-8fbb-4b3a-99c4-da473707ec01 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:56.522783 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63484e9-8fbb-4b3a-99c4-da473707ec01 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:56.524464 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 468/937] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:28:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:56.530298 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42cab6f-8a90-4b23-82b3-bfc188be4203 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:56.530577 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42cab6f-8a90-4b23-82b3-bfc188be4203 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:56.530851 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42cab6f-8a90-4b23-82b3-bfc188be4203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:56.550526 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-b42cab6f-8a90-4b23-82b3-bfc188be4203 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:56.552080 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-b42cab6f-8a90-4b23-82b3-bfc188be4203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:56.625456 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 470/938] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:28:56.649021 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63484e9-8fbb-4b3a-99c4-da473707ec01 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:56.717664 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:56.764273 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63484e9-8fbb-4b3a-99c4-da473707ec01 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:56.801991 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6104341b-303c-4684-9109-dc0873dae8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:56.802838 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6104341b-303c-4684-9109-dc0873dae8e6 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:56.803116 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6104341b-303c-4684-9109-dc0873dae8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:56.803391 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6104341b-303c-4684-9109-dc0873dae8e6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:56.816251 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6104341b-303c-4684-9109-dc0873dae8e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:28:56.825140 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-6104341b-303c-4684-9109-dc0873dae8e6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 16:28:56.825140 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:56.825140 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:56.825140 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:56.825140 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:56.825140 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:56.825140 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:56.825140 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:56.825140 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:56.825140 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:56.825140 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:56.825140 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:56.825140 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:28:56.825140 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:28:56.825140 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:28:56.825140 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:28:56.826124 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:28:56.826124 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:28:56.826124 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:28:56.826124 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:28:56.826124 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:56.826124 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:56.826124 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:56.826124 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:56.826124 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:56.826124 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:56.826124 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:56.826124 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:56.826124 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:56.826124 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:56.826124 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:56.826124 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:56.827610 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:56.827610 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:56.827610 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:56.827610 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:56.827610 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:28:56.827610 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:28:56.827610 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:28:56.827610 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:28:56.827610 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:28:56.827610 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:28:56.827610 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 16:28:56.827610 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:56.827610 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 469/939] 10.222.0.81 () {56 vars in 1120 bytes} [Mon Jul 18 16:28:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:56.832373 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42cab6f-8a90-4b23-82b3-bfc188be4203 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:56.864269 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:56.943112 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42cab6f-8a90-4b23-82b3-bfc188be4203 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:56.987003 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3df86f-051c-47aa-993f-526d9b313f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:56.987687 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3df86f-051c-47aa-993f-526d9b313f7c None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:56.988006 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3df86f-051c-47aa-993f-526d9b313f7c None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:56.988285 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3df86f-051c-47aa-993f-526d9b313f7c None admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:56.989039 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3df86f-051c-47aa-993f-526d9b313f7c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:56.989350 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3df86f-051c-47aa-993f-526d9b313f7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:56.990726 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3df86f-051c-47aa-993f-526d9b313f7c None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:57.000734 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 471/940] 10.222.0.81 () {56 vars in 1115 bytes} [Mon Jul 18 16:28:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:57.006092 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6104341b-303c-4684-9109-dc0873dae8e6 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:57.122170 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6104341b-303c-4684-9109-dc0873dae8e6 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:57.148141 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:57.160071 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c0db9f-53c7-41ea-a638-8b228e97226e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:57.160878 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0db9f-53c7-41ea-a638-8b228e97226e None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:57.161156 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0db9f-53c7-41ea-a638-8b228e97226e None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:57.161431 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0db9f-53c7-41ea-a638-8b228e97226e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:57.173459 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c0db9f-53c7-41ea-a638-8b228e97226e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:57.175263 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c0db9f-53c7-41ea-a638-8b228e97226e None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:57.194033 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-a8c0db9f-53c7-41ea-a638-8b228e97226e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:57.194033 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:57.194033 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:57.194033 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:57.194033 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:57.194033 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:57.194033 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:57.194033 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:57.194033 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:57.194033 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:57.194033 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:57.194033 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:57.194033 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:28:57.194033 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:28:57.194033 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:28:57.196149 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:28:57.196149 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:57.196149 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:57.196149 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:57.196149 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:57.196149 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:57.196149 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:57.196149 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:57.196149 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:57.196149 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:57.196149 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:57.196149 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:57.196149 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:57.196149 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:57.196149 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:57.196149 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:57.196149 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:57.198186 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:28:57.198186 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:28:57.198186 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:57.198186 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:57.198186 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 470/941] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:28:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:57.199454 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db614806-ef22-421c-b4aa-7899ea13e633 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:57.199966 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db614806-ef22-421c-b4aa-7899ea13e633 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:57.200151 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db614806-ef22-421c-b4aa-7899ea13e633 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:57.201253 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c0db9f-53c7-41ea-a638-8b228e97226e None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:57.201740 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 472/942] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:28:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:57.207100 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344aa5ec-0bed-440f-8faa-6d9361a844b3 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:57.207399 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344aa5ec-0bed-440f-8faa-6d9361a844b3 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:57.207654 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344aa5ec-0bed-440f-8faa-6d9361a844b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:57.225701 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-344aa5ec-0bed-440f-8faa-6d9361a844b3 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:57.226915 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-344aa5ec-0bed-440f-8faa-6d9361a844b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:57.324115 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 473/943] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 16:28:57.325492 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c0db9f-53c7-41ea-a638-8b228e97226e None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:57.344679 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344aa5ec-0bed-440f-8faa-6d9361a844b3 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:57.367060 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:57.369176 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c19e65-def3-4978-970d-ed1c936792a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:57.370274 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c19e65-def3-4978-970d-ed1c936792a3 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:57.370835 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c19e65-def3-4978-970d-ed1c936792a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:57.371407 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c19e65-def3-4978-970d-ed1c936792a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:57.372417 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c19e65-def3-4978-970d-ed1c936792a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:57.372976 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c19e65-def3-4978-970d-ed1c936792a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:57.374739 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c19e65-def3-4978-970d-ed1c936792a3 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:57.396080 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 471/944] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:28:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:57.405097 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c19e65-def3-4978-970d-ed1c936792a3 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:57.451064 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:57.489492 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344aa5ec-0bed-440f-8faa-6d9361a844b3 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:57.534462 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be57f136-536d-4dbf-bdeb-d2eb00ba6a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:57.535697 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57f136-536d-4dbf-bdeb-d2eb00ba6a3d None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:57.536221 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57f136-536d-4dbf-bdeb-d2eb00ba6a3d None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:57.536716 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57f136-536d-4dbf-bdeb-d2eb00ba6a3d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:57.537675 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be57f136-536d-4dbf-bdeb-d2eb00ba6a3d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:57.539412 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be57f136-536d-4dbf-bdeb-d2eb00ba6a3d None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:57.549050 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c19e65-def3-4978-970d-ed1c936792a3 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:57.553081 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-be57f136-536d-4dbf-bdeb-d2eb00ba6a3d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 16:28:57.553081 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:57.553081 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 16:28:57.553081 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 16:28:57.553081 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 16:28:57.553081 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 16:28:57.553081 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 16:28:57.553081 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:28:57.553081 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 16:28:57.553081 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:57.553081 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 16:28:57.553081 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:57.553081 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:57.553081 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:57.553081 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:57.553081 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:57.553081 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:57.554137 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:57.554137 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:57.554137 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:57.554137 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:57.554137 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:57.554137 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:57.554137 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 16:28:57.554137 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 16:28:57.554137 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 16:28:57.554137 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 16:28:57.554137 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:57.554137 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:57.554137 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:57.554137 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:57.554137 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:57.554137 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:57.555608 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:57.555608 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:57.555608 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:57.555608 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:57.555608 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:57.555608 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:57.555608 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:57.555608 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:57.555608 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:57.555608 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:57.555608 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 16:28:57.555608 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:28:57.555608 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 16:28:57.555608 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:57.555608 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 474/945] 10.222.0.81 () {56 vars in 1126 bytes} [Mon Jul 18 16:28:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:57.556716 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f11e7-4926-42ec-bc88-a79cb93cfb27 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:57.556716 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f11e7-4926-42ec-bc88-a79cb93cfb27 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:57.556716 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f11e7-4926-42ec-bc88-a79cb93cfb27 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:57.557911 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 475/946] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:28:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:57.560544 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0f11e7-4926-42ec-bc88-a79cb93cfb27 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:57.590066 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad37d94-20e7-40fd-a4f3-2ae750316c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:57.590798 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad37d94-20e7-40fd-a4f3-2ae750316c09 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:57.591075 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad37d94-20e7-40fd-a4f3-2ae750316c09 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:57.591345 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad37d94-20e7-40fd-a4f3-2ae750316c09 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:57.599272 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad37d94-20e7-40fd-a4f3-2ae750316c09 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:57.600747 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad37d94-20e7-40fd-a4f3-2ae750316c09 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:57.616850 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-cad37d94-20e7-40fd-a4f3-2ae750316c09 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 16:28:57.616850 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:57.616850 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:57.616850 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:57.616850 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:57.616850 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:57.616850 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:57.616850 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:57.616850 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:57.616850 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:57.616850 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:57.616850 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:57.616850 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:28:57.616850 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:28:57.616850 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:28:57.616850 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:28:57.617907 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:57.617907 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:57.617907 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:28:57.617907 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:28:57.617907 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:28:57.617907 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:28:57.617907 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:57.617907 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:57.617907 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:57.617907 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:57.617907 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:57.617907 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:57.617907 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:57.617907 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:57.617907 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:57.617907 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:57.617907 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:57.617907 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:57.618885 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:57.618885 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:57.618885 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:28:57.618885 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:28:57.618885 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:28:57.618885 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:28:57.618885 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:28:57.618885 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:28:57.618885 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 16:28:57.618885 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:57.618885 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 472/947] 10.222.0.81 () {56 vars in 1117 bytes} [Mon Jul 18 16:28:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:57.620646 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c2d9f-a892-49fa-bbfd-dfd67ea613cb None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:57.620646 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c2d9f-a892-49fa-bbfd-dfd67ea613cb None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:57.620646 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c2d9f-a892-49fa-bbfd-dfd67ea613cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:57.640935 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-250c2d9f-a892-49fa-bbfd-dfd67ea613cb None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:57.642151 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-250c2d9f-a892-49fa-bbfd-dfd67ea613cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:57.666150 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:57.692393 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0f11e7-4926-42ec-bc88-a79cb93cfb27 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:57.727977 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 473/948] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:28:57.728935 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c2d9f-a892-49fa-bbfd-dfd67ea613cb None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:57.739935 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a4405d-cdc9-42d9-a23f-f757637686dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:57.740612 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4405d-cdc9-42d9-a23f-f757637686dc None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:57.740897 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4405d-cdc9-42d9-a23f-f757637686dc None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:57.741164 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4405d-cdc9-42d9-a23f-f757637686dc None admin] PATH_INFO: `/v3/services` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:57.742287 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a4405d-cdc9-42d9-a23f-f757637686dc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:57.742594 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a4405d-cdc9-42d9-a23f-f757637686dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:57.744325 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a4405d-cdc9-42d9-a23f-f757637686dc None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:57.750234 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 476/949] 10.222.0.81 () {56 vars in 1122 bytes} [Mon Jul 18 16:28:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:57.751066 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a4405d-cdc9-42d9-a23f-f757637686dc None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:57.763842 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:57.860184 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c2d9f-a892-49fa-bbfd-dfd67ea613cb None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:57.868139 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a4405d-cdc9-42d9-a23f-f757637686dc None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:57.899702 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ff2695-601a-4848-bb27-d9fb9b0aa12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:57.900403 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff2695-601a-4848-bb27-d9fb9b0aa12b None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:57.900683 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff2695-601a-4848-bb27-d9fb9b0aa12b None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:57.900956 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff2695-601a-4848-bb27-d9fb9b0aa12b None admin] PATH_INFO: `/v3/users` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:57.901830 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ff2695-601a-4848-bb27-d9fb9b0aa12b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:57.902138 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ff2695-601a-4848-bb27-d9fb9b0aa12b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:57.903566 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ff2695-601a-4848-bb27-d9fb9b0aa12b None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:57.910677 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f5d6f1-7f12-4779-bf07-d48ef6d18bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:57.911849 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5d6f1-7f12-4779-bf07-d48ef6d18bd6 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:57.912269 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5d6f1-7f12-4779-bf07-d48ef6d18bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:57.912707 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5d6f1-7f12-4779-bf07-d48ef6d18bd6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:57.913529 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f5d6f1-7f12-4779-bf07-d48ef6d18bd6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:57.915036 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f5d6f1-7f12-4779-bf07-d48ef6d18bd6 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:57.928492 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 474/950] 10.222.0.81 () {56 vars in 1149 bytes} [Mon Jul 18 16:28:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:57.928492 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ff2695-601a-4848-bb27-d9fb9b0aa12b None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:57.928786 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-16f5d6f1-7f12-4779-bf07-d48ef6d18bd6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 16:28:57.928786 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:57.928786 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 16:28:57.928786 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 16:28:57.928786 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 16:28:57.928786 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 16:28:57.928786 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 16:28:57.928786 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:28:57.928786 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 16:28:57.928786 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:57.928786 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 16:28:57.928786 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:57.928786 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:57.928786 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:57.928786 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:57.928786 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:57.928786 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:57.929763 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:57.929763 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:57.929763 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:57.929763 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:57.929763 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:57.929763 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:57.929763 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 16:28:57.929763 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 16:28:57.929763 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 16:28:57.929763 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 16:28:57.929763 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:57.929763 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:57.929763 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:57.929763 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:57.929763 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:57.929763 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:57.930743 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:57.930743 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:57.930743 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:57.930743 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:57.930743 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:57.930743 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:57.930743 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:57.930743 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:57.930743 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:57.930743 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:57.930743 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 16:28:57.930743 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:28:57.930743 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 16:28:57.930743 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:57.930743 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 477/951] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Jul 18 16:28:57 2022] GET /identity/v3/services/compute => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:57.932039 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f5d6f1-7f12-4779-bf07-d48ef6d18bd6 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:57.946306 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:58.024892 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:58.052933 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f5d6f1-7f12-4779-bf07-d48ef6d18bd6 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:58.056169 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ff2695-601a-4848-bb27-d9fb9b0aa12b None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:58.093569 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be08b74-3c89-4e2f-acac-fb27e97e725b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:58.094354 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be08b74-3c89-4e2f-acac-fb27e97e725b None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:58.094653 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be08b74-3c89-4e2f-acac-fb27e97e725b None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:58.094900 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be08b74-3c89-4e2f-acac-fb27e97e725b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:58.107961 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be08b74-3c89-4e2f-acac-fb27e97e725b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:58.108592 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79fd97a-fd6c-42ff-83a8-919ae81f31c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:58.109273 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79fd97a-fd6c-42ff-83a8-919ae81f31c9 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:58.109386 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be08b74-3c89-4e2f-acac-fb27e97e725b None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:58.109602 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79fd97a-fd6c-42ff-83a8-919ae81f31c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:58.109910 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79fd97a-fd6c-42ff-83a8-919ae81f31c9 None admin] PATH_INFO: `/v3/services` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:58.110774 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79fd97a-fd6c-42ff-83a8-919ae81f31c9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:58.111310 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79fd97a-fd6c-42ff-83a8-919ae81f31c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:58.112401 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79fd97a-fd6c-42ff-83a8-919ae81f31c9 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:58.118607 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 475/952] 10.222.0.81 () {56 vars in 1122 bytes} [Mon Jul 18 16:28:57 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:58.119598 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79fd97a-fd6c-42ff-83a8-919ae81f31c9 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:58.136481 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-5be08b74-3c89-4e2f-acac-fb27e97e725b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:58.136481 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:58.136481 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:58.136481 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:58.136481 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:58.136481 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:58.136481 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:58.136481 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:58.136481 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:58.136481 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:58.136481 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:58.136481 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:58.136481 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:28:58.136481 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:28:58.136481 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:28:58.137717 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:28:58.137717 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:58.137717 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:58.137717 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:58.137717 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:58.137717 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:58.137717 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:58.137717 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:58.137717 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:58.137717 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:58.137717 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:58.137717 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:58.137717 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:58.137717 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:58.137717 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:58.137717 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:58.137717 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:58.138707 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:28:58.138707 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:28:58.138707 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:58.138707 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:58.138707 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 478/953] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:28:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:58.138996 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be08b74-3c89-4e2f-acac-fb27e97e725b None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:58.218379 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:58.256585 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79fd97a-fd6c-42ff-83a8-919ae81f31c9 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:58.273664 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be08b74-3c89-4e2f-acac-fb27e97e725b None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:58.306978 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc65e3d0-2066-4c5d-95f5-400c17ebcce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:58.308166 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65e3d0-2066-4c5d-95f5-400c17ebcce7 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:58.308836 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65e3d0-2066-4c5d-95f5-400c17ebcce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:58.308836 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65e3d0-2066-4c5d-95f5-400c17ebcce7 None admin] PATH_INFO: `/v3/services` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:58.309584 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc65e3d0-2066-4c5d-95f5-400c17ebcce7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:58.310079 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc65e3d0-2066-4c5d-95f5-400c17ebcce7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:58.312448 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc65e3d0-2066-4c5d-95f5-400c17ebcce7 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:58.326326 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 476/954] 10.222.0.81 () {56 vars in 1112 bytes} [Mon Jul 18 16:28:58 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:58.326326 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc65e3d0-2066-4c5d-95f5-400c17ebcce7 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:58.334405 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b6d14f-933b-4464-99cd-e8ae5055fc78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:58.335072 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6d14f-933b-4464-99cd-e8ae5055fc78 None admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:58.335348 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6d14f-933b-4464-99cd-e8ae5055fc78 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:58.335621 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6d14f-933b-4464-99cd-e8ae5055fc78 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:58.336395 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b6d14f-933b-4464-99cd-e8ae5055fc78 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:58.337778 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b6d14f-933b-4464-99cd-e8ae5055fc78 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:58.343752 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:58.437830 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc65e3d0-2066-4c5d-95f5-400c17ebcce7 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:58.451628 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 479/955] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Jul 18 16:28:58 2022] POST /identity/v3/endpoints => generated 349 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:28:58.452993 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b6d14f-933b-4464-99cd-e8ae5055fc78 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:58.510189 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d9834c-e091-4304-8e13-35d5c25f32ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:58.512043 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d9834c-e091-4304-8e13-35d5c25f32ae None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:58.512572 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d9834c-e091-4304-8e13-35d5c25f32ae None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:58.513046 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d9834c-e091-4304-8e13-35d5c25f32ae None admin] PATH_INFO: `/v3/domains` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:58.514614 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d9834c-e091-4304-8e13-35d5c25f32ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:58.515193 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d9834c-e091-4304-8e13-35d5c25f32ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:58.517084 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d9834c-e091-4304-8e13-35d5c25f32ae None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:58.537045 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 477/956] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:28:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:58.538481 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e0639-6a95-406e-b2c2-2b43a2aee0c9 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:58.538775 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e0639-6a95-406e-b2c2-2b43a2aee0c9 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:58.539057 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e0639-6a95-406e-b2c2-2b43a2aee0c9 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:58.540828 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 478/957] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:28:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:58.541688 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e0639-6a95-406e-b2c2-2b43a2aee0c9 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:58.635932 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b6d14f-933b-4464-99cd-e8ae5055fc78 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:58.641473 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:58.663018 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:58.684459 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e0639-6a95-406e-b2c2-2b43a2aee0c9 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:58.687233 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770b0da-920c-453f-a79f-1f24dbd5bd71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:58.688191 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770b0da-920c-453f-a79f-1f24dbd5bd71 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:58.688424 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770b0da-920c-453f-a79f-1f24dbd5bd71 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:58.688702 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770b0da-920c-453f-a79f-1f24dbd5bd71 None admin] PATH_INFO: `/v3/services` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:58.689467 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1770b0da-920c-453f-a79f-1f24dbd5bd71 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:58.689779 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1770b0da-920c-453f-a79f-1f24dbd5bd71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:58.691209 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1770b0da-920c-453f-a79f-1f24dbd5bd71 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:58.696934 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 480/958] 10.222.0.81 () {56 vars in 1112 bytes} [Mon Jul 18 16:28:58 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:58.698372 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088bab9f-245b-41b3-85ab-7c0f5a2568c2 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:58.698665 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088bab9f-245b-41b3-85ab-7c0f5a2568c2 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:58.698947 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088bab9f-245b-41b3-85ab-7c0f5a2568c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:58.722806 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-088bab9f-245b-41b3-85ab-7c0f5a2568c2 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:58.725069 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-088bab9f-245b-41b3-85ab-7c0f5a2568c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:58.740705 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa794f-1d2f-41f2-a860-0e7fe7cb8993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:58.741981 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa794f-1d2f-41f2-a860-0e7fe7cb8993 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:58.742513 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa794f-1d2f-41f2-a860-0e7fe7cb8993 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:58.742988 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa794f-1d2f-41f2-a860-0e7fe7cb8993 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:58.751514 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfa794f-1d2f-41f2-a860-0e7fe7cb8993 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:58.753118 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfa794f-1d2f-41f2-a860-0e7fe7cb8993 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:58.774708 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-abfa794f-1d2f-41f2-a860-0e7fe7cb8993 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:28:58.774708 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:58.774708 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:58.774708 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:58.774708 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:58.774708 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:58.774708 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:58.774708 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:58.774708 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:58.774708 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:58.774708 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:58.774708 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:58.774708 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:28:58.774708 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:28:58.774708 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:28:58.775761 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:28:58.775761 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:58.775761 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:58.775761 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:58.775761 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:58.775761 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:58.775761 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:58.775761 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:58.775761 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:58.775761 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:58.775761 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:58.775761 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:58.775761 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:58.775761 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:58.775761 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:58.775761 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:58.775761 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:58.776805 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:28:58.776805 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:28:58.776805 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:28:58.776805 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:28:58.776805 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:28:58.776805 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:28:58.776805 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:28:58.776805 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:28:58.779803 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 479/959] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Jul 18 16:28:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:58.789252 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa794f-1d2f-41f2-a860-0e7fe7cb8993 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:58.845296 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 481/960] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:28:58.872023 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088bab9f-245b-41b3-85ab-7c0f5a2568c2 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:58.988221 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa794f-1d2f-41f2-a860-0e7fe7cb8993 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:58.992089 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088bab9f-245b-41b3-85ab-7c0f5a2568c2 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:59.009489 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:59.019862 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:59.028993 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af13d1-a06c-4b91-b2e4-fd2e2d7555e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:59.030338 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af13d1-a06c-4b91-b2e4-fd2e2d7555e8 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:59.030796 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af13d1-a06c-4b91-b2e4-fd2e2d7555e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:59.031260 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af13d1-a06c-4b91-b2e4-fd2e2d7555e8 None admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:59.032281 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47af13d1-a06c-4b91-b2e4-fd2e2d7555e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:59.032771 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47af13d1-a06c-4b91-b2e4-fd2e2d7555e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:59.034352 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47af13d1-a06c-4b91-b2e4-fd2e2d7555e8 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:59.036456 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1b6f6b-a59d-4232-aef8-cc6e96c7a71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:59.037730 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b6f6b-a59d-4232-aef8-cc6e96c7a71e None admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:59.037730 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b6f6b-a59d-4232-aef8-cc6e96c7a71e None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:59.038093 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b6f6b-a59d-4232-aef8-cc6e96c7a71e None admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:59.038920 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1b6f6b-a59d-4232-aef8-cc6e96c7a71e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:59.040528 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1b6f6b-a59d-4232-aef8-cc6e96c7a71e None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:59.049388 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 480/961] 10.222.0.81 () {56 vars in 1148 bytes} [Mon Jul 18 16:28:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:28:59.055091 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af13d1-a06c-4b91-b2e4-fd2e2d7555e8 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:59.114918 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.sql.core [None req-2c1b6f6b-a59d-4232-aef8-cc6e96c7a71e None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 18 16:28:59.114918 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 18 16:28:59.114918 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [parameters: {'user_id': '86ac0c97e6a34abea310840139e76e8d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 18 16:28:59.114918 dv-cinder-846173-3-smb devstack@keystone.service[80544]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80544) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 18 16:28:59.127560 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-2c1b6f6b-a59d-4232-aef8-cc6e96c7a71e None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 18 16:28:59.127560 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:59.127560 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 18 16:28:59.127560 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 18 16:28:59.127560 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 18 16:28:59.127560 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 18 16:28:59.127560 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 18 16:28:59.127560 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application result = self._query(query) Jul 18 16:28:59.127560 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 18 16:28:59.127560 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application conn.query(q) Jul 18 16:28:59.127560 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 18 16:28:59.127560 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 18 16:28:59.127560 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 18 16:28:59.127560 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application result.read() Jul 18 16:28:59.127560 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 18 16:28:59.128775 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 18 16:28:59.128775 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 18 16:28:59.128775 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 18 16:28:59.128775 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 18 16:28:59.128775 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 18 16:28:59.128775 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 18 16:28:59.128775 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 18 16:28:59.128775 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 18 16:28:59.128775 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:59.128775 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 18 16:28:59.128775 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:59.128775 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:59.128775 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 18 16:28:59.128775 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 18 16:28:59.128775 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 18 16:28:59.128775 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 18 16:28:59.128775 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 18 16:28:59.128775 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application next(self.gen) Jul 18 16:28:59.130651 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 18 16:28:59.130651 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application yield resource Jul 18 16:28:59.130651 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 18 16:28:59.130651 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application next(self.gen) Jul 18 16:28:59.130651 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 18 16:28:59.130651 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application self.session.rollback() Jul 18 16:28:59.130651 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 16:28:59.130651 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application self.force_reraise() Jul 18 16:28:59.130651 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 16:28:59.130651 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise self.value Jul 18 16:28:59.130651 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 18 16:28:59.130651 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 18 16:28:59.130651 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 18 16:28:59.130651 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application session.commit() Jul 18 16:28:59.130651 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 18 16:28:59.130651 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 18 16:28:59.130651 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 18 16:28:59.132354 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application self._prepare_impl() Jul 18 16:28:59.132354 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 18 16:28:59.132354 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application self.session.flush() Jul 18 16:28:59.132354 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 18 16:28:59.132354 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application self._flush(objects) Jul 18 16:28:59.132354 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 18 16:28:59.132354 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 18 16:28:59.132354 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 18 16:28:59.132354 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application compat.raise_( Jul 18 16:28:59.132354 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 18 16:28:59.132354 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception Jul 18 16:28:59.132354 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 18 16:28:59.132354 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application flush_context.execute() Jul 18 16:28:59.132354 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 18 16:28:59.132354 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rec.execute(self) Jul 18 16:28:59.132354 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 18 16:28:59.132354 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 18 16:28:59.133698 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 18 16:28:59.133698 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 18 16:28:59.133698 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 18 16:28:59.133698 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 18 16:28:59.133698 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 18 16:28:59.133698 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 18 16:28:59.133698 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 18 16:28:59.133698 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 18 16:28:59.133698 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 18 16:28:59.133698 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 18 16:28:59.133698 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 18 16:28:59.133698 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 18 16:28:59.133698 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 18 16:28:59.133698 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 18 16:28:59.133698 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 18 16:28:59.133698 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception Jul 18 16:28:59.135119 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 18 16:28:59.135119 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 18 16:28:59.135119 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 18 16:28:59.135119 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 18 16:28:59.135119 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 18 16:28:59.135119 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application result = self._query(query) Jul 18 16:28:59.135119 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 18 16:28:59.135119 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application conn.query(q) Jul 18 16:28:59.135119 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 18 16:28:59.135119 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 18 16:28:59.135119 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 18 16:28:59.135119 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application result.read() Jul 18 16:28:59.135119 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 18 16:28:59.135119 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 18 16:28:59.135119 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 18 16:28:59.135119 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 18 16:28:59.136350 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 18 16:28:59.136350 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 18 16:28:59.136350 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 18 16:28:59.136350 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 18 16:28:59.136350 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 18 16:28:59.136350 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 18 16:28:59.136350 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [parameters: {'user_id': '86ac0c97e6a34abea310840139e76e8d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 18 16:28:59.136350 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 18 16:28:59.136350 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:59.136350 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 16:28:59.136350 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:59.136350 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:59.136350 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:59.136350 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:59.136350 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:59.137908 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:59.137908 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:59.137908 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:59.137908 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:59.137908 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:59.137908 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:59.137908 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:59.137908 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 18 16:28:59.137908 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 18 16:28:59.137908 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:59.137908 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:59.137908 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:28:59.137908 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:28:59.137908 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:28:59.137908 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:28:59.137908 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 18 16:28:59.137908 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 18 16:28:59.139434 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 18 16:28:59.139434 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 18 16:28:59.139434 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 18 16:28:59.139434 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 18 16:28:59.139434 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 18 16:28:59.139434 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:59.139434 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 482/962] 10.222.0.81 () {60 vars in 1131 bytes} [Mon Jul 18 16:28:58 2022] POST /identity/v3/users => generated 160 bytes in 254 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:59.140797 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1b6f6b-a59d-4232-aef8-cc6e96c7a71e None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:59.274626 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af13d1-a06c-4b91-b2e4-fd2e2d7555e8 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:59.281202 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1b6f6b-a59d-4232-aef8-cc6e96c7a71e None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:59.328316 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1950e5-fd79-4dcd-bd14-67aea8fa887c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:59.329807 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1950e5-fd79-4dcd-bd14-67aea8fa887c None admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:59.330253 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1950e5-fd79-4dcd-bd14-67aea8fa887c None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:59.330680 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1950e5-fd79-4dcd-bd14-67aea8fa887c None admin] PATH_INFO: `/v3/projects/9d1d84bf334d47e6bfba1141c1fc6f59/users/ea2a096c4b964f03aed533d1e5e96db7/roles/98b55727d5284c6e92f21b06e332215f` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:59.335003 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1950e5-fd79-4dcd-bd14-67aea8fa887c None admin] RBAC: Authorizing `identity:create_grant(project_id=9d1d84bf334d47e6bfba1141c1fc6f59, user_id=ea2a096c4b964f03aed533d1e5e96db7, role_id=98b55727d5284c6e92f21b06e332215f)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:59.337048 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1950e5-fd79-4dcd-bd14-67aea8fa887c None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:59.340521 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790fc169-f746-401c-9373-f56996bd0c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:59.341782 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790fc169-f746-401c-9373-f56996bd0c2c None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:59.341960 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790fc169-f746-401c-9373-f56996bd0c2c None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:59.342355 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790fc169-f746-401c-9373-f56996bd0c2c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:59.350972 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790fc169-f746-401c-9373-f56996bd0c2c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:59.358417 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790fc169-f746-401c-9373-f56996bd0c2c None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:59.370305 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-790fc169-f746-401c-9373-f56996bd0c2c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 18 16:28:59.370305 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:59.370305 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:59.370305 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:59.370305 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:59.370305 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:59.370305 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:59.370305 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:59.370305 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:59.370305 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:59.370305 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:59.370305 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:59.370305 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:28:59.370305 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:28:59.370305 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:28:59.370305 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:28:59.371773 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:59.371773 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:59.371773 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:28:59.371773 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:28:59.371773 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:28:59.371773 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:28:59.371773 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:59.371773 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:59.371773 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:59.371773 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:59.371773 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:59.371773 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:59.371773 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:59.371773 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:59.371773 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:59.371773 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:59.371773 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:59.371773 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:59.373066 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:59.373066 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:59.373066 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:28:59.373066 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:28:59.373066 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:28:59.373066 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:28:59.373066 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:28:59.373066 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:28:59.373066 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 18 16:28:59.373066 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:28:59.374781 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 483/963] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Jul 18 16:28:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:59.380237 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790fc169-f746-401c-9373-f56996bd0c2c None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:59.421891 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:59.488012 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 481/964] 10.222.0.81 () {58 vars in 1439 bytes} [Mon Jul 18 16:28:59 2022] PUT /identity/v3/projects/9d1d84bf334d47e6bfba1141c1fc6f59/users/ea2a096c4b964f03aed533d1e5e96db7/roles/98b55727d5284c6e92f21b06e332215f => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:28:59.512992 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790fc169-f746-401c-9373-f56996bd0c2c None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:59.556259 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2197891-e2de-4b6b-92fe-ccf760f40a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:59.557327 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2197891-e2de-4b6b-92fe-ccf760f40a87 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:59.557982 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2197891-e2de-4b6b-92fe-ccf760f40a87 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:59.558432 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2197891-e2de-4b6b-92fe-ccf760f40a87 None admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:59.559440 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2197891-e2de-4b6b-92fe-ccf760f40a87 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:59.559987 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2197891-e2de-4b6b-92fe-ccf760f40a87 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:59.561688 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2197891-e2de-4b6b-92fe-ccf760f40a87 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:59.608414 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 484/965] 10.222.0.81 () {56 vars in 1101 bytes} [Mon Jul 18 16:28:59 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:00.724189 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231b1ad-012a-48ad-8d62-2a4ced771b5c None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:00.724697 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231b1ad-012a-48ad-8d62-2a4ced771b5c None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:00.724810 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231b1ad-012a-48ad-8d62-2a4ced771b5c None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:00.726278 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 482/966] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:29:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:29:00.733143 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc20ef-621d-4d46-9cc0-af99cdf4ecd4 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:00.733744 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc20ef-621d-4d46-9cc0-af99cdf4ecd4 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:00.734326 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc20ef-621d-4d46-9cc0-af99cdf4ecd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:00.763828 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-e8cc20ef-621d-4d46-9cc0-af99cdf4ecd4 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:00.765450 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-e8cc20ef-621d-4d46-9cc0-af99cdf4ecd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:00.837325 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 485/967] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:29:00.860912 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b231b1ad-012a-48ad-8d62-2a4ced771b5c None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:00.916530 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:00.969830 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9ce78-c2b3-4271-ad19-1e9fe34dfee9 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:00.970058 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b231b1ad-012a-48ad-8d62-2a4ced771b5c None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:00.970149 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9ce78-c2b3-4271-ad19-1e9fe34dfee9 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:00.970379 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9ce78-c2b3-4271-ad19-1e9fe34dfee9 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:00.971939 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 486/968] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:29:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:29:00.978146 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ea6ea-b09c-4d29-aebf-d795eeb0833c None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:00.978146 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ea6ea-b09c-4d29-aebf-d795eeb0833c None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:00.978146 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ea6ea-b09c-4d29-aebf-d795eeb0833c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:01.002099 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-6c7ea6ea-b09c-4d29-aebf-d795eeb0833c None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:01.003282 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-6c7ea6ea-b09c-4d29-aebf-d795eeb0833c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:01.009553 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f3e074-bebd-4d72-a8c4-7503d32c4aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:01.010907 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3e074-bebd-4d72-a8c4-7503d32c4aed None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:01.011191 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3e074-bebd-4d72-a8c4-7503d32c4aed None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:01.011470 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3e074-bebd-4d72-a8c4-7503d32c4aed None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:01.012163 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f3e074-bebd-4d72-a8c4-7503d32c4aed None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:01.013539 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f3e074-bebd-4d72-a8c4-7503d32c4aed None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:01.024430 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:01.028181 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-93f3e074-bebd-4d72-a8c4-7503d32c4aed None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 16:29:01.028181 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:01.028181 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 16:29:01.028181 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 16:29:01.028181 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 16:29:01.028181 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 16:29:01.028181 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 16:29:01.028181 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:29:01.028181 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 16:29:01.028181 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:29:01.028181 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 16:29:01.028181 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:29:01.028181 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:01.028181 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:01.028181 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:01.028181 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:01.028181 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:01.029474 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:01.029474 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:01.029474 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:01.029474 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:01.029474 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:01.029474 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:01.029474 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 16:29:01.029474 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 16:29:01.029474 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 16:29:01.029474 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 16:29:01.029474 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:01.029474 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:01.029474 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:01.029474 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:01.029474 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:01.029474 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:01.030703 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:01.030703 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:01.030703 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:01.030703 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:01.030703 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:01.030703 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:01.030703 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:01.030703 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:01.030703 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:01.030703 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:01.030703 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 16:29:01.030703 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:29:01.030703 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 16:29:01.030703 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:29:01.034560 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 483/969] 10.222.0.81 () {56 vars in 1126 bytes} [Mon Jul 18 16:29:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:01.035379 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f3e074-bebd-4d72-a8c4-7503d32c4aed None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:01.085259 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 487/970] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 16:29:01.108116 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7ea6ea-b09c-4d29-aebf-d795eeb0833c None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:01.143092 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f3e074-bebd-4d72-a8c4-7503d32c4aed None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:01.158152 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:01.180471 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f59440-3607-4218-9e0c-6740309f10d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:01.181138 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f59440-3607-4218-9e0c-6740309f10d7 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:01.181418 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f59440-3607-4218-9e0c-6740309f10d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:01.181690 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f59440-3607-4218-9e0c-6740309f10d7 None admin] PATH_INFO: `/v3/services` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:01.182448 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f59440-3607-4218-9e0c-6740309f10d7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:01.182724 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f59440-3607-4218-9e0c-6740309f10d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:01.184120 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f59440-3607-4218-9e0c-6740309f10d7 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:01.194336 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 484/971] 10.222.0.81 () {56 vars in 1122 bytes} [Mon Jul 18 16:29:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:01.195659 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f59440-3607-4218-9e0c-6740309f10d7 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:01.222133 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7ea6ea-b09c-4d29-aebf-d795eeb0833c None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:01.261565 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02f13d1-c4e3-413d-91bd-5295e3ec3367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:01.262228 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f13d1-c4e3-413d-91bd-5295e3ec3367 None admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:01.262541 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f13d1-c4e3-413d-91bd-5295e3ec3367 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:01.262819 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f13d1-c4e3-413d-91bd-5295e3ec3367 None admin] PATH_INFO: `/v3/services` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:01.263582 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02f13d1-c4e3-413d-91bd-5295e3ec3367 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:01.265098 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02f13d1-c4e3-413d-91bd-5295e3ec3367 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:01.309638 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f59440-3607-4218-9e0c-6740309f10d7 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:01.345764 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fc6a36-4063-4269-ab5b-2b7ffc8b2a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:01.346580 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc6a36-4063-4269-ab5b-2b7ffc8b2a4b None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:01.346869 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc6a36-4063-4269-ab5b-2b7ffc8b2a4b None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:01.347145 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc6a36-4063-4269-ab5b-2b7ffc8b2a4b None admin] PATH_INFO: `/v3/services` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:01.348067 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fc6a36-4063-4269-ab5b-2b7ffc8b2a4b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:01.348401 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fc6a36-4063-4269-ab5b-2b7ffc8b2a4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:01.350154 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fc6a36-4063-4269-ab5b-2b7ffc8b2a4b None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:01.355155 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 488/972] 10.222.0.81 () {60 vars in 1141 bytes} [Mon Jul 18 16:29:01 2022] POST /identity/v3/services => generated 242 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:29:01.360681 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 485/973] 10.222.0.81 () {56 vars in 1122 bytes} [Mon Jul 18 16:29:01 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:01.367696 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02f13d1-c4e3-413d-91bd-5295e3ec3367 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:01.383528 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:01.512871 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02f13d1-c4e3-413d-91bd-5295e3ec3367 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:01.563978 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de47a752-d641-490a-a0a5-7a2089e21b88 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:01.564324 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de47a752-d641-490a-a0a5-7a2089e21b88 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:01.564538 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de47a752-d641-490a-a0a5-7a2089e21b88 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:01.565915 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 486/974] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:29:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:29:01.569531 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26db8b5c-9161-444d-a561-2713408fc086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:01.570901 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db8b5c-9161-444d-a561-2713408fc086 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:01.571346 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5761e4-beae-41dd-8d4d-6bc577b38c6e None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:01.571449 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db8b5c-9161-444d-a561-2713408fc086 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:01.571635 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5761e4-beae-41dd-8d4d-6bc577b38c6e None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:01.571936 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db8b5c-9161-444d-a561-2713408fc086 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:01.572032 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5761e4-beae-41dd-8d4d-6bc577b38c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:01.574429 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26db8b5c-9161-444d-a561-2713408fc086 None admin] RBAC: Adding query filter params (interface=admin, service_id=bcfd1d81fc974c9cb11f63225ee7cc3c, region_id=RegionOne) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:01.574958 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26db8b5c-9161-444d-a561-2713408fc086 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:01.577886 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26db8b5c-9161-444d-a561-2713408fc086 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:01.587950 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 489/975] 10.222.0.81 () {56 vars in 1249 bytes} [Mon Jul 18 16:29:01 2022] GET /identity/v3/endpoints?service_id=bcfd1d81fc974c9cb11f63225ee7cc3c&interface=admin®ion_id=RegionOne => generated 193 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:01.591260 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-3a5761e4-beae-41dd-8d4d-6bc577b38c6e None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:01.592714 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-3a5761e4-beae-41dd-8d4d-6bc577b38c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:01.593740 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26db8b5c-9161-444d-a561-2713408fc086 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:01.630576 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:01.665671 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 487/976] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:01 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 16:29:01.677816 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:01.689514 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5761e4-beae-41dd-8d4d-6bc577b38c6e None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:01.714630 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26db8b5c-9161-444d-a561-2713408fc086 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:01.755484 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e67081b-0e82-41d3-8da0-c3ab22a622f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:01.756368 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67081b-0e82-41d3-8da0-c3ab22a622f2 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:01.756642 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67081b-0e82-41d3-8da0-c3ab22a622f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:01.757176 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67081b-0e82-41d3-8da0-c3ab22a622f2 None admin] PATH_INFO: `/v3/services` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:01.757862 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e67081b-0e82-41d3-8da0-c3ab22a622f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:01.759239 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e67081b-0e82-41d3-8da0-c3ab22a622f2 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:01.766614 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 490/977] 10.222.0.81 () {56 vars in 1087 bytes} [Mon Jul 18 16:29:01 2022] GET /identity/v3/services => generated 1727 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 16:29:01.805040 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5761e4-beae-41dd-8d4d-6bc577b38c6e None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:01.846541 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e7eb89-849c-4c60-ade3-c4d9f6d88a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:01.847378 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e7eb89-849c-4c60-ade3-c4d9f6d88a25 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:01.847666 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e7eb89-849c-4c60-ade3-c4d9f6d88a25 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:01.847973 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e7eb89-849c-4c60-ade3-c4d9f6d88a25 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:01.860860 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e7eb89-849c-4c60-ade3-c4d9f6d88a25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:29:01.869363 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-68e7eb89-849c-4c60-ade3-c4d9f6d88a25 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 16:29:01.869363 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:01.869363 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:01.869363 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:01.869363 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:01.869363 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:01.869363 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:01.869363 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:01.869363 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:01.869363 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:01.869363 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:01.869363 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:01.869363 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:29:01.869363 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:29:01.869363 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:29:01.869363 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:29:01.871002 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:29:01.871002 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:29:01.871002 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:29:01.871002 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:29:01.871002 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:01.871002 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:01.871002 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:01.871002 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:01.871002 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:01.871002 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:01.871002 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:01.871002 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:01.871002 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:01.871002 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:01.871002 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:01.871002 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:01.871993 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:01.871993 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:01.871993 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:01.871993 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:01.871993 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:29:01.871993 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:29:01.871993 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:29:01.871993 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:29:01.871993 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:29:01.871993 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:29:01.871993 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 16:29:01.871993 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:29:01.871993 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 488/978] 10.222.0.81 () {56 vars in 1120 bytes} [Mon Jul 18 16:29:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:29:01.879195 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e67081b-0e82-41d3-8da0-c3ab22a622f2 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:01.992576 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e67081b-0e82-41d3-8da0-c3ab22a622f2 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:02.030263 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af97c939-7200-4f99-86bc-2ccab3cf46dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:02.030891 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97c939-7200-4f99-86bc-2ccab3cf46dc None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:02.031152 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97c939-7200-4f99-86bc-2ccab3cf46dc None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:02.031430 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97c939-7200-4f99-86bc-2ccab3cf46dc None admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:02.032295 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af97c939-7200-4f99-86bc-2ccab3cf46dc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:02.032601 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af97c939-7200-4f99-86bc-2ccab3cf46dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:02.034692 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af97c939-7200-4f99-86bc-2ccab3cf46dc None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:02.038023 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:02.050430 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 491/979] 10.222.0.81 () {56 vars in 1115 bytes} [Mon Jul 18 16:29:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:02.051920 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e7eb89-849c-4c60-ade3-c4d9f6d88a25 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:02.085498 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:02.160735 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e7eb89-849c-4c60-ade3-c4d9f6d88a25 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:02.195399 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a18c8bf-483d-43ca-9e3d-d47d9f3d2c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:02.196218 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18c8bf-483d-43ca-9e3d-d47d9f3d2c4d None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:02.196504 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18c8bf-483d-43ca-9e3d-d47d9f3d2c4d None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:02.196777 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18c8bf-483d-43ca-9e3d-d47d9f3d2c4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:02.207405 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a18c8bf-483d-43ca-9e3d-d47d9f3d2c4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:02.208890 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a18c8bf-483d-43ca-9e3d-d47d9f3d2c4d None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:02.227810 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-0a18c8bf-483d-43ca-9e3d-d47d9f3d2c4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:02.227810 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:02.227810 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:02.227810 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:02.227810 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:02.227810 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:02.227810 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:02.227810 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:02.227810 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:02.227810 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:02.227810 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:02.227810 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:02.227810 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:29:02.227810 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:29:02.227810 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:29:02.228953 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:29:02.228953 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:02.228953 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:02.228953 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:02.228953 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:02.228953 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:02.228953 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:02.228953 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:02.228953 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:02.228953 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:02.228953 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:02.228953 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:02.228953 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:02.228953 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:02.228953 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:02.228953 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:02.228953 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:02.230642 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:29:02.230642 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:29:02.230642 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:02.230642 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:29:02.230642 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 489/980] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:29:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:29:02.236795 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af97c939-7200-4f99-86bc-2ccab3cf46dc None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:02.347069 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af97c939-7200-4f99-86bc-2ccab3cf46dc None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:02.383602 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af909b-c116-4a77-a5b8-f18317e9619b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:02.384305 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af909b-c116-4a77-a5b8-f18317e9619b None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:02.384590 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af909b-c116-4a77-a5b8-f18317e9619b None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:02.384867 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af909b-c116-4a77-a5b8-f18317e9619b None admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:02.385628 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68af909b-c116-4a77-a5b8-f18317e9619b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:02.385930 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68af909b-c116-4a77-a5b8-f18317e9619b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:02.387305 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68af909b-c116-4a77-a5b8-f18317e9619b None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:02.400085 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 492/981] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:29:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:02.406134 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a18c8bf-483d-43ca-9e3d-d47d9f3d2c4d None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:02.499646 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:02.520861 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a18c8bf-483d-43ca-9e3d-d47d9f3d2c4d None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:02.556341 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e91500-59da-4386-b092-037ce7d8919f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:02.557426 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e91500-59da-4386-b092-037ce7d8919f None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:02.558246 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e91500-59da-4386-b092-037ce7d8919f None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:02.558983 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e91500-59da-4386-b092-037ce7d8919f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:02.568236 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e91500-59da-4386-b092-037ce7d8919f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:02.569772 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e91500-59da-4386-b092-037ce7d8919f None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:02.590086 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-33e91500-59da-4386-b092-037ce7d8919f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 16:29:02.590086 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:02.590086 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:02.590086 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:02.590086 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:02.590086 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:02.590086 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:02.590086 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:02.590086 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:02.590086 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:02.590086 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:02.590086 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:02.590086 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:29:02.590086 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:29:02.590086 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:29:02.590086 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:29:02.591403 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:02.591403 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:02.591403 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:29:02.591403 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:29:02.591403 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:29:02.591403 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:29:02.591403 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:02.591403 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:02.591403 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:02.591403 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:02.591403 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:02.591403 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:02.591403 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:02.591403 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:02.591403 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:02.591403 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:02.591403 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:02.591403 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:02.592999 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:02.592999 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:02.592999 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:29:02.592999 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:29:02.592999 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:29:02.592999 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:29:02.592999 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:29:02.592999 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:29:02.592999 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 16:29:02.592999 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:29:02.595826 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 490/982] 10.222.0.81 () {56 vars in 1117 bytes} [Mon Jul 18 16:29:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:02.597319 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af909b-c116-4a77-a5b8-f18317e9619b None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:02.657572 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:02.702684 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af909b-c116-4a77-a5b8-f18317e9619b None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:02.738568 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fdf861-a62f-43dc-9ae8-42a5e47c577c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:02.739238 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fdf861-a62f-43dc-9ae8-42a5e47c577c None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:02.739521 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fdf861-a62f-43dc-9ae8-42a5e47c577c None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:02.739825 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fdf861-a62f-43dc-9ae8-42a5e47c577c None admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:02.740660 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fdf861-a62f-43dc-9ae8-42a5e47c577c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:02.741153 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fdf861-a62f-43dc-9ae8-42a5e47c577c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:02.742738 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fdf861-a62f-43dc-9ae8-42a5e47c577c None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:02.763792 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 493/983] 10.222.0.81 () {56 vars in 1149 bytes} [Mon Jul 18 16:29:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:02.769292 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e91500-59da-4386-b092-037ce7d8919f None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:02.876296 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e91500-59da-4386-b092-037ce7d8919f None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:02.914973 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d58966-425d-4432-beb2-749e80eb76c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:02.915637 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d58966-425d-4432-beb2-749e80eb76c0 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:02.915965 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d58966-425d-4432-beb2-749e80eb76c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:02.916243 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d58966-425d-4432-beb2-749e80eb76c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:02.929114 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:02.989643 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d58966-425d-4432-beb2-749e80eb76c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:02.991074 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d58966-425d-4432-beb2-749e80eb76c0 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:03.091474 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 491/984] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Jul 18 16:29:02 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 16:29:03.097079 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fdf861-a62f-43dc-9ae8-42a5e47c577c None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:03.206569 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fdf861-a62f-43dc-9ae8-42a5e47c577c None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:03.225380 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:03.244925 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726f8870-e4b3-46cc-be60-faca756cf7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:03.245710 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726f8870-e4b3-46cc-be60-faca756cf7be None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:03.245987 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726f8870-e4b3-46cc-be60-faca756cf7be None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:03.246257 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726f8870-e4b3-46cc-be60-faca756cf7be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:03.256263 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726f8870-e4b3-46cc-be60-faca756cf7be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:03.257955 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726f8870-e4b3-46cc-be60-faca756cf7be None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:03.276876 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-726f8870-e4b3-46cc-be60-faca756cf7be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:03.276876 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:03.276876 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:03.276876 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:03.276876 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:03.276876 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:03.276876 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:03.276876 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:03.276876 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:03.276876 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:03.276876 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:03.276876 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:03.276876 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:29:03.276876 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:29:03.276876 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:29:03.277938 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:29:03.277938 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:03.277938 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:03.277938 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:03.277938 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:03.277938 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:03.277938 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:03.277938 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:03.277938 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:03.277938 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:03.277938 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:03.277938 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:03.277938 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:03.277938 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:03.277938 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:03.277938 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:03.277938 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:03.278978 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:29:03.278978 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:29:03.278978 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:03.278978 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:29:03.279965 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 494/985] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:29:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:03.284225 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d58966-425d-4432-beb2-749e80eb76c0 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:03.329713 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:03.391878 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d58966-425d-4432-beb2-749e80eb76c0 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:03.428206 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06fd3eb-e979-446f-9333-328e45850757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:03.428873 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06fd3eb-e979-446f-9333-328e45850757 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:03.429158 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06fd3eb-e979-446f-9333-328e45850757 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:03.429435 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06fd3eb-e979-446f-9333-328e45850757 None admin] PATH_INFO: `/v3/domains` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:03.430161 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06fd3eb-e979-446f-9333-328e45850757 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:03.430468 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06fd3eb-e979-446f-9333-328e45850757 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:03.430739 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caebff7-6da1-4ab8-806a-83740a76e7b8 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:03.431224 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caebff7-6da1-4ab8-806a-83740a76e7b8 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:03.431699 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caebff7-6da1-4ab8-806a-83740a76e7b8 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:03.431894 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06fd3eb-e979-446f-9333-328e45850757 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:03.433713 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 495/986] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:29:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:29:03.438948 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ef6f2-f151-4409-abc1-8c8a263daff5 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:03.439235 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ef6f2-f151-4409-abc1-8c8a263daff5 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:03.439511 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ef6f2-f151-4409-abc1-8c8a263daff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:03.448834 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 492/987] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:29:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:03.450503 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06fd3eb-e979-446f-9333-328e45850757 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:03.457493 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-8b3ef6f2-f151-4409-abc1-8c8a263daff5 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:03.458615 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-8b3ef6f2-f151-4409-abc1-8c8a263daff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:03.534767 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 496/988] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:03 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 16:29:03.557703 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ef6f2-f151-4409-abc1-8c8a263daff5 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:03.579782 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06fd3eb-e979-446f-9333-328e45850757 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:03.581442 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:03.617498 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076a2f3-52e6-4f0d-bc7c-39ea64033ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:03.618294 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076a2f3-52e6-4f0d-bc7c-39ea64033ff0 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:03.618674 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076a2f3-52e6-4f0d-bc7c-39ea64033ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:03.618951 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076a2f3-52e6-4f0d-bc7c-39ea64033ff0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:03.627638 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7076a2f3-52e6-4f0d-bc7c-39ea64033ff0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:03.629102 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7076a2f3-52e6-4f0d-bc7c-39ea64033ff0 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:03.643138 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-7076a2f3-52e6-4f0d-bc7c-39ea64033ff0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:29:03.643138 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:03.643138 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:03.643138 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:03.643138 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:03.643138 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:03.643138 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:03.643138 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:03.643138 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:03.643138 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:03.643138 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:03.643138 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:03.643138 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:29:03.643138 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:29:03.643138 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:29:03.644439 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:29:03.644439 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:03.644439 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:03.644439 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:03.644439 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:03.644439 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:03.644439 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:03.644439 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:03.644439 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:03.644439 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:03.644439 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:03.644439 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:03.644439 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:03.644439 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:03.644439 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:03.644439 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:03.644439 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:03.645533 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:29:03.645533 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:29:03.645533 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:29:03.645533 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:29:03.645533 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:29:03.645533 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:29:03.645533 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:29:03.645533 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:29:03.645533 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 493/989] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Jul 18 16:29:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:29:03.652622 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076a2f3-52e6-4f0d-bc7c-39ea64033ff0 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:03.671277 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:03.676558 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ef6f2-f151-4409-abc1-8c8a263daff5 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:03.717579 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b278cc-34f9-4017-b97f-02d4b37b450d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:03.718280 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b278cc-34f9-4017-b97f-02d4b37b450d None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:03.718538 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b278cc-34f9-4017-b97f-02d4b37b450d None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:03.718881 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b278cc-34f9-4017-b97f-02d4b37b450d None admin] PATH_INFO: `/v3/services/compute` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:03.720003 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b278cc-34f9-4017-b97f-02d4b37b450d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:03.721775 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b278cc-34f9-4017-b97f-02d4b37b450d None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:03.734536 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-24b278cc-34f9-4017-b97f-02d4b37b450d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 16:29:03.734536 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:03.734536 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 16:29:03.734536 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 16:29:03.734536 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 16:29:03.734536 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 16:29:03.734536 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 16:29:03.734536 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:29:03.734536 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 16:29:03.734536 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:29:03.734536 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 16:29:03.734536 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:29:03.734536 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:03.734536 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:03.734536 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:03.734536 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:03.734536 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:03.735642 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:03.735642 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:03.735642 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:03.735642 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:03.735642 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:03.735642 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:03.735642 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 16:29:03.735642 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 16:29:03.735642 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 16:29:03.735642 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 16:29:03.735642 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:03.735642 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:03.735642 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:03.735642 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:03.735642 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:03.735642 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:03.736708 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:03.736708 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:03.736708 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:03.736708 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:03.736708 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:03.736708 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:03.736708 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:03.736708 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:03.736708 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:03.736708 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:03.736708 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 16:29:03.736708 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:29:03.736708 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 16:29:03.736708 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:29:03.736708 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 497/990] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Jul 18 16:29:03 2022] GET /identity/v3/services/compute => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:29:03.741504 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b278cc-34f9-4017-b97f-02d4b37b450d None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:03.767390 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076a2f3-52e6-4f0d-bc7c-39ea64033ff0 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:03.807427 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30fbaf-c84d-482a-94b3-08c233c67e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:03.808133 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30fbaf-c84d-482a-94b3-08c233c67e99 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:03.808417 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30fbaf-c84d-482a-94b3-08c233c67e99 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:03.809355 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30fbaf-c84d-482a-94b3-08c233c67e99 None admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:03.809789 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b30fbaf-c84d-482a-94b3-08c233c67e99 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:03.809986 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b30fbaf-c84d-482a-94b3-08c233c67e99 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:03.811440 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b30fbaf-c84d-482a-94b3-08c233c67e99 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:03.825593 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 494/991] 10.222.0.81 () {56 vars in 1148 bytes} [Mon Jul 18 16:29:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:03.831277 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30fbaf-c84d-482a-94b3-08c233c67e99 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:03.935463 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:03.945450 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b278cc-34f9-4017-b97f-02d4b37b450d None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:03.980205 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d5d920-be32-423a-a504-f64ca1c2585c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:03.980877 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5d920-be32-423a-a504-f64ca1c2585c None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:03.981157 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5d920-be32-423a-a504-f64ca1c2585c None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:03.981424 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5d920-be32-423a-a504-f64ca1c2585c None admin] PATH_INFO: `/v3/services` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:03.982126 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d5d920-be32-423a-a504-f64ca1c2585c None admin] RBAC: Adding query filter params (name=compute) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:03.982432 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d5d920-be32-423a-a504-f64ca1c2585c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:03.983831 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d5d920-be32-423a-a504-f64ca1c2585c None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:03.988929 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 498/992] 10.222.0.81 () {56 vars in 1112 bytes} [Mon Jul 18 16:29:03 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:03.990153 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26573f-d44c-4d3b-bf09-611eacf60ae4 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:03.990442 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26573f-d44c-4d3b-bf09-611eacf60ae4 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:03.990716 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26573f-d44c-4d3b-bf09-611eacf60ae4 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:03.992169 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 499/993] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:29:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:29:03.994219 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a26573f-d44c-4d3b-bf09-611eacf60ae4 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:04.020379 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30fbaf-c84d-482a-94b3-08c233c67e99 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:04.022710 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:04.055436 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9091ec4-5c81-4c25-b297-a7a09b7d99d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:04.056122 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9091ec4-5c81-4c25-b297-a7a09b7d99d3 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:04.056397 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9091ec4-5c81-4c25-b297-a7a09b7d99d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:04.056671 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9091ec4-5c81-4c25-b297-a7a09b7d99d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:04.057508 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9091ec4-5c81-4c25-b297-a7a09b7d99d3 None admin] RBAC: Adding query filter params (role.id=98b55727d5284c6e92f21b06e332215f, scope.project.id=9d1d84bf334d47e6bfba1141c1fc6f59, user.id=ea2a096c4b964f03aed533d1e5e96db7) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:04.057812 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9091ec4-5c81-4c25-b297-a7a09b7d99d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:04.059250 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9091ec4-5c81-4c25-b297-a7a09b7d99d3 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:04.065073 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 495/994] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Jul 18 16:29:03 2022] GET /identity/v3/role_assignments?user.id=ea2a096c4b964f03aed533d1e5e96db7&scope.project.id=9d1d84bf334d47e6bfba1141c1fc6f59&role.id=98b55727d5284c6e92f21b06e332215f => generated 608 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:04.066254 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae0ee89-988c-4c72-b268-3a5b894e834b None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:04.067155 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae0ee89-988c-4c72-b268-3a5b894e834b None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:04.067271 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae0ee89-988c-4c72-b268-3a5b894e834b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:04.085527 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-4ae0ee89-988c-4c72-b268-3a5b894e834b None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:04.086749 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-4ae0ee89-988c-4c72-b268-3a5b894e834b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:04.128226 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a26573f-d44c-4d3b-bf09-611eacf60ae4 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:04.171127 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf782528-d1c7-4ce0-8cc3-34a9fbdb6b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:04.171908 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf782528-d1c7-4ce0-8cc3-34a9fbdb6b50 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:04.172137 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf782528-d1c7-4ce0-8cc3-34a9fbdb6b50 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:04.172522 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf782528-d1c7-4ce0-8cc3-34a9fbdb6b50 None admin] PATH_INFO: `/v3/services` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:04.173150 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf782528-d1c7-4ce0-8cc3-34a9fbdb6b50 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:04.173550 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf782528-d1c7-4ce0-8cc3-34a9fbdb6b50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:04.174964 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf782528-d1c7-4ce0-8cc3-34a9fbdb6b50 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:04.179483 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 496/995] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:04 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:29:04.183758 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 500/996] 10.222.0.81 () {56 vars in 1112 bytes} [Mon Jul 18 16:29:03 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:04.193208 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae0ee89-988c-4c72-b268-3a5b894e834b None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:04.205718 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf782528-d1c7-4ce0-8cc3-34a9fbdb6b50 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:04.216707 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:04.311578 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae0ee89-988c-4c72-b268-3a5b894e834b None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:04.316486 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:04.329152 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf782528-d1c7-4ce0-8cc3-34a9fbdb6b50 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:04.351143 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3e361-31cc-483f-9772-e24b6059702f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:04.352099 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3e361-31cc-483f-9772-e24b6059702f None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:04.352476 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3e361-31cc-483f-9772-e24b6059702f None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:04.352845 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3e361-31cc-483f-9772-e24b6059702f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:04.353732 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa3e361-31cc-483f-9772-e24b6059702f None admin] RBAC: Adding query filter params (interface=public, service_id=c98370fbb25143f5afc4cd51075ed548, region_id=RegionOne) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:04.354164 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa3e361-31cc-483f-9772-e24b6059702f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:04.355680 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa3e361-31cc-483f-9772-e24b6059702f None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:04.361606 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 497/997] 10.222.0.81 () {56 vars in 1251 bytes} [Mon Jul 18 16:29:04 2022] GET /identity/v3/endpoints?service_id=c98370fbb25143f5afc4cd51075ed548&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:04.366995 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3e361-31cc-483f-9772-e24b6059702f None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:04.370313 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee1e8b-bc5b-4d63-92a4-55aa8c23e0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:04.371127 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee1e8b-bc5b-4d63-92a4-55aa8c23e0d7 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:04.371414 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee1e8b-bc5b-4d63-92a4-55aa8c23e0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:04.371693 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee1e8b-bc5b-4d63-92a4-55aa8c23e0d7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:04.372374 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ee1e8b-bc5b-4d63-92a4-55aa8c23e0d7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:04.373746 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ee1e8b-bc5b-4d63-92a4-55aa8c23e0d7 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:04.388111 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-85ee1e8b-bc5b-4d63-92a4-55aa8c23e0d7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 16:29:04.388111 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:04.388111 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 16:29:04.388111 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 16:29:04.388111 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 16:29:04.388111 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 16:29:04.388111 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 16:29:04.388111 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:29:04.388111 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 16:29:04.388111 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:29:04.388111 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 16:29:04.388111 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:29:04.388111 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:04.388111 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:04.388111 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:04.388111 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:04.388111 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:04.389188 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:04.389188 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:04.389188 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:04.389188 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:04.389188 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:04.389188 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:04.389188 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 16:29:04.389188 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 16:29:04.389188 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 16:29:04.389188 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 16:29:04.389188 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:04.389188 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:04.389188 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:04.389188 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:04.389188 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:04.389188 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:04.390078 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:04.390078 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:04.390078 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:04.390078 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:04.390078 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:04.390078 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:04.390078 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:04.390078 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:04.390078 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:04.390078 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:04.390078 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 16:29:04.390078 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:29:04.390078 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 16:29:04.390078 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:29:04.390078 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 501/998] 10.222.0.81 () {56 vars in 1126 bytes} [Mon Jul 18 16:29:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:29:04.395326 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee1e8b-bc5b-4d63-92a4-55aa8c23e0d7 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:04.464690 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:04.487580 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3e361-31cc-483f-9772-e24b6059702f None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:04.513841 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee1e8b-bc5b-4d63-92a4-55aa8c23e0d7 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:04.525077 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa65830-7c53-4e59-a9c6-69ddbe1069fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:04.526426 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa65830-7c53-4e59-a9c6-69ddbe1069fa None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:04.526668 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa65830-7c53-4e59-a9c6-69ddbe1069fa None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:04.527014 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa65830-7c53-4e59-a9c6-69ddbe1069fa None admin] PATH_INFO: `/v3/services` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:04.527899 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa65830-7c53-4e59-a9c6-69ddbe1069fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:04.529339 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa65830-7c53-4e59-a9c6-69ddbe1069fa None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:04.547747 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 498/999] 10.222.0.81 () {56 vars in 1087 bytes} [Mon Jul 18 16:29:04 2022] GET /identity/v3/services => generated 1727 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:29:04.570756 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f77a0-0cee-4025-b5ae-cfd75e98fde8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:04.571471 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f77a0-0cee-4025-b5ae-cfd75e98fde8 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:04.571867 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f77a0-0cee-4025-b5ae-cfd75e98fde8 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:04.572212 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f77a0-0cee-4025-b5ae-cfd75e98fde8 None admin] PATH_INFO: `/v3/services` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:04.573071 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94f77a0-0cee-4025-b5ae-cfd75e98fde8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:04.573469 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94f77a0-0cee-4025-b5ae-cfd75e98fde8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:04.575122 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94f77a0-0cee-4025-b5ae-cfd75e98fde8 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:04.581502 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 502/1000] 10.222.0.81 () {56 vars in 1122 bytes} [Mon Jul 18 16:29:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:04.587478 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa65830-7c53-4e59-a9c6-69ddbe1069fa None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:04.709990 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa65830-7c53-4e59-a9c6-69ddbe1069fa None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:04.747417 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13b706a-982a-4c32-b513-08f3e09887b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:04.748124 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b706a-982a-4c32-b513-08f3e09887b8 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:04.748409 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b706a-982a-4c32-b513-08f3e09887b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:04.748686 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b706a-982a-4c32-b513-08f3e09887b8 None admin] PATH_INFO: `/v3/services` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:04.749390 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13b706a-982a-4c32-b513-08f3e09887b8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:04.749696 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13b706a-982a-4c32-b513-08f3e09887b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:04.751066 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13b706a-982a-4c32-b513-08f3e09887b8 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:04.756505 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 499/1001] 10.222.0.81 () {56 vars in 1122 bytes} [Mon Jul 18 16:29:04 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:04.763212 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f77a0-0cee-4025-b5ae-cfd75e98fde8 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:04.784239 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:04.875181 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f77a0-0cee-4025-b5ae-cfd75e98fde8 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:04.914571 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b43712-f01c-4282-9dd2-90af12942c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:04.915485 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b43712-f01c-4282-9dd2-90af12942c16 None admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:04.915819 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b43712-f01c-4282-9dd2-90af12942c16 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:04.916098 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b43712-f01c-4282-9dd2-90af12942c16 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:04.916994 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b43712-f01c-4282-9dd2-90af12942c16 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:04.918967 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b43712-f01c-4282-9dd2-90af12942c16 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:05.035689 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 503/1002] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Jul 18 16:29:04 2022] POST /identity/v3/endpoints => generated 325 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:29:06.148949 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d3e92-3376-4fc2-b8c3-af384bc5bd6d None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:06.149542 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d3e92-3376-4fc2-b8c3-af384bc5bd6d None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:06.149542 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d3e92-3376-4fc2-b8c3-af384bc5bd6d None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:06.151437 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 500/1003] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:29:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:29:06.157113 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd4eca8-d30e-4aa2-92e1-9f6e7b40aa00 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:06.157548 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd4eca8-d30e-4aa2-92e1-9f6e7b40aa00 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:06.157659 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd4eca8-d30e-4aa2-92e1-9f6e7b40aa00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:06.176180 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-ccd4eca8-d30e-4aa2-92e1-9f6e7b40aa00 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:06.177445 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-ccd4eca8-d30e-4aa2-92e1-9f6e7b40aa00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:06.257475 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 504/1004] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:06 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:29:06.278620 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d3e92-3376-4fc2-b8c3-af384bc5bd6d None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:06.289929 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:06.383474 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d3e92-3376-4fc2-b8c3-af384bc5bd6d None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:06.418536 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a60d6b9-aec4-46a8-8b01-82838fae643f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:06.419238 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60d6b9-aec4-46a8-8b01-82838fae643f None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:06.419512 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60d6b9-aec4-46a8-8b01-82838fae643f None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:06.419807 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60d6b9-aec4-46a8-8b01-82838fae643f None admin] PATH_INFO: `/v3/services/image` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:06.420455 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a60d6b9-aec4-46a8-8b01-82838fae643f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:06.421812 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a60d6b9-aec4-46a8-8b01-82838fae643f None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:06.433816 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-8a60d6b9-aec4-46a8-8b01-82838fae643f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 16:29:06.433816 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:06.433816 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 16:29:06.433816 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 16:29:06.433816 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 16:29:06.433816 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 16:29:06.433816 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 16:29:06.433816 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:29:06.433816 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 16:29:06.433816 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:29:06.433816 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 16:29:06.433816 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:29:06.433816 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:06.433816 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:06.433816 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:06.433816 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:06.433816 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:06.434944 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:06.434944 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:06.434944 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:06.434944 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:06.434944 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:06.434944 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:06.434944 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 16:29:06.434944 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 16:29:06.434944 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 16:29:06.434944 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 16:29:06.434944 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:06.434944 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:06.434944 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:06.434944 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:06.434944 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:06.434944 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:06.435847 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:06.435847 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:06.435847 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:06.435847 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:06.435847 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:06.435847 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:06.435847 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:06.435847 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:06.435847 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:06.435847 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:06.435847 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 16:29:06.435847 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:29:06.435847 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 16:29:06.435847 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:29:06.443294 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 501/1005] 10.222.0.81 () {56 vars in 1105 bytes} [Mon Jul 18 16:29:06 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:06.443461 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd4eca8-d30e-4aa2-92e1-9f6e7b40aa00 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:06.444971 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:06.563440 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd4eca8-d30e-4aa2-92e1-9f6e7b40aa00 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:06.596177 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46813586-4dd1-49c5-a8d4-b3eb7a0b5e5e None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:06.596513 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46813586-4dd1-49c5-a8d4-b3eb7a0b5e5e None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:06.596725 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46813586-4dd1-49c5-a8d4-b3eb7a0b5e5e None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:06.598145 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 502/1006] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:29:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:29:06.603483 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ebfaaf-f08b-433a-a41b-38f146f20ae3 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:06.604336 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ebfaaf-f08b-433a-a41b-38f146f20ae3 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:06.604625 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ebfaaf-f08b-433a-a41b-38f146f20ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:06.605195 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce06d8-7f7f-4ef0-93fd-964a4a8ebe98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:06.606027 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce06d8-7f7f-4ef0-93fd-964a4a8ebe98 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:06.606480 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce06d8-7f7f-4ef0-93fd-964a4a8ebe98 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:06.606910 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce06d8-7f7f-4ef0-93fd-964a4a8ebe98 None admin] PATH_INFO: `/v3/services` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:06.607818 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ce06d8-7f7f-4ef0-93fd-964a4a8ebe98 None admin] RBAC: Adding query filter params (name=image) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:06.608290 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ce06d8-7f7f-4ef0-93fd-964a4a8ebe98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:06.609838 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ce06d8-7f7f-4ef0-93fd-964a4a8ebe98 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:06.615576 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 505/1007] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:29:06 2022] GET /identity/v3/services?name=image => generated 122 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:06.622755 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce06d8-7f7f-4ef0-93fd-964a4a8ebe98 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:06.628537 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-75ebfaaf-f08b-433a-a41b-38f146f20ae3 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:06.629757 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-75ebfaaf-f08b-433a-a41b-38f146f20ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:06.698110 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:06.712229 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 503/1008] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:06 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 16:29:06.734534 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce06d8-7f7f-4ef0-93fd-964a4a8ebe98 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:06.735311 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ebfaaf-f08b-433a-a41b-38f146f20ae3 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:06.737523 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:06.775680 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff518b77-75b0-427c-af5d-ccd40546609a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:06.776374 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff518b77-75b0-427c-af5d-ccd40546609a None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:06.776657 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff518b77-75b0-427c-af5d-ccd40546609a None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:06.776968 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff518b77-75b0-427c-af5d-ccd40546609a None admin] PATH_INFO: `/v3/services` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:06.777669 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff518b77-75b0-427c-af5d-ccd40546609a None admin] RBAC: Adding query filter params (type=image) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:06.777975 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff518b77-75b0-427c-af5d-ccd40546609a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:06.779347 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff518b77-75b0-427c-af5d-ccd40546609a None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:06.795742 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 506/1009] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:29:06 2022] GET /identity/v3/services?type=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:06.864945 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ebfaaf-f08b-433a-a41b-38f146f20ae3 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:06.906715 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4668b6-3296-49cf-b41e-6c6dc3028335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:06.907628 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4668b6-3296-49cf-b41e-6c6dc3028335 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:06.907992 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4668b6-3296-49cf-b41e-6c6dc3028335 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:06.908281 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4668b6-3296-49cf-b41e-6c6dc3028335 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:06.908950 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4668b6-3296-49cf-b41e-6c6dc3028335 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:06.910378 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4668b6-3296-49cf-b41e-6c6dc3028335 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:06.923150 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-3a4668b6-3296-49cf-b41e-6c6dc3028335 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 16:29:06.923150 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:06.923150 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 16:29:06.923150 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 16:29:06.923150 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 16:29:06.923150 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 16:29:06.923150 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 16:29:06.923150 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:29:06.923150 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 16:29:06.923150 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:29:06.923150 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 16:29:06.923150 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:29:06.923150 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:06.923150 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:06.923150 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:06.923150 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:06.923150 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:06.924361 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:06.924361 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:06.924361 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:06.924361 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:06.924361 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:06.924361 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:06.924361 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 16:29:06.924361 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 16:29:06.924361 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 16:29:06.924361 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 16:29:06.924361 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:06.924361 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:06.924361 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:06.924361 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:06.924361 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:06.924361 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:06.925226 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:06.925226 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:06.925226 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:06.925226 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:06.925226 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:06.925226 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:06.925226 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:06.925226 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:06.925226 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:06.925226 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:06.925226 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 16:29:06.925226 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:29:06.925226 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 16:29:06.925226 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:29:06.925226 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 504/1010] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Jul 18 16:29:06 2022] GET /identity/v3/services/compute => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:29:06.930721 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff518b77-75b0-427c-af5d-ccd40546609a None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:07.064815 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff518b77-75b0-427c-af5d-ccd40546609a None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:07.106511 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:07.110394 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf706a-5528-4e01-8118-40835dad55d3 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:07.110680 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf706a-5528-4e01-8118-40835dad55d3 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:07.110960 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf706a-5528-4e01-8118-40835dad55d3 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:07.115774 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 505/1011] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:29:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:29:07.118660 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a11672-4359-4c17-9a40-9c6900977870 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:07.122760 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a11672-4359-4c17-9a40-9c6900977870 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:07.122760 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a11672-4359-4c17-9a40-9c6900977870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:07.122977 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff030961-cac5-4411-9320-a997764541f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:07.122977 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff030961-cac5-4411-9320-a997764541f3 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:07.122977 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff030961-cac5-4411-9320-a997764541f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:07.122977 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff030961-cac5-4411-9320-a997764541f3 None admin] PATH_INFO: `/v3/services` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:07.123307 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff030961-cac5-4411-9320-a997764541f3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:07.123307 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff030961-cac5-4411-9320-a997764541f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:07.123455 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff030961-cac5-4411-9320-a997764541f3 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:07.131300 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 507/1012] 10.222.0.81 () {56 vars in 1112 bytes} [Mon Jul 18 16:29:06 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:07.137950 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff030961-cac5-4411-9320-a997764541f3 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:07.144391 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-b1a11672-4359-4c17-9a40-9c6900977870 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:07.145640 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-b1a11672-4359-4c17-9a40-9c6900977870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:07.223837 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:07.233248 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 506/1013] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:07 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 16:29:07.257045 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a11672-4359-4c17-9a40-9c6900977870 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:07.277271 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff030961-cac5-4411-9320-a997764541f3 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:07.319844 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01de7fd6-eeef-4056-83bc-75889afff5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:07.320435 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de7fd6-eeef-4056-83bc-75889afff5e0 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:07.320714 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de7fd6-eeef-4056-83bc-75889afff5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:07.320992 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de7fd6-eeef-4056-83bc-75889afff5e0 None admin] PATH_INFO: `/v3/services` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:07.321696 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01de7fd6-eeef-4056-83bc-75889afff5e0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:07.321997 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01de7fd6-eeef-4056-83bc-75889afff5e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:07.323968 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01de7fd6-eeef-4056-83bc-75889afff5e0 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:07.334787 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 508/1014] 10.222.0.81 () {56 vars in 1112 bytes} [Mon Jul 18 16:29:07 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:07.336038 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01de7fd6-eeef-4056-83bc-75889afff5e0 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:07.407916 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a11672-4359-4c17-9a40-9c6900977870 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:07.418209 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:07.454501 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a52ae4-62b0-4762-93ad-757dbc8962c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:07.455298 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a52ae4-62b0-4762-93ad-757dbc8962c0 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:07.455585 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a52ae4-62b0-4762-93ad-757dbc8962c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:07.455897 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a52ae4-62b0-4762-93ad-757dbc8962c0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:07.457333 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a52ae4-62b0-4762-93ad-757dbc8962c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:07.458823 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a52ae4-62b0-4762-93ad-757dbc8962c0 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:07.466611 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 507/1015] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:29:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:07.467605 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a52ae4-62b0-4762-93ad-757dbc8962c0 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:07.485788 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01de7fd6-eeef-4056-83bc-75889afff5e0 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:07.528315 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31908f9b-93f9-421d-bdee-670e2ca814f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:07.529000 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31908f9b-93f9-421d-bdee-670e2ca814f2 None admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:07.529262 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31908f9b-93f9-421d-bdee-670e2ca814f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:07.529535 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31908f9b-93f9-421d-bdee-670e2ca814f2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:07.530285 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31908f9b-93f9-421d-bdee-670e2ca814f2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:07.531740 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31908f9b-93f9-421d-bdee-670e2ca814f2 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:07.548710 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:07.589869 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a52ae4-62b0-4762-93ad-757dbc8962c0 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:07.624814 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7bbbe-8777-4b4f-8b6e-91e01baa4864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:07.625474 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7bbbe-8777-4b4f-8b6e-91e01baa4864 None admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:07.625751 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7bbbe-8777-4b4f-8b6e-91e01baa4864 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:07.626020 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7bbbe-8777-4b4f-8b6e-91e01baa4864 None admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:07.626721 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c7bbbe-8777-4b4f-8b6e-91e01baa4864 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:07.628182 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c7bbbe-8777-4b4f-8b6e-91e01baa4864 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:07.669049 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 509/1016] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Jul 18 16:29:07 2022] POST /identity/v3/endpoints => generated 334 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:29:07.767479 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 508/1017] 10.222.0.81 () {60 vars in 1141 bytes} [Mon Jul 18 16:29:07 2022] POST /identity/v3/projects => generated 311 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:29:08.886464 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d906a-5b35-4299-ac91-864f19cb39c4 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:08.887198 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d906a-5b35-4299-ac91-864f19cb39c4 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:08.887198 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d906a-5b35-4299-ac91-864f19cb39c4 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:08.888428 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 510/1018] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:29:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:29:08.895568 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1bc0dc-180c-406e-bcce-51fe9323f770 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:08.896125 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1bc0dc-180c-406e-bcce-51fe9323f770 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:08.896546 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1bc0dc-180c-406e-bcce-51fe9323f770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:08.922809 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-dc1bc0dc-180c-406e-bcce-51fe9323f770 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:08.924456 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-dc1bc0dc-180c-406e-bcce-51fe9323f770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:09.047764 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 509/1019] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:08 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:29:09.068977 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363d906a-5b35-4299-ac91-864f19cb39c4 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:09.179931 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363d906a-5b35-4299-ac91-864f19cb39c4 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:09.199585 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:09.220761 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b4bef0-333f-4346-a1b8-d1fd694f3866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:09.221446 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4bef0-333f-4346-a1b8-d1fd694f3866 None admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:09.221721 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4bef0-333f-4346-a1b8-d1fd694f3866 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:09.221994 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4bef0-333f-4346-a1b8-d1fd694f3866 None admin] PATH_INFO: `/v3/services` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:09.222735 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b4bef0-333f-4346-a1b8-d1fd694f3866 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:09.224179 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b4bef0-333f-4346-a1b8-d1fd694f3866 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:09.309783 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 511/1020] 10.222.0.81 () {60 vars in 1141 bytes} [Mon Jul 18 16:29:09 2022] POST /identity/v3/services => generated 242 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:29:09.919982 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a4f68-5254-4c0e-9719-09a75c2638c7 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:09.920579 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a4f68-5254-4c0e-9719-09a75c2638c7 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:09.920579 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a4f68-5254-4c0e-9719-09a75c2638c7 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:09.922215 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 510/1021] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:29:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:29:09.927681 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b3d67-7651-45f9-8b19-3e14cd251fa6 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:09.928284 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e872d-c228-45e4-82b8-e4d30bb154fc None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:09.928367 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b3d67-7651-45f9-8b19-3e14cd251fa6 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:09.928565 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e872d-c228-45e4-82b8-e4d30bb154fc None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:09.928698 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b3d67-7651-45f9-8b19-3e14cd251fa6 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:09.928829 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e872d-c228-45e4-82b8-e4d30bb154fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:09.930010 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 512/1022] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:29:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:29:09.938726 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4593a-e9b2-4c51-95cd-253bd9af0a79 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:09.939015 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4593a-e9b2-4c51-95cd-253bd9af0a79 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:09.939276 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4593a-e9b2-4c51-95cd-253bd9af0a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:09.951388 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-df9e872d-c228-45e4-82b8-e4d30bb154fc None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:09.952801 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-df9e872d-c228-45e4-82b8-e4d30bb154fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:09.959213 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-8ef4593a-e9b2-4c51-95cd-253bd9af0a79 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:09.960477 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-8ef4593a-e9b2-4c51-95cd-253bd9af0a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:09.996941 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:10.039571 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 511/1023] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:09 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 16:29:10.050275 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 513/1024] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:09 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 16:29:10.065954 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e872d-c228-45e4-82b8-e4d30bb154fc None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:10.075123 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef4593a-e9b2-4c51-95cd-253bd9af0a79 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:10.193982 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e872d-c228-45e4-82b8-e4d30bb154fc None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:10.203786 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef4593a-e9b2-4c51-95cd-253bd9af0a79 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:10.213816 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:10.231418 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab8fefd-3906-477b-89ac-e63c7d8ed579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:10.231998 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8fefd-3906-477b-89ac-e63c7d8ed579 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:10.231998 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8fefd-3906-477b-89ac-e63c7d8ed579 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:10.235390 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8fefd-3906-477b-89ac-e63c7d8ed579 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:10.235390 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab8fefd-3906-477b-89ac-e63c7d8ed579 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:10.235390 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab8fefd-3906-477b-89ac-e63c7d8ed579 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:10.241461 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 512/1025] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:29:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:10.271658 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab8fefd-3906-477b-89ac-e63c7d8ed579 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:10.271844 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83a2cb8-ee10-467d-828b-d3071f361f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:10.271844 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83a2cb8-ee10-467d-828b-d3071f361f7c None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:10.271844 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83a2cb8-ee10-467d-828b-d3071f361f7c None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:10.271844 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83a2cb8-ee10-467d-828b-d3071f361f7c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:10.272167 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83a2cb8-ee10-467d-828b-d3071f361f7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:29:10.282473 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-e83a2cb8-ee10-467d-828b-d3071f361f7c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 16:29:10.282473 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:10.282473 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:10.282473 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:10.282473 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:10.282473 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:10.282473 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:10.282473 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:10.282473 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:10.282473 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:10.282473 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:10.282473 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:10.282473 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:29:10.282473 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:29:10.282473 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:29:10.282473 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:29:10.283876 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:29:10.283876 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:29:10.283876 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:29:10.283876 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:29:10.283876 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:10.283876 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:10.283876 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:10.283876 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:10.283876 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:10.283876 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:10.283876 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:10.283876 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:10.283876 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:10.283876 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:10.283876 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:10.283876 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:10.290663 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:10.290663 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:10.290663 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:10.290663 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:10.290663 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:29:10.290663 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:29:10.290663 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:29:10.290663 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:29:10.290663 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:29:10.290663 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:29:10.290663 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 16:29:10.290663 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:29:10.290663 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 514/1026] 10.222.0.81 () {56 vars in 1120 bytes} [Mon Jul 18 16:29:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:29:10.292020 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:10.292164 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83a2cb8-ee10-467d-828b-d3071f361f7c None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:10.365405 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab8fefd-3906-477b-89ac-e63c7d8ed579 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:10.402562 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daccbb4-e3e4-45c0-a48f-8da118aa2f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:10.403238 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daccbb4-e3e4-45c0-a48f-8da118aa2f66 None admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:10.403517 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daccbb4-e3e4-45c0-a48f-8da118aa2f66 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:10.403818 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daccbb4-e3e4-45c0-a48f-8da118aa2f66 None admin] PATH_INFO: `/v3/users` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:10.404723 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daccbb4-e3e4-45c0-a48f-8da118aa2f66 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:10.406164 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daccbb4-e3e4-45c0-a48f-8da118aa2f66 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:10.407911 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83a2cb8-ee10-467d-828b-d3071f361f7c None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:10.445325 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3690ff24-a64a-432c-b58a-e9d7295098ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:10.445917 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690ff24-a64a-432c-b58a-e9d7295098ea None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:10.446203 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690ff24-a64a-432c-b58a-e9d7295098ea None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:10.446483 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690ff24-a64a-432c-b58a-e9d7295098ea None admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:10.447355 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3690ff24-a64a-432c-b58a-e9d7295098ea None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:10.447668 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3690ff24-a64a-432c-b58a-e9d7295098ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:10.449167 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3690ff24-a64a-432c-b58a-e9d7295098ea None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:10.465614 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 515/1027] 10.222.0.81 () {56 vars in 1115 bytes} [Mon Jul 18 16:29:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:10.472040 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3690ff24-a64a-432c-b58a-e9d7295098ea None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:10.582562 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3690ff24-a64a-432c-b58a-e9d7295098ea None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:10.628892 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c71ac2c-9851-430b-ad88-411716293972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:10.629854 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c71ac2c-9851-430b-ad88-411716293972 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:10.630239 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c71ac2c-9851-430b-ad88-411716293972 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:10.630631 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c71ac2c-9851-430b-ad88-411716293972 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:10.644235 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c71ac2c-9851-430b-ad88-411716293972 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:10.645819 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c71ac2c-9851-430b-ad88-411716293972 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:10.658417 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 513/1028] 10.222.0.81 () {60 vars in 1132 bytes} [Mon Jul 18 16:29:10 2022] POST /identity/v3/users => generated 285 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:29:10.678077 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-6c71ac2c-9851-430b-ad88-411716293972 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:10.678077 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:10.678077 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:10.678077 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:10.678077 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:10.678077 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:10.678077 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:10.678077 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:10.678077 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:10.678077 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:10.678077 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:10.678077 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:10.678077 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:29:10.678077 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:29:10.678077 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:29:10.679675 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:29:10.679675 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:10.679675 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:10.679675 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:10.679675 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:10.679675 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:10.679675 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:10.679675 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:10.679675 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:10.679675 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:10.679675 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:10.679675 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:10.679675 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:10.679675 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:10.679675 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:10.679675 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:10.679675 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:10.682195 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:29:10.682195 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:29:10.682195 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:10.682195 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:29:10.682195 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 516/1029] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:29:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:29:10.691768 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daccbb4-e3e4-45c0-a48f-8da118aa2f66 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:10.717480 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:10.824698 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:10.837193 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daccbb4-e3e4-45c0-a48f-8da118aa2f66 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:10.887660 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61652cd-81fc-4b01-8767-305be17ea6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:10.889592 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61652cd-81fc-4b01-8767-305be17ea6d0 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:10.889592 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61652cd-81fc-4b01-8767-305be17ea6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:10.889592 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61652cd-81fc-4b01-8767-305be17ea6d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:10.889871 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61652cd-81fc-4b01-8767-305be17ea6d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:10.889959 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61652cd-81fc-4b01-8767-305be17ea6d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:10.891346 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61652cd-81fc-4b01-8767-305be17ea6d0 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:10.906082 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 514/1030] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:29:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:10.911839 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c71ac2c-9851-430b-ad88-411716293972 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:11.026656 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:11.062952 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c71ac2c-9851-430b-ad88-411716293972 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:11.128188 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd54c96-6fb9-4129-9c3d-fe0d505c7c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:11.129552 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd54c96-6fb9-4129-9c3d-fe0d505c7c1d None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:11.130039 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd54c96-6fb9-4129-9c3d-fe0d505c7c1d None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:11.130499 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd54c96-6fb9-4129-9c3d-fe0d505c7c1d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:11.145724 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd54c96-6fb9-4129-9c3d-fe0d505c7c1d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:11.148515 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd54c96-6fb9-4129-9c3d-fe0d505c7c1d None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:11.177821 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-dfd54c96-6fb9-4129-9c3d-fe0d505c7c1d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 16:29:11.177821 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:11.177821 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:11.177821 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:11.177821 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:11.177821 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:11.177821 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:11.177821 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:11.177821 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:11.177821 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:11.177821 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:11.177821 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:11.177821 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:29:11.177821 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:29:11.177821 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:29:11.177821 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:29:11.180258 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:11.180258 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:11.180258 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:29:11.180258 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:29:11.180258 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:29:11.180258 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:29:11.180258 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:11.180258 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:11.180258 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:11.180258 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:11.180258 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:11.180258 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:11.180258 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:11.180258 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:11.180258 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:11.180258 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:11.180258 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:11.180258 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:11.182307 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:11.182307 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:11.182307 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:29:11.182307 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:29:11.182307 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:29:11.182307 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:29:11.182307 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:29:11.182307 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:29:11.182307 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 16:29:11.182307 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:29:11.188022 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 517/1031] 10.222.0.81 () {56 vars in 1093 bytes} [Mon Jul 18 16:29:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:29:11.189601 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61652cd-81fc-4b01-8767-305be17ea6d0 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:11.359653 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61652cd-81fc-4b01-8767-305be17ea6d0 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:11.425981 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f586f-aec9-4c16-ad09-3030d617a025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:11.427385 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f586f-aec9-4c16-ad09-3030d617a025 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:11.427926 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f586f-aec9-4c16-ad09-3030d617a025 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:11.428420 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f586f-aec9-4c16-ad09-3030d617a025 None admin] PATH_INFO: `/v3/users` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:11.430128 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7f586f-aec9-4c16-ad09-3030d617a025 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:11.430691 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7f586f-aec9-4c16-ad09-3030d617a025 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:11.433790 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7f586f-aec9-4c16-ad09-3030d617a025 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:11.480627 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 515/1032] 10.222.0.81 () {56 vars in 1133 bytes} [Mon Jul 18 16:29:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:11.481653 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b0255-35bf-4d21-b0f8-5888129a8d2e None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:11.481966 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b0255-35bf-4d21-b0f8-5888129a8d2e None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:11.482236 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b0255-35bf-4d21-b0f8-5888129a8d2e None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:11.483805 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 518/1033] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:29:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:29:11.489568 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad6dc3-4800-40ce-896b-ff83d5e97861 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:11.489879 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b0255-35bf-4d21-b0f8-5888129a8d2e None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:11.490055 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad6dc3-4800-40ce-896b-ff83d5e97861 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:11.490224 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad6dc3-4800-40ce-896b-ff83d5e97861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:11.509276 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-b9ad6dc3-4800-40ce-896b-ff83d5e97861 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:11.510692 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-b9ad6dc3-4800-40ce-896b-ff83d5e97861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:11.515467 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:11.596601 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 516/1034] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:11 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:29:11.619436 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad6dc3-4800-40ce-896b-ff83d5e97861 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:11.656549 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b0255-35bf-4d21-b0f8-5888129a8d2e None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:11.713633 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e9201-55df-441a-85b6-6c8d1e37d7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:11.714620 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e9201-55df-441a-85b6-6c8d1e37d7eb None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:11.715139 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e9201-55df-441a-85b6-6c8d1e37d7eb None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:11.715504 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e9201-55df-441a-85b6-6c8d1e37d7eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:11.736010 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:11.740968 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad6dc3-4800-40ce-896b-ff83d5e97861 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:11.781430 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39cb868-8da5-4b1f-a88f-17a73a81b5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:11.782244 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39cb868-8da5-4b1f-a88f-17a73a81b5ae None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:11.782562 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39cb868-8da5-4b1f-a88f-17a73a81b5ae None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:11.782812 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39cb868-8da5-4b1f-a88f-17a73a81b5ae None admin] PATH_INFO: `/v3/services/image` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:11.783460 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39cb868-8da5-4b1f-a88f-17a73a81b5ae None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:11.784909 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39cb868-8da5-4b1f-a88f-17a73a81b5ae None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:11.802698 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-c39cb868-8da5-4b1f-a88f-17a73a81b5ae None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 16:29:11.802698 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:11.802698 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 16:29:11.802698 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 16:29:11.802698 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 16:29:11.802698 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 16:29:11.802698 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 16:29:11.802698 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:29:11.802698 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 16:29:11.802698 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:29:11.802698 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 16:29:11.802698 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:29:11.802698 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:11.802698 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:11.802698 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:11.802698 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:11.802698 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:11.804850 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:11.804850 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:11.804850 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:11.804850 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:11.804850 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:11.804850 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:11.804850 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 16:29:11.804850 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 16:29:11.804850 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 16:29:11.804850 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 16:29:11.804850 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:11.804850 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:11.804850 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:11.804850 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:11.804850 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:11.804850 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:11.805802 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:11.805802 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:11.805802 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:11.805802 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:11.805802 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:11.805802 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:11.805802 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:11.805802 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:11.805802 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:11.805802 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:11.805802 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 16:29:11.805802 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:29:11.805802 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 16:29:11.805802 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:29:11.805802 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 517/1035] 10.222.0.81 () {56 vars in 1105 bytes} [Mon Jul 18 16:29:11 2022] GET /identity/v3/services/image => generated 86 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:29:11.812210 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39cb868-8da5-4b1f-a88f-17a73a81b5ae None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:11.816656 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:11.847221 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14e9201-55df-441a-85b6-6c8d1e37d7eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:11.849903 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14e9201-55df-441a-85b6-6c8d1e37d7eb None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:11.959439 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39cb868-8da5-4b1f-a88f-17a73a81b5ae None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:12.004091 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 519/1036] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Jul 18 16:29:11 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 18 16:29:12.010650 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e9201-55df-441a-85b6-6c8d1e37d7eb None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:12.023435 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d7e00-c796-4b36-9dbf-badeb9cf4dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:12.024537 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d7e00-c796-4b36-9dbf-badeb9cf4dbf None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:12.024992 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d7e00-c796-4b36-9dbf-badeb9cf4dbf None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:12.025859 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d7e00-c796-4b36-9dbf-badeb9cf4dbf None admin] PATH_INFO: `/v3/services` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:12.027053 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3d7e00-c796-4b36-9dbf-badeb9cf4dbf None admin] RBAC: Adding query filter params (name=image) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:12.027574 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3d7e00-c796-4b36-9dbf-badeb9cf4dbf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:12.030057 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3d7e00-c796-4b36-9dbf-badeb9cf4dbf None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:12.038377 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 518/1037] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:29:11 2022] GET /identity/v3/services?name=image => generated 122 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:12.045570 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d7e00-c796-4b36-9dbf-badeb9cf4dbf None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:12.087554 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:12.177529 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:12.196615 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e9201-55df-441a-85b6-6c8d1e37d7eb None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:12.239841 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d7e00-c796-4b36-9dbf-badeb9cf4dbf None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:12.253620 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5198f111-599b-42d6-8ffd-34cba1f320d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:12.254732 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198f111-599b-42d6-8ffd-34cba1f320d7 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:12.255167 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198f111-599b-42d6-8ffd-34cba1f320d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:12.255612 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198f111-599b-42d6-8ffd-34cba1f320d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:12.269409 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5198f111-599b-42d6-8ffd-34cba1f320d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:12.271299 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5198f111-599b-42d6-8ffd-34cba1f320d7 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:12.292288 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca11e4-5121-40c9-8a30-5256ac6703c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:12.292991 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca11e4-5121-40c9-8a30-5256ac6703c5 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:12.293180 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-5198f111-599b-42d6-8ffd-34cba1f320d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:12.293180 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:12.293180 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:12.293180 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:12.293180 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:12.293180 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:12.293180 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:12.293180 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:12.293180 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:12.293180 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:12.293180 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:12.293180 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:12.293180 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:29:12.293180 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:29:12.293180 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:29:12.294546 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:29:12.294546 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:12.294546 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:12.294546 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:12.294546 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:12.294546 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:12.294546 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:12.294546 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:12.294546 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:12.294546 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:12.294546 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:12.294546 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:12.294546 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:12.294546 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:12.294546 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:12.294546 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:12.294546 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:12.296831 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:29:12.296831 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:29:12.296831 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:12.296831 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:29:12.297227 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca11e4-5121-40c9-8a30-5256ac6703c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:12.297227 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca11e4-5121-40c9-8a30-5256ac6703c5 None admin] PATH_INFO: `/v3/services` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:12.297227 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ca11e4-5121-40c9-8a30-5256ac6703c5 None admin] RBAC: Adding query filter params (type=image) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:12.297227 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ca11e4-5121-40c9-8a30-5256ac6703c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:12.297227 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ca11e4-5121-40c9-8a30-5256ac6703c5 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:12.299265 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 520/1038] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:29:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:29:12.300279 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5198f111-599b-42d6-8ffd-34cba1f320d7 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:12.304544 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 519/1039] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:29:12 2022] GET /identity/v3/services?type=image => generated 350 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:12.310687 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca11e4-5121-40c9-8a30-5256ac6703c5 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:12.428739 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:12.438798 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5198f111-599b-42d6-8ffd-34cba1f320d7 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:12.476775 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca11e4-5121-40c9-8a30-5256ac6703c5 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:12.490040 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9529c5-b4be-47c0-aded-0fd83100165c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:12.490638 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9529c5-b4be-47c0-aded-0fd83100165c None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:12.490930 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9529c5-b4be-47c0-aded-0fd83100165c None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:12.491202 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9529c5-b4be-47c0-aded-0fd83100165c None admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:12.491965 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9529c5-b4be-47c0-aded-0fd83100165c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:12.492272 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9529c5-b4be-47c0-aded-0fd83100165c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:12.493699 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9529c5-b4be-47c0-aded-0fd83100165c None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:12.517370 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 521/1040] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:29:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:12.519294 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9529c5-b4be-47c0-aded-0fd83100165c None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:12.542784 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:12.551360 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f66a53-0a51-41c4-a39d-4fde50140200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:12.552645 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f66a53-0a51-41c4-a39d-4fde50140200 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:12.553189 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f66a53-0a51-41c4-a39d-4fde50140200 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:12.559921 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f66a53-0a51-41c4-a39d-4fde50140200 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:12.559921 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f66a53-0a51-41c4-a39d-4fde50140200 None admin] RBAC: Adding query filter params (interface=public, service_id=0966f416dabb44a5bc4b1342a12a3c39, region_id=RegionOne) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:12.559921 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f66a53-0a51-41c4-a39d-4fde50140200 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:12.559921 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f66a53-0a51-41c4-a39d-4fde50140200 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:12.566105 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 520/1041] 10.222.0.81 () {56 vars in 1251 bytes} [Mon Jul 18 16:29:12 2022] GET /identity/v3/endpoints?service_id=0966f416dabb44a5bc4b1342a12a3c39&interface=public®ion_id=RegionOne => generated 194 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:12.571851 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f66a53-0a51-41c4-a39d-4fde50140200 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:12.688858 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f66a53-0a51-41c4-a39d-4fde50140200 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:12.702180 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9529c5-b4be-47c0-aded-0fd83100165c None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:12.742683 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273adc4-7707-4764-b7fc-cd2004c2ab8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:12.742985 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37926c7e-da0b-4847-9786-c7738a675efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:12.743384 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273adc4-7707-4764-b7fc-cd2004c2ab8d None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:12.743653 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273adc4-7707-4764-b7fc-cd2004c2ab8d None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:12.744447 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37926c7e-da0b-4847-9786-c7738a675efe None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:12.744605 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273adc4-7707-4764-b7fc-cd2004c2ab8d None admin] PATH_INFO: `/v3/services` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:12.744757 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37926c7e-da0b-4847-9786-c7738a675efe None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:12.744904 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37926c7e-da0b-4847-9786-c7738a675efe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:12.745239 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0273adc4-7707-4764-b7fc-cd2004c2ab8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:12.746507 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0273adc4-7707-4764-b7fc-cd2004c2ab8d None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:12.753163 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37926c7e-da0b-4847-9786-c7738a675efe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:12.754434 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 521/1042] 10.222.0.81 () {56 vars in 1087 bytes} [Mon Jul 18 16:29:12 2022] GET /identity/v3/services => generated 1957 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 16:29:12.754732 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37926c7e-da0b-4847-9786-c7738a675efe None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:12.771913 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-37926c7e-da0b-4847-9786-c7738a675efe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:29:12.771913 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:12.771913 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:12.771913 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:12.771913 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:12.771913 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:12.771913 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:12.771913 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:12.771913 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:12.771913 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:12.771913 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:12.771913 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:12.771913 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:29:12.771913 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:29:12.771913 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:29:12.781032 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:29:12.781032 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:12.781032 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:12.781032 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:12.781032 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:12.781032 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:12.781032 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:12.781032 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:12.781032 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:12.781032 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:12.781032 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:12.781032 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:12.781032 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:12.781032 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:12.781032 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:12.781032 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:12.781032 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:12.783184 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:29:12.783184 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:29:12.783184 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:29:12.783184 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:29:12.783184 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:29:12.783184 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:29:12.783184 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:29:12.783184 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:29:12.783184 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 522/1043] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Jul 18 16:29:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:29:12.789220 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273adc4-7707-4764-b7fc-cd2004c2ab8d None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:12.909640 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:12.974031 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273adc4-7707-4764-b7fc-cd2004c2ab8d None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:13.010741 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7553c038-190c-4996-b809-4b1fd3886de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:13.011372 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553c038-190c-4996-b809-4b1fd3886de3 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:13.011656 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553c038-190c-4996-b809-4b1fd3886de3 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:13.011958 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553c038-190c-4996-b809-4b1fd3886de3 None admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:13.012755 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7553c038-190c-4996-b809-4b1fd3886de3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:13.013060 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7553c038-190c-4996-b809-4b1fd3886de3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:13.014502 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7553c038-190c-4996-b809-4b1fd3886de3 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:13.028133 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 522/1044] 10.222.0.81 () {56 vars in 1148 bytes} [Mon Jul 18 16:29:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:13.034145 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37926c7e-da0b-4847-9786-c7738a675efe None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:13.051211 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:13.153772 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37926c7e-da0b-4847-9786-c7738a675efe None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:13.179006 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e6e08-14de-42d6-a987-f80201b8c273 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:13.179329 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e6e08-14de-42d6-a987-f80201b8c273 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:13.179616 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e6e08-14de-42d6-a987-f80201b8c273 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:13.181348 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 523/1045] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:29:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:29:13.187087 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea377169-e852-4969-95f5-07e9bae27e4f None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:13.187376 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea377169-e852-4969-95f5-07e9bae27e4f None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:13.187661 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea377169-e852-4969-95f5-07e9bae27e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:13.195953 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654d04f2-3219-4efc-a40d-9ae40fba47c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:13.196619 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d04f2-3219-4efc-a40d-9ae40fba47c6 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:13.196894 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d04f2-3219-4efc-a40d-9ae40fba47c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:13.197779 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d04f2-3219-4efc-a40d-9ae40fba47c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:13.198631 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654d04f2-3219-4efc-a40d-9ae40fba47c6 None admin] RBAC: Adding query filter params (role.id=98b55727d5284c6e92f21b06e332215f, scope.project.id=9d1d84bf334d47e6bfba1141c1fc6f59, user.id=07f0c5bf1bee48a0bafdf7a9e4537c70) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:13.198935 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654d04f2-3219-4efc-a40d-9ae40fba47c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:13.200544 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654d04f2-3219-4efc-a40d-9ae40fba47c6 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:13.206255 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-ea377169-e852-4969-95f5-07e9bae27e4f None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:13.216026 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 523/1046] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Jul 18 16:29:13 2022] GET /identity/v3/role_assignments?user.id=07f0c5bf1bee48a0bafdf7a9e4537c70&scope.project.id=9d1d84bf334d47e6bfba1141c1fc6f59&role.id=98b55727d5284c6e92f21b06e332215f => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:13.216252 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-ea377169-e852-4969-95f5-07e9bae27e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:13.313871 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 524/1047] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:13 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 16:29:13.345658 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654d04f2-3219-4efc-a40d-9ae40fba47c6 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:13.445178 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:13.473195 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654d04f2-3219-4efc-a40d-9ae40fba47c6 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:13.534413 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a9293-aea6-45b7-87c8-832301994a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:13.535840 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a9293-aea6-45b7-87c8-832301994a4c None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:13.536347 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a9293-aea6-45b7-87c8-832301994a4c None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:13.536814 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a9293-aea6-45b7-87c8-832301994a4c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:13.564328 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7a9293-aea6-45b7-87c8-832301994a4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:29:13.579326 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-9e7a9293-aea6-45b7-87c8-832301994a4c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:29:13.579326 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:13.579326 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:13.579326 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:13.579326 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:13.579326 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:13.579326 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:13.579326 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:13.579326 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:13.579326 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:13.579326 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:13.579326 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:13.579326 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:29:13.579326 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:29:13.579326 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:29:13.579326 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:29:13.580411 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:29:13.580411 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:29:13.580411 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:29:13.580411 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:29:13.580411 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:13.580411 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:13.580411 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:13.580411 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:13.580411 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:13.580411 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:13.580411 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:13.580411 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:13.580411 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:13.580411 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:13.580411 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:13.580411 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:13.581298 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:13.581298 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:13.581298 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:13.581298 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:13.581298 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:29:13.581298 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:29:13.581298 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:29:13.581298 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:29:13.581298 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:29:13.581298 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:29:13.581298 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:29:13.581298 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:29:13.582718 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 524/1048] 10.222.0.81 () {56 vars in 1096 bytes} [Mon Jul 18 16:29:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:29:13.589752 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea377169-e852-4969-95f5-07e9bae27e4f None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:13.651876 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:13.722767 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea377169-e852-4969-95f5-07e9bae27e4f None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:13.763197 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55967bb-bb18-4c23-9943-33e87684008d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:13.763908 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55967bb-bb18-4c23-9943-33e87684008d None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:13.764186 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55967bb-bb18-4c23-9943-33e87684008d None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:13.764454 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55967bb-bb18-4c23-9943-33e87684008d None admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:13.765210 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55967bb-bb18-4c23-9943-33e87684008d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:13.765508 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55967bb-bb18-4c23-9943-33e87684008d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:13.766876 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55967bb-bb18-4c23-9943-33e87684008d None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:13.779086 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 525/1049] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Jul 18 16:29:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:13.784738 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a9293-aea6-45b7-87c8-832301994a4c None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:13.932179 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a9293-aea6-45b7-87c8-832301994a4c None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:13.967343 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428cfdaf-2ae1-4bfd-bc7a-45a4ba2fd535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:13.968408 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428cfdaf-2ae1-4bfd-bc7a-45a4ba2fd535 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:13.968686 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428cfdaf-2ae1-4bfd-bc7a-45a4ba2fd535 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:13.971740 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428cfdaf-2ae1-4bfd-bc7a-45a4ba2fd535 None admin] PATH_INFO: `/v3/users/f4eb571a0ebd48f08fabb049b9eeaa73` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:13.972384 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:13.987592 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428cfdaf-2ae1-4bfd-bc7a-45a4ba2fd535 None admin] RBAC: Authorizing `identity:get_user(user_id=f4eb571a0ebd48f08fabb049b9eeaa73)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:13.989116 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428cfdaf-2ae1-4bfd-bc7a-45a4ba2fd535 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:13.991614 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 525/1050] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Jul 18 16:29:13 2022] GET /identity/v3/users/f4eb571a0ebd48f08fabb049b9eeaa73 => generated 285 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:14.001996 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55967bb-bb18-4c23-9943-33e87684008d None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:14.181026 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55967bb-bb18-4c23-9943-33e87684008d None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:14.181026 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:14.198975 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197390ea-0219-416a-b8dd-8d29a9cd2783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:14.199571 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197390ea-0219-416a-b8dd-8d29a9cd2783 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:14.199970 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197390ea-0219-416a-b8dd-8d29a9cd2783 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:14.200245 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197390ea-0219-416a-b8dd-8d29a9cd2783 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:14.331324 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197390ea-0219-416a-b8dd-8d29a9cd2783 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:14.333783 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197390ea-0219-416a-b8dd-8d29a9cd2783 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:14.467848 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 526/1051] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Jul 18 16:29:14 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 16:29:14.468121 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428cfdaf-2ae1-4bfd-bc7a-45a4ba2fd535 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:14.579443 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428cfdaf-2ae1-4bfd-bc7a-45a4ba2fd535 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:14.640401 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b20da8-eaa3-45ea-ab7c-9e53b402ec87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:14.641447 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b20da8-eaa3-45ea-ab7c-9e53b402ec87 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:14.641866 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b20da8-eaa3-45ea-ab7c-9e53b402ec87 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:14.642277 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b20da8-eaa3-45ea-ab7c-9e53b402ec87 None admin] PATH_INFO: `/v3/projects/d5d5073c347b4f3e8b57229b255b7fbc` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:14.643686 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b20da8-eaa3-45ea-ab7c-9e53b402ec87 None admin] RBAC: Authorizing `identity:get_project(project_id=d5d5073c347b4f3e8b57229b255b7fbc)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:14.645309 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b20da8-eaa3-45ea-ab7c-9e53b402ec87 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:14.647526 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 526/1052] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Jul 18 16:29:14 2022] GET /identity/v3/projects/d5d5073c347b4f3e8b57229b255b7fbc => generated 311 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:14.653921 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197390ea-0219-416a-b8dd-8d29a9cd2783 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:14.671160 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:14.832955 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197390ea-0219-416a-b8dd-8d29a9cd2783 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:14.870453 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33944e73-1aa9-48cd-a9f9-c5c4ad340d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:14.871393 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33944e73-1aa9-48cd-a9f9-c5c4ad340d31 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:14.871752 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33944e73-1aa9-48cd-a9f9-c5c4ad340d31 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:14.872062 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33944e73-1aa9-48cd-a9f9-c5c4ad340d31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:14.873502 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33944e73-1aa9-48cd-a9f9-c5c4ad340d31 None admin] RBAC: Adding query filter params (role.id=fd83eab44cb343a2b532ce32a2ac31d8, scope.project.id=d5d5073c347b4f3e8b57229b255b7fbc, user.id=f4eb571a0ebd48f08fabb049b9eeaa73) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:14.874044 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33944e73-1aa9-48cd-a9f9-c5c4ad340d31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:14.876821 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33944e73-1aa9-48cd-a9f9-c5c4ad340d31 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:14.885616 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 527/1053] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Jul 18 16:29:14 2022] GET /identity/v3/role_assignments?user.id=f4eb571a0ebd48f08fabb049b9eeaa73&scope.project.id=d5d5073c347b4f3e8b57229b255b7fbc&role.id=fd83eab44cb343a2b532ce32a2ac31d8 => generated 259 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:14.918581 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345b213-3684-4411-8794-8b6e054aaa89 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:14.919079 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345b213-3684-4411-8794-8b6e054aaa89 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:14.919577 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345b213-3684-4411-8794-8b6e054aaa89 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:14.922450 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 527/1054] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:29:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:29:14.931246 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9810063-f767-4b25-8d73-e6567ac21bbc None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:14.932283 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9810063-f767-4b25-8d73-e6567ac21bbc None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:14.932796 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9810063-f767-4b25-8d73-e6567ac21bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:14.962698 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-d9810063-f767-4b25-8d73-e6567ac21bbc None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:14.964789 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-d9810063-f767-4b25-8d73-e6567ac21bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:15.090275 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 528/1055] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:14 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:29:15.113642 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b345b213-3684-4411-8794-8b6e054aaa89 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:15.179601 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:15.221854 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b345b213-3684-4411-8794-8b6e054aaa89 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:15.260843 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd954e-0980-4b90-8f54-48b1e543c43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:15.261634 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd954e-0980-4b90-8f54-48b1e543c43c None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:15.261923 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd954e-0980-4b90-8f54-48b1e543c43c None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:15.262265 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd954e-0980-4b90-8f54-48b1e543c43c None admin] PATH_INFO: `/v3/services/image` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:15.262821 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfd954e-0980-4b90-8f54-48b1e543c43c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:15.264226 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfd954e-0980-4b90-8f54-48b1e543c43c None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:15.276813 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-abfd954e-0980-4b90-8f54-48b1e543c43c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 16:29:15.276813 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:15.276813 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 16:29:15.276813 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 16:29:15.276813 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 16:29:15.276813 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 16:29:15.276813 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 16:29:15.276813 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:29:15.276813 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 16:29:15.276813 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:29:15.276813 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 16:29:15.276813 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:29:15.276813 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:15.276813 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:15.276813 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:15.276813 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:15.276813 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:15.277906 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:15.277906 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:15.277906 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:15.277906 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:15.277906 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:15.277906 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:15.277906 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 16:29:15.277906 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 16:29:15.277906 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 16:29:15.277906 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 16:29:15.277906 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:15.277906 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:15.277906 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:15.277906 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:15.277906 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:15.277906 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:15.278788 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:15.278788 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:15.278788 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:15.278788 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:15.278788 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:15.278788 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:15.278788 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:15.278788 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:15.278788 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:15.278788 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:15.278788 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 16:29:15.278788 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:29:15.278788 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 16:29:15.278788 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:29:15.283050 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 528/1056] 10.222.0.81 () {56 vars in 1105 bytes} [Mon Jul 18 16:29:15 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:15.284265 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9810063-f767-4b25-8d73-e6567ac21bbc None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:15.292746 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:15.391232 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed744f-0d18-45e9-b727-9cc8cd90ec99 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:15.391483 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed744f-0d18-45e9-b727-9cc8cd90ec99 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:15.391682 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed744f-0d18-45e9-b727-9cc8cd90ec99 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:15.393127 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 529/1057] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:29:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:29:15.395400 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9810063-f767-4b25-8d73-e6567ac21bbc None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:15.398653 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1fede-786b-4cb9-9a9c-b3fb60700676 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:15.398951 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1fede-786b-4cb9-9a9c-b3fb60700676 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:15.399232 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1fede-786b-4cb9-9a9c-b3fb60700676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:15.417689 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-c2e1fede-786b-4cb9-9a9c-b3fb60700676 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:15.418945 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-c2e1fede-786b-4cb9-9a9c-b3fb60700676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:15.443566 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee1953-86d0-4f5d-9ee8-e9b37cb7fb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:15.444265 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee1953-86d0-4f5d-9ee8-e9b37cb7fb38 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:15.444551 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee1953-86d0-4f5d-9ee8-e9b37cb7fb38 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:15.444829 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee1953-86d0-4f5d-9ee8-e9b37cb7fb38 None admin] PATH_INFO: `/v3/services` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:15.445580 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baee1953-86d0-4f5d-9ee8-e9b37cb7fb38 None admin] RBAC: Adding query filter params (name=image) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:15.445888 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baee1953-86d0-4f5d-9ee8-e9b37cb7fb38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:15.447799 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baee1953-86d0-4f5d-9ee8-e9b37cb7fb38 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:15.454086 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 529/1058] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:29:15 2022] GET /identity/v3/services?name=image => generated 122 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:15.459627 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee1953-86d0-4f5d-9ee8-e9b37cb7fb38 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:15.507823 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 530/1059] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:15 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 16:29:15.529855 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e1fede-786b-4cb9-9a9c-b3fb60700676 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:15.535577 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:15.569301 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee1953-86d0-4f5d-9ee8-e9b37cb7fb38 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:15.610217 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:15.620972 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24bd350-07db-418d-8713-878f25a1ab37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:15.621645 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24bd350-07db-418d-8713-878f25a1ab37 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:15.621925 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24bd350-07db-418d-8713-878f25a1ab37 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:15.622229 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24bd350-07db-418d-8713-878f25a1ab37 None admin] PATH_INFO: `/v3/services` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:15.622928 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24bd350-07db-418d-8713-878f25a1ab37 None admin] RBAC: Adding query filter params (type=image) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:15.623237 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24bd350-07db-418d-8713-878f25a1ab37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:15.624648 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24bd350-07db-418d-8713-878f25a1ab37 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:15.629966 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 530/1060] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:29:15 2022] GET /identity/v3/services?type=image => generated 350 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:15.636573 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24bd350-07db-418d-8713-878f25a1ab37 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:15.664153 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e1fede-786b-4cb9-9a9c-b3fb60700676 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:15.719847 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4edbc-8d6f-4446-9403-f4f8f9b5a593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:15.720668 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4edbc-8d6f-4446-9403-f4f8f9b5a593 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:15.720947 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4edbc-8d6f-4446-9403-f4f8f9b5a593 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:15.721219 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4edbc-8d6f-4446-9403-f4f8f9b5a593 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:15.734258 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c4edbc-8d6f-4446-9403-f4f8f9b5a593 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:29:15.742647 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-e7c4edbc-8d6f-4446-9403-f4f8f9b5a593 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 16:29:15.742647 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:15.742647 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:15.742647 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:15.742647 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:15.742647 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:15.742647 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:15.742647 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:15.742647 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:15.742647 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:15.742647 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:15.742647 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:15.742647 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:29:15.742647 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:29:15.742647 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:29:15.742647 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:29:15.743738 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:29:15.743738 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:29:15.743738 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:29:15.743738 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:29:15.743738 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:15.743738 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:15.743738 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:15.743738 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:15.743738 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:15.743738 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:15.743738 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:15.743738 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:15.743738 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:15.743738 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:15.743738 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:15.743738 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:15.746520 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:15.746520 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:15.746520 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:15.746520 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:15.746520 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:29:15.746520 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:29:15.746520 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:29:15.746520 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:29:15.746520 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:29:15.746520 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:29:15.746520 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 16:29:15.746520 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:29:15.746520 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 531/1061] 10.222.0.81 () {56 vars in 1120 bytes} [Mon Jul 18 16:29:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:29:15.751096 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4edbc-8d6f-4446-9403-f4f8f9b5a593 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:15.757582 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24bd350-07db-418d-8713-878f25a1ab37 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:15.826189 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaefb9e-da84-42ac-9d23-a23aa11b2093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:15.826962 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaefb9e-da84-42ac-9d23-a23aa11b2093 None admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:15.827237 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaefb9e-da84-42ac-9d23-a23aa11b2093 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:15.827511 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaefb9e-da84-42ac-9d23-a23aa11b2093 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:15.828365 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaefb9e-da84-42ac-9d23-a23aa11b2093 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:15.829693 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaefb9e-da84-42ac-9d23-a23aa11b2093 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:15.834195 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:15.879569 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4edbc-8d6f-4446-9403-f4f8f9b5a593 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:15.897419 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:15.915555 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e3ce3-34bd-45d7-9a06-02f5455dcaa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:15.916106 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e3ce3-34bd-45d7-9a06-02f5455dcaa6 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:15.916385 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e3ce3-34bd-45d7-9a06-02f5455dcaa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:15.916660 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e3ce3-34bd-45d7-9a06-02f5455dcaa6 None admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:15.917398 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e3ce3-34bd-45d7-9a06-02f5455dcaa6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:15.917698 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e3ce3-34bd-45d7-9a06-02f5455dcaa6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:15.919060 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e3ce3-34bd-45d7-9a06-02f5455dcaa6 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:15.928162 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 532/1062] 10.222.0.81 () {56 vars in 1115 bytes} [Mon Jul 18 16:29:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:15.939234 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e3ce3-34bd-45d7-9a06-02f5455dcaa6 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:15.945218 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 531/1063] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Jul 18 16:29:15 2022] POST /identity/v3/endpoints => generated 327 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:29:16.061455 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e3ce3-34bd-45d7-9a06-02f5455dcaa6 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:16.107551 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ef36e1-dec5-489c-afbe-fa0783aa0a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:16.108382 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef36e1-dec5-489c-afbe-fa0783aa0a3f None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:16.108665 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef36e1-dec5-489c-afbe-fa0783aa0a3f None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:16.108940 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef36e1-dec5-489c-afbe-fa0783aa0a3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:16.121294 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ef36e1-dec5-489c-afbe-fa0783aa0a3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:16.123310 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ef36e1-dec5-489c-afbe-fa0783aa0a3f None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:16.145139 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-84ef36e1-dec5-489c-afbe-fa0783aa0a3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:16.145139 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:16.145139 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:16.145139 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:16.145139 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:16.145139 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:16.145139 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:16.145139 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:16.145139 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:16.145139 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:16.145139 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:16.145139 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:16.145139 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:29:16.145139 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:29:16.145139 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:29:16.147328 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:29:16.147328 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:16.147328 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:16.147328 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:16.147328 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:16.147328 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:16.147328 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:16.147328 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:16.147328 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:16.147328 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:16.147328 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:16.147328 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:16.147328 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:16.147328 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:16.147328 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:16.147328 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:16.147328 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:16.149685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:29:16.149685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:29:16.149685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:16.149685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:29:16.149685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 533/1064] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:29:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:29:16.152681 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaefb9e-da84-42ac-9d23-a23aa11b2093 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:16.270976 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaefb9e-da84-42ac-9d23-a23aa11b2093 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:16.310783 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf9be81-d654-4e40-b8da-9af176aad4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:16.311464 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf9be81-d654-4e40-b8da-9af176aad4c2 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:16.311833 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf9be81-d654-4e40-b8da-9af176aad4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:16.312222 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf9be81-d654-4e40-b8da-9af176aad4c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:16.313027 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf9be81-d654-4e40-b8da-9af176aad4c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:16.313332 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf9be81-d654-4e40-b8da-9af176aad4c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:16.314813 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf9be81-d654-4e40-b8da-9af176aad4c2 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:16.328630 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 532/1065] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:29:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:16.334721 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ef36e1-dec5-489c-afbe-fa0783aa0a3f None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:16.367972 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:16.449507 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ef36e1-dec5-489c-afbe-fa0783aa0a3f None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:16.490184 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a418835f-47b3-4007-87f2-c0a4f1d09828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:16.490985 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418835f-47b3-4007-87f2-c0a4f1d09828 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:16.491265 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418835f-47b3-4007-87f2-c0a4f1d09828 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:16.491540 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418835f-47b3-4007-87f2-c0a4f1d09828 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:16.499512 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a418835f-47b3-4007-87f2-c0a4f1d09828 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:16.500989 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a418835f-47b3-4007-87f2-c0a4f1d09828 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:16.516126 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-a418835f-47b3-4007-87f2-c0a4f1d09828 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 16:29:16.516126 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:16.516126 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:16.516126 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:16.516126 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:16.516126 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:16.516126 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:16.516126 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:16.516126 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:16.516126 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:16.516126 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:16.516126 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:16.516126 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:29:16.516126 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:29:16.516126 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:29:16.516126 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:29:16.517610 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:16.517610 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:16.517610 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:29:16.517610 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:29:16.517610 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:29:16.517610 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:29:16.517610 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:16.517610 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:16.517610 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:16.517610 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:16.517610 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:16.517610 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:16.517610 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:16.517610 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:16.517610 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:16.517610 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:16.517610 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:16.517610 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:16.519368 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:16.519368 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:16.519368 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:29:16.519368 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:29:16.519368 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:29:16.519368 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:29:16.519368 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:29:16.519368 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:29:16.519368 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 16:29:16.519368 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:29:16.522473 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 534/1066] 10.222.0.81 () {56 vars in 1093 bytes} [Mon Jul 18 16:29:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:16.523640 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf9be81-d654-4e40-b8da-9af176aad4c2 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:16.586204 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:16.656259 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf9be81-d654-4e40-b8da-9af176aad4c2 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:16.701411 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7207ff-de2a-4bf5-bf3e-7cea7136fa3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:16.702204 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7207ff-de2a-4bf5-bf3e-7cea7136fa3e None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:16.702617 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7207ff-de2a-4bf5-bf3e-7cea7136fa3e None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:16.703008 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7207ff-de2a-4bf5-bf3e-7cea7136fa3e None admin] PATH_INFO: `/v3/users` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:16.704192 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7207ff-de2a-4bf5-bf3e-7cea7136fa3e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:16.704530 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7207ff-de2a-4bf5-bf3e-7cea7136fa3e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:16.706022 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7207ff-de2a-4bf5-bf3e-7cea7136fa3e None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:16.726812 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 533/1067] 10.222.0.81 () {56 vars in 1133 bytes} [Mon Jul 18 16:29:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:16.732411 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a418835f-47b3-4007-87f2-c0a4f1d09828 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:16.832335 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:16.850846 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a418835f-47b3-4007-87f2-c0a4f1d09828 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:16.893591 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc914bc6-2187-4f86-8c5e-2ed08ecfa632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:16.894681 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc914bc6-2187-4f86-8c5e-2ed08ecfa632 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:16.894867 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc914bc6-2187-4f86-8c5e-2ed08ecfa632 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:16.895154 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc914bc6-2187-4f86-8c5e-2ed08ecfa632 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:16.914147 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc914bc6-2187-4f86-8c5e-2ed08ecfa632 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:16.917618 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc914bc6-2187-4f86-8c5e-2ed08ecfa632 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:16.938198 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-dc914bc6-2187-4f86-8c5e-2ed08ecfa632 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:16.938198 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:16.938198 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:16.938198 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:16.938198 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:16.938198 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:16.938198 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:16.938198 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:16.938198 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:16.938198 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:16.938198 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:16.938198 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:16.938198 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:29:16.938198 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:29:16.938198 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:29:16.939203 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:29:16.939203 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:16.939203 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:16.939203 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:16.939203 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:16.939203 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:16.939203 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:16.939203 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:16.939203 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:16.939203 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:16.939203 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:16.939203 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:16.939203 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:16.939203 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:16.939203 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:16.939203 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:16.939203 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:16.940174 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:29:16.940174 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:29:16.940174 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:16.940174 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:29:16.941159 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 535/1068] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:29:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:16.947747 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7207ff-de2a-4bf5-bf3e-7cea7136fa3e None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:16.971055 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b2d50-6d60-435d-a751-04a8ff696953 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:16.971375 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b2d50-6d60-435d-a751-04a8ff696953 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:16.971602 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b2d50-6d60-435d-a751-04a8ff696953 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:16.973182 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 536/1069] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:29:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:29:16.978613 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689bef2e-b949-40b2-9f59-30f3ee7bc54b None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:16.978897 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689bef2e-b949-40b2-9f59-30f3ee7bc54b None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:16.979171 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689bef2e-b949-40b2-9f59-30f3ee7bc54b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:16.996446 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-689bef2e-b949-40b2-9f59-30f3ee7bc54b None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:16.997732 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-689bef2e-b949-40b2-9f59-30f3ee7bc54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:17.073047 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7207ff-de2a-4bf5-bf3e-7cea7136fa3e None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:17.075045 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 537/1070] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 16:29:17.083977 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:17.097960 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689bef2e-b949-40b2-9f59-30f3ee7bc54b None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:17.112683 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f752b517-f3ba-47ed-a236-56ab6da6e98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:17.113401 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752b517-f3ba-47ed-a236-56ab6da6e98e None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:17.113724 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752b517-f3ba-47ed-a236-56ab6da6e98e None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:17.113952 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752b517-f3ba-47ed-a236-56ab6da6e98e None admin] PATH_INFO: `/v3/domains` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:17.114768 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f752b517-f3ba-47ed-a236-56ab6da6e98e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:17.115048 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f752b517-f3ba-47ed-a236-56ab6da6e98e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:17.117069 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f752b517-f3ba-47ed-a236-56ab6da6e98e None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:17.129726 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 534/1071] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:29:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:17.136309 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f752b517-f3ba-47ed-a236-56ab6da6e98e None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:17.182447 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:17.239140 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689bef2e-b949-40b2-9f59-30f3ee7bc54b None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:17.255202 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f752b517-f3ba-47ed-a236-56ab6da6e98e None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:17.279586 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b421d2e6-9bd8-416c-8a4a-4fae8debbf56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:17.280685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421d2e6-9bd8-416c-8a4a-4fae8debbf56 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:17.280967 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421d2e6-9bd8-416c-8a4a-4fae8debbf56 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:17.281237 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421d2e6-9bd8-416c-8a4a-4fae8debbf56 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:17.294079 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d2204-4520-49f1-83ff-bb951c094d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:17.295000 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d2204-4520-49f1-83ff-bb951c094d85 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:17.295291 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d2204-4520-49f1-83ff-bb951c094d85 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:17.295508 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b421d2e6-9bd8-416c-8a4a-4fae8debbf56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:29:17.295627 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d2204-4520-49f1-83ff-bb951c094d85 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:17.302775 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87d2204-4520-49f1-83ff-bb951c094d85 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:17.304259 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87d2204-4520-49f1-83ff-bb951c094d85 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:17.304755 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-b421d2e6-9bd8-416c-8a4a-4fae8debbf56 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:29:17.304755 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:17.304755 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:17.304755 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:17.304755 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:17.304755 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:17.304755 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:17.304755 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:17.304755 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:17.304755 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:17.304755 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:17.304755 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:17.304755 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:29:17.304755 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:29:17.304755 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:29:17.304755 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:29:17.305832 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:29:17.305832 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:29:17.305832 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:29:17.305832 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:29:17.305832 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:17.305832 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:17.305832 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:17.305832 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:17.305832 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:17.305832 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:17.305832 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:17.305832 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:17.305832 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:17.305832 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:17.305832 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:17.305832 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:17.307409 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:17.307409 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:17.307409 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:17.307409 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:17.307409 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:29:17.307409 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:29:17.307409 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:29:17.307409 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:29:17.307409 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:29:17.307409 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:29:17.307409 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:29:17.307409 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:29:17.309546 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 538/1072] 10.222.0.81 () {56 vars in 1096 bytes} [Mon Jul 18 16:29:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:29:17.315151 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b421d2e6-9bd8-416c-8a4a-4fae8debbf56 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:17.323354 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-f87d2204-4520-49f1-83ff-bb951c094d85 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:29:17.323354 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:17.323354 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:17.323354 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:17.323354 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:17.323354 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:17.323354 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:17.323354 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:17.323354 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:17.323354 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:17.323354 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:17.323354 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:17.323354 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:29:17.323354 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:29:17.323354 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:29:17.325330 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:29:17.325330 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:17.325330 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:17.325330 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:17.325330 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:17.325330 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:17.325330 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:17.325330 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:17.325330 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:17.325330 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:17.325330 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:17.325330 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:17.325330 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:17.325330 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:17.325330 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:17.325330 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:17.325330 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:17.326655 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:29:17.326655 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:29:17.326655 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:29:17.326655 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:29:17.326655 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:29:17.326655 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:29:17.326655 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:29:17.326655 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:29:17.326655 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 535/1073] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Jul 18 16:29:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:17.330215 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d2204-4520-49f1-83ff-bb951c094d85 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:17.362689 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:17.463281 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d2204-4520-49f1-83ff-bb951c094d85 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:17.480302 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b421d2e6-9bd8-416c-8a4a-4fae8debbf56 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:17.510302 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b13e27c-dfb7-4f5e-bc80-a9da5e1aed99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:17.511171 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b13e27c-dfb7-4f5e-bc80-a9da5e1aed99 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:17.511580 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b13e27c-dfb7-4f5e-bc80-a9da5e1aed99 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:17.512215 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b13e27c-dfb7-4f5e-bc80-a9da5e1aed99 None admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:17.513114 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b13e27c-dfb7-4f5e-bc80-a9da5e1aed99 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:17.513543 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b13e27c-dfb7-4f5e-bc80-a9da5e1aed99 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:17.515507 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b13e27c-dfb7-4f5e-bc80-a9da5e1aed99 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:17.519639 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:17.530306 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 536/1074] 10.222.0.81 () {56 vars in 1148 bytes} [Mon Jul 18 16:29:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:17.536726 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b13e27c-dfb7-4f5e-bc80-a9da5e1aed99 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:17.536943 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a267ca-5207-4691-88b7-12a8e979be4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:17.537802 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a267ca-5207-4691-88b7-12a8e979be4f None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:17.538236 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a267ca-5207-4691-88b7-12a8e979be4f None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:17.538736 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a267ca-5207-4691-88b7-12a8e979be4f None admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:17.539996 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a267ca-5207-4691-88b7-12a8e979be4f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:17.540438 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a267ca-5207-4691-88b7-12a8e979be4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:17.543049 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a267ca-5207-4691-88b7-12a8e979be4f None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:17.553766 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 539/1075] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Jul 18 16:29:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:17.559857 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a267ca-5207-4691-88b7-12a8e979be4f None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:17.659289 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:17.675299 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b13e27c-dfb7-4f5e-bc80-a9da5e1aed99 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:17.691833 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a267ca-5207-4691-88b7-12a8e979be4f None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:17.719035 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d04c7-2a79-453b-b800-b8d6497df778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:17.720241 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d04c7-2a79-453b-b800-b8d6497df778 None admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:17.720714 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d04c7-2a79-453b-b800-b8d6497df778 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:17.721038 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d04c7-2a79-453b-b800-b8d6497df778 None admin] PATH_INFO: `/v3/projects/9d1d84bf334d47e6bfba1141c1fc6f59/users/07f0c5bf1bee48a0bafdf7a9e4537c70/roles/98b55727d5284c6e92f21b06e332215f` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:17.724780 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0d04c7-2a79-453b-b800-b8d6497df778 None admin] RBAC: Authorizing `identity:create_grant(project_id=9d1d84bf334d47e6bfba1141c1fc6f59, user_id=07f0c5bf1bee48a0bafdf7a9e4537c70, role_id=98b55727d5284c6e92f21b06e332215f)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:17.727611 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0d04c7-2a79-453b-b800-b8d6497df778 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:17.736570 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7d097a-5006-4c85-9870-c83171fa7638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:17.737692 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d097a-5006-4c85-9870-c83171fa7638 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:17.738047 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d097a-5006-4c85-9870-c83171fa7638 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:17.738323 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d097a-5006-4c85-9870-c83171fa7638 None admin] PATH_INFO: `/v3/users/f4eb571a0ebd48f08fabb049b9eeaa73` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:17.739539 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7d097a-5006-4c85-9870-c83171fa7638 None admin] RBAC: Authorizing `identity:get_user(user_id=f4eb571a0ebd48f08fabb049b9eeaa73)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:17.741002 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7d097a-5006-4c85-9870-c83171fa7638 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:17.742713 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 540/1076] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Jul 18 16:29:17 2022] GET /identity/v3/users/f4eb571a0ebd48f08fabb049b9eeaa73 => generated 285 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:17.748574 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7d097a-5006-4c85-9870-c83171fa7638 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:17.813381 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:17.828356 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 537/1077] 10.222.0.81 () {58 vars in 1439 bytes} [Mon Jul 18 16:29:17 2022] PUT /identity/v3/projects/9d1d84bf334d47e6bfba1141c1fc6f59/users/07f0c5bf1bee48a0bafdf7a9e4537c70/roles/98b55727d5284c6e92f21b06e332215f => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:29:17.890046 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7d097a-5006-4c85-9870-c83171fa7638 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:17.934682 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016e43fa-049c-45ad-baf4-a29c0d8e1224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:17.935492 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e43fa-049c-45ad-baf4-a29c0d8e1224 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:17.935799 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e43fa-049c-45ad-baf4-a29c0d8e1224 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:17.936078 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e43fa-049c-45ad-baf4-a29c0d8e1224 None admin] PATH_INFO: `/v3/projects/d5d5073c347b4f3e8b57229b255b7fbc` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:17.937440 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016e43fa-049c-45ad-baf4-a29c0d8e1224 None admin] RBAC: Authorizing `identity:get_project(project_id=d5d5073c347b4f3e8b57229b255b7fbc)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:17.938970 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016e43fa-049c-45ad-baf4-a29c0d8e1224 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:17.941426 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 541/1078] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Jul 18 16:29:17 2022] GET /identity/v3/projects/d5d5073c347b4f3e8b57229b255b7fbc => generated 311 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:17.947851 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d04c7-2a79-453b-b800-b8d6497df778 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:18.075432 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d04c7-2a79-453b-b800-b8d6497df778 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:18.080669 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb28e68-6b2e-415b-a10d-cb1940d2ad17 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:18.081040 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb28e68-6b2e-415b-a10d-cb1940d2ad17 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:18.081243 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb28e68-6b2e-415b-a10d-cb1940d2ad17 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:18.082632 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 542/1079] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:29:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:29:18.090280 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1f91c7-bff0-4a68-833f-b9fc609f1da4 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:18.090561 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1f91c7-bff0-4a68-833f-b9fc609f1da4 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:18.090837 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1f91c7-bff0-4a68-833f-b9fc609f1da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:18.113995 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-db1f91c7-bff0-4a68-833f-b9fc609f1da4 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:18.115270 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-db1f91c7-bff0-4a68-833f-b9fc609f1da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:18.116522 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a7dd9-388e-4cc0-bd80-7f70912fb9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:18.117428 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a7dd9-388e-4cc0-bd80-7f70912fb9d4 None admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:18.117708 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a7dd9-388e-4cc0-bd80-7f70912fb9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:18.117981 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a7dd9-388e-4cc0-bd80-7f70912fb9d4 None admin] PATH_INFO: `/v3/projects/d5d5073c347b4f3e8b57229b255b7fbc/users/f4eb571a0ebd48f08fabb049b9eeaa73/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:18.120100 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748a7dd9-388e-4cc0-bd80-7f70912fb9d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=d5d5073c347b4f3e8b57229b255b7fbc, user_id=f4eb571a0ebd48f08fabb049b9eeaa73, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:18.121552 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748a7dd9-388e-4cc0-bd80-7f70912fb9d4 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:18.190772 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 543/1080] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 16:29:18.209513 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 538/1081] 10.222.0.81 () {58 vars in 1439 bytes} [Mon Jul 18 16:29:17 2022] PUT /identity/v3/projects/d5d5073c347b4f3e8b57229b255b7fbc/users/f4eb571a0ebd48f08fabb049b9eeaa73/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:29:18.213554 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1f91c7-bff0-4a68-833f-b9fc609f1da4 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:18.305727 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:18.386942 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1f91c7-bff0-4a68-833f-b9fc609f1da4 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:18.433645 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b03246-7fed-4ce5-806b-c719bd54456d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:18.434317 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b03246-7fed-4ce5-806b-c719bd54456d None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:18.434597 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b03246-7fed-4ce5-806b-c719bd54456d None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:18.434867 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b03246-7fed-4ce5-806b-c719bd54456d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:18.525141 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b03246-7fed-4ce5-806b-c719bd54456d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:18.527376 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b03246-7fed-4ce5-806b-c719bd54456d None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:18.605662 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:18.661427 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 544/1082] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Jul 18 16:29:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 18 16:29:18.662759 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a7dd9-388e-4cc0-bd80-7f70912fb9d4 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:18.676049 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:18.774608 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a7dd9-388e-4cc0-bd80-7f70912fb9d4 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:18.811703 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4e500-0950-4a38-9047-f1f07e6538ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:18.812525 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4e500-0950-4a38-9047-f1f07e6538ca None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:18.812936 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4e500-0950-4a38-9047-f1f07e6538ca None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:18.813214 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4e500-0950-4a38-9047-f1f07e6538ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:18.825562 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac4e500-0950-4a38-9047-f1f07e6538ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:18.826999 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac4e500-0950-4a38-9047-f1f07e6538ca None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:18.844737 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-eac4e500-0950-4a38-9047-f1f07e6538ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:18.844737 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:18.844737 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:18.844737 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:18.844737 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:18.844737 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:18.844737 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:18.844737 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:18.844737 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:18.844737 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:18.844737 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:18.844737 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:18.844737 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:29:18.844737 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:29:18.844737 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:29:18.853860 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:29:18.853860 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:18.853860 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:18.853860 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:18.853860 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:18.853860 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:18.853860 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:18.853860 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:18.853860 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:18.853860 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:18.853860 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:18.853860 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:18.853860 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:18.853860 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:18.853860 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:18.853860 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:18.853860 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:18.854872 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:29:18.854872 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:29:18.854872 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:18.854872 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:29:18.854872 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 539/1083] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:29:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:18.855159 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b03246-7fed-4ce5-806b-c719bd54456d None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:18.964125 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b03246-7fed-4ce5-806b-c719bd54456d None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:19.001984 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51430d2c-9d9a-4e2a-9e96-dad3a0083558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:19.002653 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51430d2c-9d9a-4e2a-9e96-dad3a0083558 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:19.002932 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51430d2c-9d9a-4e2a-9e96-dad3a0083558 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:19.003201 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51430d2c-9d9a-4e2a-9e96-dad3a0083558 None admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:19.003949 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51430d2c-9d9a-4e2a-9e96-dad3a0083558 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:19.004256 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51430d2c-9d9a-4e2a-9e96-dad3a0083558 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:19.005612 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51430d2c-9d9a-4e2a-9e96-dad3a0083558 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:19.023762 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 545/1084] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:29:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:19.949962 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc188baf-ce7d-41e8-84af-ea831ac43db0 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:19.950517 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc188baf-ce7d-41e8-84af-ea831ac43db0 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:19.950517 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc188baf-ce7d-41e8-84af-ea831ac43db0 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:19.951933 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 540/1085] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:29:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:29:19.958123 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6399d-1ce2-4804-b7f6-12aecf833d2e None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:19.958689 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6399d-1ce2-4804-b7f6-12aecf833d2e None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:19.958785 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6399d-1ce2-4804-b7f6-12aecf833d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:19.977031 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-1bc6399d-1ce2-4804-b7f6-12aecf833d2e None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:19.978756 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-1bc6399d-1ce2-4804-b7f6-12aecf833d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:19.991631 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:20.052436 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 546/1086] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:29:20.075467 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc188baf-ce7d-41e8-84af-ea831ac43db0 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:20.139452 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:20.180871 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc188baf-ce7d-41e8-84af-ea831ac43db0 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:20.213546 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ef9e7-fedd-4fd6-9c82-ac1519353634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:20.214264 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ef9e7-fedd-4fd6-9c82-ac1519353634 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:20.214541 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ef9e7-fedd-4fd6-9c82-ac1519353634 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:20.214808 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ef9e7-fedd-4fd6-9c82-ac1519353634 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:20.225065 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3ef9e7-fedd-4fd6-9c82-ac1519353634 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:29:20.233752 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-ed3ef9e7-fedd-4fd6-9c82-ac1519353634 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 16:29:20.233752 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:20.233752 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:20.233752 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:20.233752 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:20.233752 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:20.233752 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:20.233752 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:20.233752 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:20.233752 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:20.233752 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:20.233752 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:20.233752 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:29:20.233752 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:29:20.233752 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:29:20.233752 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:29:20.234931 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:29:20.234931 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:29:20.234931 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:29:20.234931 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:29:20.234931 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:20.234931 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:20.234931 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:20.234931 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:20.234931 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:20.234931 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:20.234931 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:20.234931 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:20.234931 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:20.234931 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:20.234931 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:20.234931 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:20.236049 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:20.236049 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:20.236049 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:20.236049 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:20.236049 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:29:20.236049 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:29:20.236049 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:29:20.236049 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:29:20.236049 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:29:20.236049 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:29:20.236049 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 16:29:20.236049 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:29:20.236878 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e96a27-009d-497e-9fe2-ff21ad44e053 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:20.236878 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e96a27-009d-497e-9fe2-ff21ad44e053 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:20.236878 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e96a27-009d-497e-9fe2-ff21ad44e053 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:20.237379 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 547/1087] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:29:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:29:20.239839 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 541/1088] 10.222.0.81 () {56 vars in 1120 bytes} [Mon Jul 18 16:29:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:20.240526 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e96a27-009d-497e-9fe2-ff21ad44e053 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:20.242470 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e4b32-8c02-4771-b947-bea09e0666b4 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:20.242752 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e4b32-8c02-4771-b947-bea09e0666b4 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:20.243027 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e4b32-8c02-4771-b947-bea09e0666b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:20.260360 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-a86e4b32-8c02-4771-b947-bea09e0666b4 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:20.261528 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-a86e4b32-8c02-4771-b947-bea09e0666b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:20.327095 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 542/1089] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 16:29:20.341126 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e96a27-009d-497e-9fe2-ff21ad44e053 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:20.350746 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e4b32-8c02-4771-b947-bea09e0666b4 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:20.375726 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3952f73b-97f9-4826-ae28-b0495d8af36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:20.376391 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3952f73b-97f9-4826-ae28-b0495d8af36e None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:20.376671 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3952f73b-97f9-4826-ae28-b0495d8af36e None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:20.376943 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3952f73b-97f9-4826-ae28-b0495d8af36e None admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:20.377677 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3952f73b-97f9-4826-ae28-b0495d8af36e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:20.377988 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3952f73b-97f9-4826-ae28-b0495d8af36e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:20.379337 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3952f73b-97f9-4826-ae28-b0495d8af36e None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:20.388208 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 548/1090] 10.222.0.81 () {56 vars in 1115 bytes} [Mon Jul 18 16:29:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:20.393761 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3952f73b-97f9-4826-ae28-b0495d8af36e None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:20.400222 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:20.405743 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:20.449916 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e4b32-8c02-4771-b947-bea09e0666b4 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:20.488750 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad20bc-9b86-42af-b532-714bf02d17f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:20.489485 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad20bc-9b86-42af-b532-714bf02d17f3 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:20.489771 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad20bc-9b86-42af-b532-714bf02d17f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:20.490046 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad20bc-9b86-42af-b532-714bf02d17f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:20.495320 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3952f73b-97f9-4826-ae28-b0495d8af36e None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:20.500396 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ad20bc-9b86-42af-b532-714bf02d17f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:29:20.508187 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-e5ad20bc-9b86-42af-b532-714bf02d17f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:29:20.508187 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:20.508187 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:20.508187 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:20.508187 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:20.508187 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:20.508187 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:20.508187 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:20.508187 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:20.508187 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:20.508187 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:20.508187 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:20.508187 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:29:20.508187 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:29:20.508187 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:29:20.508187 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:29:20.509833 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:29:20.509833 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:29:20.509833 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:29:20.509833 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:29:20.509833 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:20.509833 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:20.509833 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:20.509833 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:20.509833 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:20.509833 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:20.509833 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:20.509833 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:20.509833 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:20.509833 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:20.509833 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:20.509833 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:20.510910 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:20.510910 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:20.510910 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:20.510910 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:20.510910 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:29:20.510910 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:29:20.510910 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:29:20.510910 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:29:20.510910 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:29:20.510910 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:29:20.510910 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:29:20.510910 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:29:20.510910 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 543/1091] 10.222.0.81 () {56 vars in 1096 bytes} [Mon Jul 18 16:29:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:29:20.515926 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad20bc-9b86-42af-b532-714bf02d17f3 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:20.530205 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ea657-9b25-4725-b0a5-addf5522673c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:20.531002 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ea657-9b25-4725-b0a5-addf5522673c None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:20.531286 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ea657-9b25-4725-b0a5-addf5522673c None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:20.531565 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ea657-9b25-4725-b0a5-addf5522673c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:20.543157 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944ea657-9b25-4725-b0a5-addf5522673c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:20.544655 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944ea657-9b25-4725-b0a5-addf5522673c None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:20.561498 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-944ea657-9b25-4725-b0a5-addf5522673c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:20.561498 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:20.561498 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:20.561498 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:20.561498 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:20.561498 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:20.561498 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:20.561498 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:20.561498 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:20.561498 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:20.561498 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:20.561498 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:20.561498 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:29:20.561498 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:29:20.561498 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:29:20.562460 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:29:20.562460 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:20.562460 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:20.562460 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:20.562460 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:20.562460 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:20.562460 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:20.562460 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:20.562460 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:20.562460 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:20.562460 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:20.562460 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:20.562460 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:20.562460 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:20.562460 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:20.562460 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:20.562460 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:20.563375 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:29:20.563375 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:29:20.563375 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:20.563375 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:29:20.563375 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 549/1092] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:29:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:29:20.568376 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ea657-9b25-4725-b0a5-addf5522673c None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:20.617454 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad20bc-9b86-42af-b532-714bf02d17f3 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:20.627160 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:20.627656 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:20.651201 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ab258-aa7f-49f9-9f7e-61daef9adbdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:20.651909 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ab258-aa7f-49f9-9f7e-61daef9adbdb None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:20.652210 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ab258-aa7f-49f9-9f7e-61daef9adbdb None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:20.652486 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ab258-aa7f-49f9-9f7e-61daef9adbdb None admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:20.653229 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18ab258-aa7f-49f9-9f7e-61daef9adbdb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:20.653533 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18ab258-aa7f-49f9-9f7e-61daef9adbdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:20.654901 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18ab258-aa7f-49f9-9f7e-61daef9adbdb None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:20.663330 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 544/1093] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Jul 18 16:29:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:20.667479 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ea657-9b25-4725-b0a5-addf5522673c None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:20.669593 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ab258-aa7f-49f9-9f7e-61daef9adbdb None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:20.702013 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82668d26-239d-450d-9e08-7b669894c67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:20.702657 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82668d26-239d-450d-9e08-7b669894c67e None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:20.702989 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82668d26-239d-450d-9e08-7b669894c67e None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:20.703260 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82668d26-239d-450d-9e08-7b669894c67e None admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:20.703996 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82668d26-239d-450d-9e08-7b669894c67e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:20.704297 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82668d26-239d-450d-9e08-7b669894c67e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:20.705647 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82668d26-239d-450d-9e08-7b669894c67e None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:20.717554 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 550/1094] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:29:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:20.722990 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82668d26-239d-450d-9e08-7b669894c67e None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:20.775030 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ab258-aa7f-49f9-9f7e-61daef9adbdb None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:20.812853 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430ac893-e7a8-4bc2-8720-52338aa2f6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:20.813732 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ac893-e7a8-4bc2-8720-52338aa2f6a4 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:20.814017 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ac893-e7a8-4bc2-8720-52338aa2f6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:20.814296 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ac893-e7a8-4bc2-8720-52338aa2f6a4 None admin] PATH_INFO: `/v3/users/f4eb571a0ebd48f08fabb049b9eeaa73` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:20.815577 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430ac893-e7a8-4bc2-8720-52338aa2f6a4 None admin] RBAC: Authorizing `identity:get_user(user_id=f4eb571a0ebd48f08fabb049b9eeaa73)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:20.817059 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430ac893-e7a8-4bc2-8720-52338aa2f6a4 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:20.818728 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 545/1095] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Jul 18 16:29:20 2022] GET /identity/v3/users/f4eb571a0ebd48f08fabb049b9eeaa73 => generated 285 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:20.824597 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430ac893-e7a8-4bc2-8720-52338aa2f6a4 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:20.825890 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82668d26-239d-450d-9e08-7b669894c67e None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:20.848209 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:20.863769 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab57cf74-6b0d-48b1-81af-9d3ce50b37c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:20.864585 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57cf74-6b0d-48b1-81af-9d3ce50b37c2 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:20.864867 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57cf74-6b0d-48b1-81af-9d3ce50b37c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:20.865145 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57cf74-6b0d-48b1-81af-9d3ce50b37c2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:20.871629 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:20.874064 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab57cf74-6b0d-48b1-81af-9d3ce50b37c2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:20.875554 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab57cf74-6b0d-48b1-81af-9d3ce50b37c2 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:20.891209 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-ab57cf74-6b0d-48b1-81af-9d3ce50b37c2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 16:29:20.891209 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:20.891209 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:20.891209 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:20.891209 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:20.891209 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:20.891209 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:20.891209 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:20.891209 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:20.891209 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:20.891209 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:20.891209 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:20.891209 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:29:20.891209 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:29:20.891209 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:29:20.891209 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:29:20.892318 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:20.892318 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:20.892318 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:29:20.892318 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:29:20.892318 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:29:20.892318 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:29:20.892318 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:20.892318 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:20.892318 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:20.892318 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:20.892318 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:20.892318 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:20.892318 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:20.892318 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:20.892318 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:20.892318 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:20.892318 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:20.892318 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:20.893304 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:20.893304 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:20.893304 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:29:20.893304 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:29:20.893304 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:29:20.893304 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:29:20.893304 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:29:20.893304 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:29:20.893304 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 16:29:20.893304 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:29:20.893304 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 551/1096] 10.222.0.81 () {56 vars in 1093 bytes} [Mon Jul 18 16:29:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:29:20.898526 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab57cf74-6b0d-48b1-81af-9d3ce50b37c2 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:20.935700 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430ac893-e7a8-4bc2-8720-52338aa2f6a4 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:20.972660 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc5c60f-9d61-495c-a441-f925c8253a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:20.973305 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5c60f-9d61-495c-a441-f925c8253a1c None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:20.973499 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5c60f-9d61-495c-a441-f925c8253a1c None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:20.973767 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5c60f-9d61-495c-a441-f925c8253a1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:21.013835 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab57cf74-6b0d-48b1-81af-9d3ce50b37c2 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:21.044899 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc5c60f-9d61-495c-a441-f925c8253a1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:21.046355 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc5c60f-9d61-495c-a441-f925c8253a1c None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:21.049850 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26da57c-730e-4b07-8f10-8f3074ff6b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:21.050529 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26da57c-730e-4b07-8f10-8f3074ff6b4b None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:21.050813 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26da57c-730e-4b07-8f10-8f3074ff6b4b None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:21.051088 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26da57c-730e-4b07-8f10-8f3074ff6b4b None admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:21.052036 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26da57c-730e-4b07-8f10-8f3074ff6b4b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:21.052325 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26da57c-730e-4b07-8f10-8f3074ff6b4b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:21.053785 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26da57c-730e-4b07-8f10-8f3074ff6b4b None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:21.071897 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 552/1097] 10.222.0.81 () {56 vars in 1133 bytes} [Mon Jul 18 16:29:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:21.077627 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26da57c-730e-4b07-8f10-8f3074ff6b4b None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:21.087949 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:21.116918 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:21.146582 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 546/1098] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Jul 18 16:29:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 18 16:29:21.153243 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc5c60f-9d61-495c-a441-f925c8253a1c None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:21.179918 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26da57c-730e-4b07-8f10-8f3074ff6b4b None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:21.215735 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05214689-92aa-4742-9a9d-400708731a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:21.216389 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05214689-92aa-4742-9a9d-400708731a9b None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:21.216672 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05214689-92aa-4742-9a9d-400708731a9b None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:21.216948 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05214689-92aa-4742-9a9d-400708731a9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:21.254757 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc5c60f-9d61-495c-a441-f925c8253a1c None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:21.289014 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ebe068-854d-4bb6-b0ed-63a71cf2e543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:21.289864 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ebe068-854d-4bb6-b0ed-63a71cf2e543 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:21.290144 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ebe068-854d-4bb6-b0ed-63a71cf2e543 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:21.290452 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ebe068-854d-4bb6-b0ed-63a71cf2e543 None admin] PATH_INFO: `/v3/projects/d5d5073c347b4f3e8b57229b255b7fbc` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:21.291619 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ebe068-854d-4bb6-b0ed-63a71cf2e543 None admin] RBAC: Authorizing `identity:get_project(project_id=d5d5073c347b4f3e8b57229b255b7fbc)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:21.292583 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05214689-92aa-4742-9a9d-400708731a9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:21.293086 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ebe068-854d-4bb6-b0ed-63a71cf2e543 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:21.294042 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05214689-92aa-4742-9a9d-400708731a9b None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:21.295115 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 547/1099] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Jul 18 16:29:21 2022] GET /identity/v3/projects/d5d5073c347b4f3e8b57229b255b7fbc => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:21.300797 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ebe068-854d-4bb6-b0ed-63a71cf2e543 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:21.311195 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:21.333633 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:21.393929 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 553/1100] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Jul 18 16:29:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 18 16:29:21.399565 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ebe068-854d-4bb6-b0ed-63a71cf2e543 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:21.399794 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05214689-92aa-4742-9a9d-400708731a9b None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:21.434605 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef035a8-6159-477f-af6d-97a6da9a4c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:21.435260 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef035a8-6159-477f-af6d-97a6da9a4c55 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:21.435543 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef035a8-6159-477f-af6d-97a6da9a4c55 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:21.435847 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef035a8-6159-477f-af6d-97a6da9a4c55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:21.436669 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef035a8-6159-477f-af6d-97a6da9a4c55 None admin] RBAC: Adding query filter params (role.id=fd83eab44cb343a2b532ce32a2ac31d8, scope.project.id=d5d5073c347b4f3e8b57229b255b7fbc, user.id=f4eb571a0ebd48f08fabb049b9eeaa73) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:21.436981 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef035a8-6159-477f-af6d-97a6da9a4c55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:21.438400 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef035a8-6159-477f-af6d-97a6da9a4c55 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:21.444464 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 548/1101] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Jul 18 16:29:21 2022] GET /identity/v3/role_assignments?user.id=f4eb571a0ebd48f08fabb049b9eeaa73&scope.project.id=d5d5073c347b4f3e8b57229b255b7fbc&role.id=fd83eab44cb343a2b532ce32a2ac31d8 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:21.504004 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05214689-92aa-4742-9a9d-400708731a9b None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:21.542874 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24b5fb-5223-446e-af10-f9f9ea6c217b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:21.543589 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24b5fb-5223-446e-af10-f9f9ea6c217b None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:21.543899 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24b5fb-5223-446e-af10-f9f9ea6c217b None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:21.544176 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24b5fb-5223-446e-af10-f9f9ea6c217b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:21.551765 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:21.556397 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb24b5fb-5223-446e-af10-f9f9ea6c217b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:21.557705 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb24b5fb-5223-446e-af10-f9f9ea6c217b None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:21.577566 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-bb24b5fb-5223-446e-af10-f9f9ea6c217b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:21.577566 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:21.577566 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:21.577566 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:21.577566 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:21.577566 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:21.577566 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:21.577566 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:21.577566 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:21.577566 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:21.577566 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:21.577566 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:21.577566 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:29:21.577566 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:29:21.577566 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:29:21.578601 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:29:21.578601 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:21.578601 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:21.578601 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:21.578601 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:21.578601 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:21.578601 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:21.578601 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:21.578601 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:21.578601 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:21.578601 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:21.578601 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:21.578601 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:21.578601 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:21.578601 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:21.578601 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:21.578601 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:21.579544 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:29:21.579544 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:29:21.579544 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:21.579544 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:29:21.579544 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 554/1102] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:29:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:29:21.585631 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef035a8-6159-477f-af6d-97a6da9a4c55 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:21.662487 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:21.705800 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef035a8-6159-477f-af6d-97a6da9a4c55 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:21.739699 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2abccf-1759-4216-9352-78a28eaf48b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:21.740381 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2abccf-1759-4216-9352-78a28eaf48b4 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:21.740659 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2abccf-1759-4216-9352-78a28eaf48b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:21.740935 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2abccf-1759-4216-9352-78a28eaf48b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:21.741657 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2abccf-1759-4216-9352-78a28eaf48b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:21.741957 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2abccf-1759-4216-9352-78a28eaf48b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:21.743330 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2abccf-1759-4216-9352-78a28eaf48b4 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:21.756170 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 549/1103] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:29:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:21.762614 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24b5fb-5223-446e-af10-f9f9ea6c217b None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:21.869799 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24b5fb-5223-446e-af10-f9f9ea6c217b None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:21.904443 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31973326-84f3-4f68-bdc4-3e7ad5f2990b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:21.905242 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31973326-84f3-4f68-bdc4-3e7ad5f2990b None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:21.905518 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31973326-84f3-4f68-bdc4-3e7ad5f2990b None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:21.905822 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31973326-84f3-4f68-bdc4-3e7ad5f2990b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:21.917221 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31973326-84f3-4f68-bdc4-3e7ad5f2990b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:21.922470 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31973326-84f3-4f68-bdc4-3e7ad5f2990b None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:21.938236 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-31973326-84f3-4f68-bdc4-3e7ad5f2990b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:29:21.938236 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:21.938236 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:21.938236 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:21.938236 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:21.938236 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:21.938236 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:21.938236 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:21.938236 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:21.938236 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:21.938236 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:21.938236 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:21.938236 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:29:21.938236 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:29:21.938236 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:29:21.939380 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:29:21.939380 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:21.939380 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:21.939380 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:21.939380 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:21.939380 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:21.939380 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:21.939380 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:21.939380 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:21.939380 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:21.939380 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:21.939380 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:21.939380 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:21.939380 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:21.939380 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:21.939380 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:21.939380 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:21.941085 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:29:21.941085 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:29:21.941085 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:29:21.941085 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:29:21.941085 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:29:21.941085 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:29:21.941085 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:29:21.941085 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:29:21.941085 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 555/1104] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Jul 18 16:29:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:21.945571 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2abccf-1759-4216-9352-78a28eaf48b4 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:22.061916 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2abccf-1759-4216-9352-78a28eaf48b4 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:22.094003 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:22.099006 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd2c89-55be-4315-8495-709916c9c8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:22.099685 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd2c89-55be-4315-8495-709916c9c8e5 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:22.099986 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd2c89-55be-4315-8495-709916c9c8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:22.100258 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd2c89-55be-4315-8495-709916c9c8e5 None admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:22.101048 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfd2c89-55be-4315-8495-709916c9c8e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:22.101348 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfd2c89-55be-4315-8495-709916c9c8e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:22.103338 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfd2c89-55be-4315-8495-709916c9c8e5 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:22.116304 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 550/1105] 10.222.0.81 () {56 vars in 1148 bytes} [Mon Jul 18 16:29:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:22.123997 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31973326-84f3-4f68-bdc4-3e7ad5f2990b None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:22.177285 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:22.229179 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31973326-84f3-4f68-bdc4-3e7ad5f2990b None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:22.262725 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edba75d-2305-43e4-a775-ad27ac570355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:22.263379 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edba75d-2305-43e4-a775-ad27ac570355 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:22.263665 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edba75d-2305-43e4-a775-ad27ac570355 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:22.263972 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edba75d-2305-43e4-a775-ad27ac570355 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:22.264801 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edba75d-2305-43e4-a775-ad27ac570355 None admin] RBAC: Adding query filter params (role.id=98b55727d5284c6e92f21b06e332215f, scope.project.id=9d1d84bf334d47e6bfba1141c1fc6f59, user.id=07f0c5bf1bee48a0bafdf7a9e4537c70) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:22.265114 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edba75d-2305-43e4-a775-ad27ac570355 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:22.266537 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edba75d-2305-43e4-a775-ad27ac570355 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:22.272417 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 556/1106] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Jul 18 16:29:22 2022] GET /identity/v3/role_assignments?user.id=07f0c5bf1bee48a0bafdf7a9e4537c70&scope.project.id=9d1d84bf334d47e6bfba1141c1fc6f59&role.id=98b55727d5284c6e92f21b06e332215f => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:23.526809 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66892c69-5494-48c3-944e-d1990ba8a40e None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:23.527343 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66892c69-5494-48c3-944e-d1990ba8a40e None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:23.527343 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66892c69-5494-48c3-944e-d1990ba8a40e None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:23.528762 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 551/1107] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:29:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:29:23.534355 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c1bd9-567d-46ed-a200-bd255faa358b None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:23.534812 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c1bd9-567d-46ed-a200-bd255faa358b None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:23.535064 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c1bd9-567d-46ed-a200-bd255faa358b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:23.551834 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-ef8c1bd9-567d-46ed-a200-bd255faa358b None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:23.553038 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-ef8c1bd9-567d-46ed-a200-bd255faa358b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:23.621529 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 557/1108] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:29:23.647311 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66892c69-5494-48c3-944e-d1990ba8a40e None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:23.747011 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66892c69-5494-48c3-944e-d1990ba8a40e None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:23.780664 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d528eeb3-66d7-4315-8c24-41f775be0867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:23.781444 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528eeb3-66d7-4315-8c24-41f775be0867 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:23.781726 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528eeb3-66d7-4315-8c24-41f775be0867 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:23.781999 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528eeb3-66d7-4315-8c24-41f775be0867 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:23.783159 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d528eeb3-66d7-4315-8c24-41f775be0867 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:23.784608 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d528eeb3-66d7-4315-8c24-41f775be0867 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:23.786222 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 552/1109] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:29:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:23.792295 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c1bd9-567d-46ed-a200-bd255faa358b None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:23.839699 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:23.892170 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c1bd9-567d-46ed-a200-bd255faa358b None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:23.924891 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d10df6a-c85d-48e8-85d1-7103b4c5add9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:23.925549 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d10df6a-c85d-48e8-85d1-7103b4c5add9 None admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:23.925824 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d10df6a-c85d-48e8-85d1-7103b4c5add9 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:23.926090 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d10df6a-c85d-48e8-85d1-7103b4c5add9 None admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:23.926780 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d10df6a-c85d-48e8-85d1-7103b4c5add9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:23.928242 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d10df6a-c85d-48e8-85d1-7103b4c5add9 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:24.045773 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 558/1110] 10.222.0.81 () {60 vars in 1132 bytes} [Mon Jul 18 16:29:23 2022] POST /identity/v3/users => generated 286 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:29:26.123620 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f56ba-1001-4013-a425-fd5ac457ac8e None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:26.124204 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f56ba-1001-4013-a425-fd5ac457ac8e None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:26.124204 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f56ba-1001-4013-a425-fd5ac457ac8e None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:26.125608 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 553/1111] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:29:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:29:26.131771 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef4469-8518-44a8-9e09-a2bea79ac900 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:26.132373 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef4469-8518-44a8-9e09-a2bea79ac900 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:26.132479 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef4469-8518-44a8-9e09-a2bea79ac900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:26.150647 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-d4ef4469-8518-44a8-9e09-a2bea79ac900 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:26.151898 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-d4ef4469-8518-44a8-9e09-a2bea79ac900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:26.228915 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 559/1112] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:29:26.252604 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915f56ba-1001-4013-a425-fd5ac457ac8e None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:26.314871 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:26.357527 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915f56ba-1001-4013-a425-fd5ac457ac8e None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:26.392820 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2bb3ba-b874-48d2-8587-4f7e83151e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:26.393578 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2bb3ba-b874-48d2-8587-4f7e83151e7e None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:26.393862 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2bb3ba-b874-48d2-8587-4f7e83151e7e None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:26.394139 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2bb3ba-b874-48d2-8587-4f7e83151e7e None admin] PATH_INFO: `/v3/roles/6bfa001ddac347da894c7231f853c3df` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:26.395644 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2bb3ba-b874-48d2-8587-4f7e83151e7e None admin] RBAC: Authorizing `identity:get_role(role_id=6bfa001ddac347da894c7231f853c3df)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:26.397044 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2bb3ba-b874-48d2-8587-4f7e83151e7e None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:26.398434 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 554/1113] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Jul 18 16:29:26 2022] GET /identity/v3/roles/6bfa001ddac347da894c7231f853c3df => generated 223 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:26.405266 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ef4469-8518-44a8-9e09-a2bea79ac900 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:26.435127 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:26.504852 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ef4469-8518-44a8-9e09-a2bea79ac900 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:26.541459 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9233740-42dd-4ca8-96a3-18a4b10c0cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:26.542344 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9233740-42dd-4ca8-96a3-18a4b10c0cbe None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:26.542631 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9233740-42dd-4ca8-96a3-18a4b10c0cbe None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:26.542914 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9233740-42dd-4ca8-96a3-18a4b10c0cbe None admin] PATH_INFO: `/v3/users/fb71e03370da4c1ab4d4a2388a5bbeb2` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:26.557246 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9233740-42dd-4ca8-96a3-18a4b10c0cbe None admin] RBAC: Authorizing `identity:get_user(user_id=fb71e03370da4c1ab4d4a2388a5bbeb2)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:26.558699 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9233740-42dd-4ca8-96a3-18a4b10c0cbe None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:26.560481 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 560/1114] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Jul 18 16:29:26 2022] GET /identity/v3/users/fb71e03370da4c1ab4d4a2388a5bbeb2 => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:26.566674 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2bb3ba-b874-48d2-8587-4f7e83151e7e None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:26.666619 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2bb3ba-b874-48d2-8587-4f7e83151e7e None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:26.691589 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:26.699625 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adee49e0-27a6-475c-8852-9cc5e65860e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:26.700353 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee49e0-27a6-475c-8852-9cc5e65860e7 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:26.700634 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee49e0-27a6-475c-8852-9cc5e65860e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:26.703641 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee49e0-27a6-475c-8852-9cc5e65860e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:26.766047 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adee49e0-27a6-475c-8852-9cc5e65860e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:26.767489 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adee49e0-27a6-475c-8852-9cc5e65860e7 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:26.866649 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 555/1115] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Jul 18 16:29:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 16:29:26.876303 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9233740-42dd-4ca8-96a3-18a4b10c0cbe None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:26.967310 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:26.978486 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9233740-42dd-4ca8-96a3-18a4b10c0cbe None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:27.013705 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46884409-ff91-4bf1-a64d-293d1b97a618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:27.014571 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46884409-ff91-4bf1-a64d-293d1b97a618 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:27.014849 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46884409-ff91-4bf1-a64d-293d1b97a618 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:27.015123 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46884409-ff91-4bf1-a64d-293d1b97a618 None admin] PATH_INFO: `/v3/projects/d5d5073c347b4f3e8b57229b255b7fbc` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:27.016329 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46884409-ff91-4bf1-a64d-293d1b97a618 None admin] RBAC: Authorizing `identity:get_project(project_id=d5d5073c347b4f3e8b57229b255b7fbc)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:27.017758 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46884409-ff91-4bf1-a64d-293d1b97a618 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:27.019468 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 561/1116] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Jul 18 16:29:26 2022] GET /identity/v3/projects/d5d5073c347b4f3e8b57229b255b7fbc => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:27.025740 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adee49e0-27a6-475c-8852-9cc5e65860e7 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:27.053073 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:27.124740 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adee49e0-27a6-475c-8852-9cc5e65860e7 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:27.185039 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f775c8cc-c2d1-4edc-935b-a1a729f5c6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:27.185696 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f775c8cc-c2d1-4edc-935b-a1a729f5c6a7 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:27.185974 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f775c8cc-c2d1-4edc-935b-a1a729f5c6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:27.186248 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f775c8cc-c2d1-4edc-935b-a1a729f5c6a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:27.187079 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f775c8cc-c2d1-4edc-935b-a1a729f5c6a7 None admin] RBAC: Adding query filter params (role.id=6bfa001ddac347da894c7231f853c3df, scope.project.id=d5d5073c347b4f3e8b57229b255b7fbc, user.id=fb71e03370da4c1ab4d4a2388a5bbeb2) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:27.187390 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f775c8cc-c2d1-4edc-935b-a1a729f5c6a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:27.188858 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f775c8cc-c2d1-4edc-935b-a1a729f5c6a7 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:27.194757 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 556/1117] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Jul 18 16:29:27 2022] GET /identity/v3/role_assignments?user.id=fb71e03370da4c1ab4d4a2388a5bbeb2&scope.project.id=d5d5073c347b4f3e8b57229b255b7fbc&role.id=6bfa001ddac347da894c7231f853c3df => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:29.236019 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67843d3-0973-41fa-9d0a-4d2ddbf0ac2a None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:29.236598 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67843d3-0973-41fa-9d0a-4d2ddbf0ac2a None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:29.236598 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67843d3-0973-41fa-9d0a-4d2ddbf0ac2a None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:29.237993 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 562/1118] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:29:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:29:29.243733 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c0fb2-bee9-4700-b656-4d3127b2c600 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:29.244186 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c0fb2-bee9-4700-b656-4d3127b2c600 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:29.244294 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c0fb2-bee9-4700-b656-4d3127b2c600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:29.261202 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-948c0fb2-bee9-4700-b656-4d3127b2c600 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:29.262395 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-948c0fb2-bee9-4700-b656-4d3127b2c600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:29.326799 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 557/1119] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:29:29.349492 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67843d3-0973-41fa-9d0a-4d2ddbf0ac2a None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:29.450769 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67843d3-0973-41fa-9d0a-4d2ddbf0ac2a None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:29.487272 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3869a0a8-4a6b-4bbd-8779-16143c983b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:29.488085 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3869a0a8-4a6b-4bbd-8779-16143c983b62 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:29.488364 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3869a0a8-4a6b-4bbd-8779-16143c983b62 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:29.488656 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3869a0a8-4a6b-4bbd-8779-16143c983b62 None admin] PATH_INFO: `/v3/roles/6bfa001ddac347da894c7231f853c3df` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:29.490103 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3869a0a8-4a6b-4bbd-8779-16143c983b62 None admin] RBAC: Authorizing `identity:get_role(role_id=6bfa001ddac347da894c7231f853c3df)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:29.491454 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3869a0a8-4a6b-4bbd-8779-16143c983b62 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:29.492866 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 563/1120] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Jul 18 16:29:29 2022] GET /identity/v3/roles/6bfa001ddac347da894c7231f853c3df => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:29.498909 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c0fb2-bee9-4700-b656-4d3127b2c600 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:29.523472 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:29.595614 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c0fb2-bee9-4700-b656-4d3127b2c600 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:29.627928 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c11ce5-cfcd-48b6-a9c3-9047fffed50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:29.628782 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c11ce5-cfcd-48b6-a9c3-9047fffed50a None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:29.629059 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c11ce5-cfcd-48b6-a9c3-9047fffed50a None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:29.629330 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c11ce5-cfcd-48b6-a9c3-9047fffed50a None admin] PATH_INFO: `/v3/users/fb71e03370da4c1ab4d4a2388a5bbeb2` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:29.630499 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c11ce5-cfcd-48b6-a9c3-9047fffed50a None admin] RBAC: Authorizing `identity:get_user(user_id=fb71e03370da4c1ab4d4a2388a5bbeb2)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:29.632217 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c11ce5-cfcd-48b6-a9c3-9047fffed50a None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:29.634325 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 558/1121] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Jul 18 16:29:29 2022] GET /identity/v3/users/fb71e03370da4c1ab4d4a2388a5bbeb2 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:29.640113 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3869a0a8-4a6b-4bbd-8779-16143c983b62 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:29.665482 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:29.738588 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3869a0a8-4a6b-4bbd-8779-16143c983b62 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:29.771632 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09dc605-68bf-48f3-bd2a-a10a98d79eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:29.772504 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09dc605-68bf-48f3-bd2a-a10a98d79eab None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:29.772782 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09dc605-68bf-48f3-bd2a-a10a98d79eab None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:29.773054 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09dc605-68bf-48f3-bd2a-a10a98d79eab None admin] PATH_INFO: `/v3/projects/d5d5073c347b4f3e8b57229b255b7fbc` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:29.774246 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09dc605-68bf-48f3-bd2a-a10a98d79eab None admin] RBAC: Authorizing `identity:get_project(project_id=d5d5073c347b4f3e8b57229b255b7fbc)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:29.776280 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09dc605-68bf-48f3-bd2a-a10a98d79eab None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:29.777965 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 564/1122] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Jul 18 16:29:29 2022] GET /identity/v3/projects/d5d5073c347b4f3e8b57229b255b7fbc => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:29.783906 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c11ce5-cfcd-48b6-a9c3-9047fffed50a None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:29.882803 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:29.892546 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c11ce5-cfcd-48b6-a9c3-9047fffed50a None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:29.937855 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db978a-0294-4262-abb2-8e44e968e184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:29.938720 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db978a-0294-4262-abb2-8e44e968e184 None admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:29.938998 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db978a-0294-4262-abb2-8e44e968e184 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:29.939275 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db978a-0294-4262-abb2-8e44e968e184 None admin] PATH_INFO: `/v3/projects/d5d5073c347b4f3e8b57229b255b7fbc/users/fb71e03370da4c1ab4d4a2388a5bbeb2/roles/6bfa001ddac347da894c7231f853c3df` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:29.941479 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1db978a-0294-4262-abb2-8e44e968e184 None admin] RBAC: Authorizing `identity:create_grant(project_id=d5d5073c347b4f3e8b57229b255b7fbc, user_id=fb71e03370da4c1ab4d4a2388a5bbeb2, role_id=6bfa001ddac347da894c7231f853c3df)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:29.942898 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1db978a-0294-4262-abb2-8e44e968e184 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:30.018348 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 559/1123] 10.222.0.81 () {58 vars in 1439 bytes} [Mon Jul 18 16:29:29 2022] PUT /identity/v3/projects/d5d5073c347b4f3e8b57229b255b7fbc/users/fb71e03370da4c1ab4d4a2388a5bbeb2/roles/6bfa001ddac347da894c7231f853c3df => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:29:32.024976 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310c73b-8bff-468d-b6d9-d74219a9a119 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:32.025618 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310c73b-8bff-468d-b6d9-d74219a9a119 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:32.025618 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310c73b-8bff-468d-b6d9-d74219a9a119 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:32.030248 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 565/1124] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:29:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:29:32.035796 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2de93-ac07-423b-ba95-c916ead67581 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:32.036247 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2de93-ac07-423b-ba95-c916ead67581 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:32.036340 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2de93-ac07-423b-ba95-c916ead67581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:32.052822 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-52a2de93-ac07-423b-ba95-c916ead67581 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:32.054060 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-52a2de93-ac07-423b-ba95-c916ead67581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:32.120284 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 560/1125] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:29:32.144245 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2310c73b-8bff-468d-b6d9-d74219a9a119 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:32.234194 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:32.244087 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2310c73b-8bff-468d-b6d9-d74219a9a119 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:32.278096 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0202d88-d735-429e-84fe-845c4946d066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:32.278879 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0202d88-d735-429e-84fe-845c4946d066 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:32.279153 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0202d88-d735-429e-84fe-845c4946d066 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:32.279424 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0202d88-d735-429e-84fe-845c4946d066 None admin] PATH_INFO: `/v3/roles/6bfa001ddac347da894c7231f853c3df` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:32.280916 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0202d88-d735-429e-84fe-845c4946d066 None admin] RBAC: Authorizing `identity:get_role(role_id=6bfa001ddac347da894c7231f853c3df)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:32.282271 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0202d88-d735-429e-84fe-845c4946d066 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:32.283644 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 566/1126] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Jul 18 16:29:32 2022] GET /identity/v3/roles/6bfa001ddac347da894c7231f853c3df => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:32.290083 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a2de93-ac07-423b-ba95-c916ead67581 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:32.366995 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:32.396828 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a2de93-ac07-423b-ba95-c916ead67581 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:32.436000 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600cf23c-5ce8-48e5-aac1-d02f78ab63df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:32.436948 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600cf23c-5ce8-48e5-aac1-d02f78ab63df None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:32.437231 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600cf23c-5ce8-48e5-aac1-d02f78ab63df None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:32.437505 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600cf23c-5ce8-48e5-aac1-d02f78ab63df None admin] PATH_INFO: `/v3/users/fb71e03370da4c1ab4d4a2388a5bbeb2` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:32.438710 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600cf23c-5ce8-48e5-aac1-d02f78ab63df None admin] RBAC: Authorizing `identity:get_user(user_id=fb71e03370da4c1ab4d4a2388a5bbeb2)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:32.440187 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600cf23c-5ce8-48e5-aac1-d02f78ab63df None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:32.441844 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 561/1127] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Jul 18 16:29:32 2022] GET /identity/v3/users/fb71e03370da4c1ab4d4a2388a5bbeb2 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:32.447974 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0202d88-d735-429e-84fe-845c4946d066 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:32.547820 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0202d88-d735-429e-84fe-845c4946d066 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:32.581034 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5730cbf2-8790-4f49-b302-45d198b060ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:32.581678 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730cbf2-8790-4f49-b302-45d198b060ae None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:32.581963 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730cbf2-8790-4f49-b302-45d198b060ae None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:32.582241 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730cbf2-8790-4f49-b302-45d198b060ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:32.609858 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:32.648870 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5730cbf2-8790-4f49-b302-45d198b060ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:32.651361 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5730cbf2-8790-4f49-b302-45d198b060ae None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:32.745329 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 567/1128] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Jul 18 16:29:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 16:29:32.751426 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600cf23c-5ce8-48e5-aac1-d02f78ab63df None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:32.847773 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600cf23c-5ce8-48e5-aac1-d02f78ab63df None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:32.880959 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4815c21-f6e7-437a-9baa-005f07c6a332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:32.882047 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4815c21-f6e7-437a-9baa-005f07c6a332 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:32.882324 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4815c21-f6e7-437a-9baa-005f07c6a332 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:32.882600 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4815c21-f6e7-437a-9baa-005f07c6a332 None admin] PATH_INFO: `/v3/projects/d5d5073c347b4f3e8b57229b255b7fbc` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:32.883834 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4815c21-f6e7-437a-9baa-005f07c6a332 None admin] RBAC: Authorizing `identity:get_project(project_id=d5d5073c347b4f3e8b57229b255b7fbc)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:32.885254 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4815c21-f6e7-437a-9baa-005f07c6a332 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:32.886933 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 562/1129] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Jul 18 16:29:32 2022] GET /identity/v3/projects/d5d5073c347b4f3e8b57229b255b7fbc => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:32.893138 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5730cbf2-8790-4f49-b302-45d198b060ae None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:32.950575 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:32.989479 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5730cbf2-8790-4f49-b302-45d198b060ae None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:33.021475 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4c032c-fbe1-4215-a05e-8ed512c80025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:33.022115 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4c032c-fbe1-4215-a05e-8ed512c80025 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:33.022393 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4c032c-fbe1-4215-a05e-8ed512c80025 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:33.022665 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4c032c-fbe1-4215-a05e-8ed512c80025 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:33.023478 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4c032c-fbe1-4215-a05e-8ed512c80025 None admin] RBAC: Adding query filter params (role.id=6bfa001ddac347da894c7231f853c3df, scope.project.id=d5d5073c347b4f3e8b57229b255b7fbc, user.id=fb71e03370da4c1ab4d4a2388a5bbeb2) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:33.023812 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4c032c-fbe1-4215-a05e-8ed512c80025 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:33.025842 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4c032c-fbe1-4215-a05e-8ed512c80025 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:33.031733 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 568/1130] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Jul 18 16:29:32 2022] GET /identity/v3/role_assignments?user.id=fb71e03370da4c1ab4d4a2388a5bbeb2&scope.project.id=d5d5073c347b4f3e8b57229b255b7fbc&role.id=6bfa001ddac347da894c7231f853c3df => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:35.061949 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56e59b-cfb4-48ab-8118-5356c6ae40a4 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:35.062510 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56e59b-cfb4-48ab-8118-5356c6ae40a4 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:35.062510 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56e59b-cfb4-48ab-8118-5356c6ae40a4 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:35.063874 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 563/1131] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:29:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:29:35.069184 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ead4e-423a-4526-bfdc-5dcc1f333662 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:35.069591 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ead4e-423a-4526-bfdc-5dcc1f333662 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:35.069743 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ead4e-423a-4526-bfdc-5dcc1f333662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:35.088930 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-5a3ead4e-423a-4526-bfdc-5dcc1f333662 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:35.090141 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-5a3ead4e-423a-4526-bfdc-5dcc1f333662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:35.158979 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 569/1132] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:29:35.182453 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc56e59b-cfb4-48ab-8118-5356c6ae40a4 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:35.200738 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:35.285256 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc56e59b-cfb4-48ab-8118-5356c6ae40a4 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:35.318048 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45545b63-7a26-4710-abb6-e60318637496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:35.318755 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45545b63-7a26-4710-abb6-e60318637496 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:35.319036 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45545b63-7a26-4710-abb6-e60318637496 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:35.319313 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45545b63-7a26-4710-abb6-e60318637496 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:35.320486 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45545b63-7a26-4710-abb6-e60318637496 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:35.322014 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45545b63-7a26-4710-abb6-e60318637496 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:35.323695 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 564/1133] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:29:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:35.329705 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3ead4e-423a-4526-bfdc-5dcc1f333662 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:35.384214 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:35.427588 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3ead4e-423a-4526-bfdc-5dcc1f333662 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:35.460322 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c905289-a28b-4afe-b277-5e5b8cc47b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:35.460981 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c905289-a28b-4afe-b277-5e5b8cc47b65 None admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:35.461263 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c905289-a28b-4afe-b277-5e5b8cc47b65 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:35.462066 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c905289-a28b-4afe-b277-5e5b8cc47b65 None admin] PATH_INFO: `/v3/projects` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:35.462775 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c905289-a28b-4afe-b277-5e5b8cc47b65 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:35.464675 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c905289-a28b-4afe-b277-5e5b8cc47b65 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:35.565639 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 570/1134] 10.222.0.81 () {60 vars in 1141 bytes} [Mon Jul 18 16:29:35 2022] POST /identity/v3/projects => generated 311 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:29:37.614783 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e134d8-5a17-4f25-b86c-2c7fdf09a6e1 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:37.615369 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e134d8-5a17-4f25-b86c-2c7fdf09a6e1 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:37.615369 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e134d8-5a17-4f25-b86c-2c7fdf09a6e1 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:37.616721 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 565/1135] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:29:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:29:37.621877 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b4bd5-069c-49be-92e6-b81aacfe0645 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:37.622282 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b4bd5-069c-49be-92e6-b81aacfe0645 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:37.622435 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b4bd5-069c-49be-92e6-b81aacfe0645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:37.639292 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-e83b4bd5-069c-49be-92e6-b81aacfe0645 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:37.640507 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-e83b4bd5-069c-49be-92e6-b81aacfe0645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:37.704902 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 571/1136] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:29:37.730157 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e134d8-5a17-4f25-b86c-2c7fdf09a6e1 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:37.813492 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:37.830174 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e134d8-5a17-4f25-b86c-2c7fdf09a6e1 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:37.864286 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76641320-40a0-4b44-bdbe-67284f2e2229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:37.865073 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76641320-40a0-4b44-bdbe-67284f2e2229 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:37.865349 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76641320-40a0-4b44-bdbe-67284f2e2229 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:37.865624 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76641320-40a0-4b44-bdbe-67284f2e2229 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:37.866787 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76641320-40a0-4b44-bdbe-67284f2e2229 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:37.868319 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76641320-40a0-4b44-bdbe-67284f2e2229 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:37.869982 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 566/1137] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:29:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:37.876069 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b4bd5-069c-49be-92e6-b81aacfe0645 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:37.910531 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:37.985332 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b4bd5-069c-49be-92e6-b81aacfe0645 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:38.019649 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b1908-8d05-4ae0-8d40-637d0271f429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:38.020330 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b1908-8d05-4ae0-8d40-637d0271f429 None admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:38.020611 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b1908-8d05-4ae0-8d40-637d0271f429 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:38.020884 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b1908-8d05-4ae0-8d40-637d0271f429 None admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:38.021585 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9b1908-8d05-4ae0-8d40-637d0271f429 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:38.023007 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9b1908-8d05-4ae0-8d40-637d0271f429 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:38.147263 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 572/1138] 10.222.0.81 () {60 vars in 1132 bytes} [Mon Jul 18 16:29:37 2022] POST /identity/v3/users => generated 286 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:29:40.241202 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46e014-38b3-4c06-9828-25f4ca661bbe None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:40.241772 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46e014-38b3-4c06-9828-25f4ca661bbe None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:40.241772 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46e014-38b3-4c06-9828-25f4ca661bbe None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:40.243940 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 567/1139] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:29:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:29:40.249391 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee94e4-3038-4a0f-8340-6ba6a0cf82cb None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:40.249819 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee94e4-3038-4a0f-8340-6ba6a0cf82cb None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:40.249919 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee94e4-3038-4a0f-8340-6ba6a0cf82cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:40.276505 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-1bee94e4-3038-4a0f-8340-6ba6a0cf82cb None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:40.277736 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-1bee94e4-3038-4a0f-8340-6ba6a0cf82cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:40.355878 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 573/1140] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:29:40.378749 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a46e014-38b3-4c06-9828-25f4ca661bbe None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:40.480305 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a46e014-38b3-4c06-9828-25f4ca661bbe None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:40.515754 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53141352-3c95-4fbd-bd30-5cc0206e8431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:40.516470 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53141352-3c95-4fbd-bd30-5cc0206e8431 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:40.516960 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53141352-3c95-4fbd-bd30-5cc0206e8431 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:40.517318 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53141352-3c95-4fbd-bd30-5cc0206e8431 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:40.528828 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53141352-3c95-4fbd-bd30-5cc0206e8431 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:29:40.537205 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-53141352-3c95-4fbd-bd30-5cc0206e8431 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:29:40.537205 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:40.537205 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:40.537205 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:40.537205 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:40.537205 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:40.537205 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:40.537205 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:40.537205 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:40.537205 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:40.537205 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:40.537205 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:40.537205 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:29:40.537205 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:29:40.537205 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:29:40.537205 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:29:40.538433 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:29:40.538433 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:29:40.538433 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:29:40.538433 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:29:40.538433 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:40.538433 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:40.538433 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:40.538433 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:40.538433 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:40.538433 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:40.538433 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:40.538433 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:40.538433 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:40.538433 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:40.538433 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:40.538433 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:40.539985 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:40.539985 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:40.539985 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:40.539985 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:40.539985 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:29:40.539985 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:29:40.539985 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:29:40.539985 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:29:40.539985 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:29:40.539985 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:29:40.539985 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:29:40.539985 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:29:40.539985 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 568/1141] 10.222.0.81 () {56 vars in 1096 bytes} [Mon Jul 18 16:29:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:40.545334 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bee94e4-3038-4a0f-8340-6ba6a0cf82cb None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:40.574863 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:40.649917 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bee94e4-3038-4a0f-8340-6ba6a0cf82cb None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:40.684509 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0ad918-af8b-4d71-8f21-75388d4a4ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:40.685174 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ad918-af8b-4d71-8f21-75388d4a4ae9 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:40.685458 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ad918-af8b-4d71-8f21-75388d4a4ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:40.685733 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ad918-af8b-4d71-8f21-75388d4a4ae9 None admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:40.686473 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0ad918-af8b-4d71-8f21-75388d4a4ae9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:40.686783 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0ad918-af8b-4d71-8f21-75388d4a4ae9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:40.688191 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0ad918-af8b-4d71-8f21-75388d4a4ae9 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:40.696729 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 574/1142] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Jul 18 16:29:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:40.702531 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53141352-3c95-4fbd-bd30-5cc0206e8431 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:40.718103 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:40.801662 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53141352-3c95-4fbd-bd30-5cc0206e8431 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:40.835024 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe24bf9-0899-439b-8976-70f3821366e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:40.835916 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe24bf9-0899-439b-8976-70f3821366e9 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:40.836763 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe24bf9-0899-439b-8976-70f3821366e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:40.837044 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe24bf9-0899-439b-8976-70f3821366e9 None admin] PATH_INFO: `/v3/users/d74c1c2208ab4f3b8e39319ddd48a94b` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:40.849930 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe24bf9-0899-439b-8976-70f3821366e9 None admin] RBAC: Authorizing `identity:get_user(user_id=d74c1c2208ab4f3b8e39319ddd48a94b)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:40.851367 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe24bf9-0899-439b-8976-70f3821366e9 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:40.853596 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 569/1143] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Jul 18 16:29:40 2022] GET /identity/v3/users/d74c1c2208ab4f3b8e39319ddd48a94b => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:40.859423 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0ad918-af8b-4d71-8f21-75388d4a4ae9 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:40.943936 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:40.959149 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0ad918-af8b-4d71-8f21-75388d4a4ae9 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:40.992147 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62596b1-4274-4d00-a67d-a37ae86693a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:40.992812 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62596b1-4274-4d00-a67d-a37ae86693a0 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:40.993088 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62596b1-4274-4d00-a67d-a37ae86693a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:40.993357 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62596b1-4274-4d00-a67d-a37ae86693a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:41.057727 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62596b1-4274-4d00-a67d-a37ae86693a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:41.059100 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62596b1-4274-4d00-a67d-a37ae86693a0 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:41.138526 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:41.154689 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 575/1144] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Jul 18 16:29:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 16:29:41.160948 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe24bf9-0899-439b-8976-70f3821366e9 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:41.230925 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:41.262084 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe24bf9-0899-439b-8976-70f3821366e9 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:41.295658 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a1c7f-b686-43d2-966c-794412a4b252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:41.296615 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a1c7f-b686-43d2-966c-794412a4b252 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:41.296894 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a1c7f-b686-43d2-966c-794412a4b252 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:41.297166 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a1c7f-b686-43d2-966c-794412a4b252 None admin] PATH_INFO: `/v3/projects/630d7d8a43f84be0a0f38bf6fb9a2a66` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:41.298324 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705a1c7f-b686-43d2-966c-794412a4b252 None admin] RBAC: Authorizing `identity:get_project(project_id=630d7d8a43f84be0a0f38bf6fb9a2a66)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:41.299775 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705a1c7f-b686-43d2-966c-794412a4b252 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:41.301453 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 570/1145] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Jul 18 16:29:41 2022] GET /identity/v3/projects/630d7d8a43f84be0a0f38bf6fb9a2a66 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:41.308326 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62596b1-4274-4d00-a67d-a37ae86693a0 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:41.405109 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62596b1-4274-4d00-a67d-a37ae86693a0 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:41.438362 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a4a275-3145-45ad-8fdc-83f83da257fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:41.439010 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4a275-3145-45ad-8fdc-83f83da257fa None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:41.439292 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4a275-3145-45ad-8fdc-83f83da257fa None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:41.439685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4a275-3145-45ad-8fdc-83f83da257fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:41.442622 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a4a275-3145-45ad-8fdc-83f83da257fa None admin] RBAC: Adding query filter params (role.id=fd83eab44cb343a2b532ce32a2ac31d8, scope.project.id=630d7d8a43f84be0a0f38bf6fb9a2a66, user.id=d74c1c2208ab4f3b8e39319ddd48a94b) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:41.442940 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a4a275-3145-45ad-8fdc-83f83da257fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:41.445469 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a4a275-3145-45ad-8fdc-83f83da257fa None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:41.464051 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 576/1146] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Jul 18 16:29:41 2022] GET /identity/v3/role_assignments?user.id=d74c1c2208ab4f3b8e39319ddd48a94b&scope.project.id=630d7d8a43f84be0a0f38bf6fb9a2a66&role.id=fd83eab44cb343a2b532ce32a2ac31d8 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:43.447031 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2d7c2-8cda-4823-8a72-17ff3a190c24 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:43.447589 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2d7c2-8cda-4823-8a72-17ff3a190c24 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:43.447589 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2d7c2-8cda-4823-8a72-17ff3a190c24 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:43.448992 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 571/1147] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:29:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:29:43.454220 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f63cb-4329-445c-95c2-abfe79a2ec26 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:43.454622 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f63cb-4329-445c-95c2-abfe79a2ec26 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:43.454770 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f63cb-4329-445c-95c2-abfe79a2ec26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:43.472402 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-ad1f63cb-4329-445c-95c2-abfe79a2ec26 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:43.473594 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-ad1f63cb-4329-445c-95c2-abfe79a2ec26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:43.516392 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:43.539237 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 577/1148] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:29:43.561543 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2d7c2-8cda-4823-8a72-17ff3a190c24 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:43.681857 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2d7c2-8cda-4823-8a72-17ff3a190c24 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:43.715985 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d2c1c8-e182-4006-b586-f9c7685d3f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:43.716707 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2c1c8-e182-4006-b586-f9c7685d3f37 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:43.716985 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2c1c8-e182-4006-b586-f9c7685d3f37 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:43.717250 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2c1c8-e182-4006-b586-f9c7685d3f37 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:43.723928 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:43.727623 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d2c1c8-e182-4006-b586-f9c7685d3f37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:29:43.735186 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-25d2c1c8-e182-4006-b586-f9c7685d3f37 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:29:43.735186 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:43.735186 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:43.735186 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:43.735186 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:43.735186 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:43.735186 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:43.735186 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:43.735186 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:43.735186 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:43.735186 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:43.735186 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:43.735186 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:29:43.735186 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:29:43.735186 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:29:43.735186 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:29:43.739651 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:29:43.739651 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:29:43.739651 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:29:43.739651 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:29:43.739651 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:43.739651 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:43.739651 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:43.739651 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:43.739651 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:43.739651 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:43.739651 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:43.739651 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:43.739651 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:43.739651 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:43.739651 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:43.739651 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:43.740729 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:43.740729 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:43.740729 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:43.740729 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:43.740729 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:29:43.740729 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:29:43.740729 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:29:43.740729 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:29:43.740729 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:29:43.740729 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:29:43.740729 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:29:43.740729 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:29:43.740729 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 572/1149] 10.222.0.81 () {56 vars in 1096 bytes} [Mon Jul 18 16:29:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:43.743069 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1f63cb-4329-445c-95c2-abfe79a2ec26 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:43.838174 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1f63cb-4329-445c-95c2-abfe79a2ec26 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:43.870776 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c165b72-16db-4a76-a8e7-2e1c5b0a4cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:43.871428 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c165b72-16db-4a76-a8e7-2e1c5b0a4cf7 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:43.871706 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c165b72-16db-4a76-a8e7-2e1c5b0a4cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:43.872006 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c165b72-16db-4a76-a8e7-2e1c5b0a4cf7 None admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:43.872733 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c165b72-16db-4a76-a8e7-2e1c5b0a4cf7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:43.873033 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c165b72-16db-4a76-a8e7-2e1c5b0a4cf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:43.874381 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c165b72-16db-4a76-a8e7-2e1c5b0a4cf7 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:43.882457 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 578/1150] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Jul 18 16:29:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:43.888801 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d2c1c8-e182-4006-b586-f9c7685d3f37 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:43.988772 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d2c1c8-e182-4006-b586-f9c7685d3f37 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:44.024760 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966a2781-5475-4540-8e03-9ea5531fd8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:44.025633 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a2781-5475-4540-8e03-9ea5531fd8db None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:44.025916 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a2781-5475-4540-8e03-9ea5531fd8db None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:44.026191 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a2781-5475-4540-8e03-9ea5531fd8db None admin] PATH_INFO: `/v3/users/d74c1c2208ab4f3b8e39319ddd48a94b` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:44.027386 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966a2781-5475-4540-8e03-9ea5531fd8db None admin] RBAC: Authorizing `identity:get_user(user_id=d74c1c2208ab4f3b8e39319ddd48a94b)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:44.028854 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966a2781-5475-4540-8e03-9ea5531fd8db None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:44.030493 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 573/1151] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Jul 18 16:29:43 2022] GET /identity/v3/users/d74c1c2208ab4f3b8e39319ddd48a94b => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:44.036325 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c165b72-16db-4a76-a8e7-2e1c5b0a4cf7 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:44.079512 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:44.139440 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c165b72-16db-4a76-a8e7-2e1c5b0a4cf7 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:44.173267 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc139e86-4ed5-491c-a480-e6f29db9a59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:44.174113 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc139e86-4ed5-491c-a480-e6f29db9a59c None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:44.174399 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc139e86-4ed5-491c-a480-e6f29db9a59c None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:44.174667 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc139e86-4ed5-491c-a480-e6f29db9a59c None admin] PATH_INFO: `/v3/projects/630d7d8a43f84be0a0f38bf6fb9a2a66` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:44.175880 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc139e86-4ed5-491c-a480-e6f29db9a59c None admin] RBAC: Authorizing `identity:get_project(project_id=630d7d8a43f84be0a0f38bf6fb9a2a66)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:44.177318 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc139e86-4ed5-491c-a480-e6f29db9a59c None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:44.179010 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 579/1152] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Jul 18 16:29:44 2022] GET /identity/v3/projects/630d7d8a43f84be0a0f38bf6fb9a2a66 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:44.185232 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966a2781-5475-4540-8e03-9ea5531fd8db None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:44.248941 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:44.282640 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966a2781-5475-4540-8e03-9ea5531fd8db None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:44.317168 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb21fcc-2fba-4423-8034-18af19f8e71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:44.318071 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb21fcc-2fba-4423-8034-18af19f8e71f None admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:44.318383 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb21fcc-2fba-4423-8034-18af19f8e71f None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:44.318658 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb21fcc-2fba-4423-8034-18af19f8e71f None admin] PATH_INFO: `/v3/projects/630d7d8a43f84be0a0f38bf6fb9a2a66/users/d74c1c2208ab4f3b8e39319ddd48a94b/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:44.320650 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb21fcc-2fba-4423-8034-18af19f8e71f None admin] RBAC: Authorizing `identity:create_grant(project_id=630d7d8a43f84be0a0f38bf6fb9a2a66, user_id=d74c1c2208ab4f3b8e39319ddd48a94b, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:44.322092 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb21fcc-2fba-4423-8034-18af19f8e71f None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:44.425530 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 574/1153] 10.222.0.81 () {58 vars in 1439 bytes} [Mon Jul 18 16:29:44 2022] PUT /identity/v3/projects/630d7d8a43f84be0a0f38bf6fb9a2a66/users/d74c1c2208ab4f3b8e39319ddd48a94b/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:29:46.523459 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007270b9-dc37-457e-827d-8a1ef2bc092f None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:46.524010 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007270b9-dc37-457e-827d-8a1ef2bc092f None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:46.524134 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007270b9-dc37-457e-827d-8a1ef2bc092f None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:46.525412 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 580/1154] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:29:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:29:46.530684 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78416f40-9827-4c82-bade-09760dab5dda None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:46.531122 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78416f40-9827-4c82-bade-09760dab5dda None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:46.531230 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78416f40-9827-4c82-bade-09760dab5dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:46.548097 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-78416f40-9827-4c82-bade-09760dab5dda None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:46.549276 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-78416f40-9827-4c82-bade-09760dab5dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:46.613325 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 575/1155] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:29:46.636939 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007270b9-dc37-457e-827d-8a1ef2bc092f None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:46.735062 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007270b9-dc37-457e-827d-8a1ef2bc092f None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:46.744563 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:46.768583 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1b8111-56ee-4f0c-a39b-b03c57a00577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:46.769386 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1b8111-56ee-4f0c-a39b-b03c57a00577 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:46.769678 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1b8111-56ee-4f0c-a39b-b03c57a00577 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:46.769945 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1b8111-56ee-4f0c-a39b-b03c57a00577 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:46.780777 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1b8111-56ee-4f0c-a39b-b03c57a00577 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:29:46.788925 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-8b1b8111-56ee-4f0c-a39b-b03c57a00577 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:29:46.788925 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:46.788925 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:46.788925 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:46.788925 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:46.788925 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:46.788925 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:46.788925 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:46.788925 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:46.788925 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:46.788925 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:46.788925 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:46.788925 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:29:46.788925 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:29:46.788925 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:29:46.788925 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:29:46.790848 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:29:46.790848 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:29:46.790848 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:29:46.790848 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:29:46.790848 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:46.790848 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:46.790848 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:46.790848 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:46.790848 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:46.790848 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:46.790848 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:46.790848 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:46.790848 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:46.790848 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:46.790848 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:46.790848 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:46.793268 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:46.793268 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:46.793268 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:46.793268 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:46.793268 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:29:46.793268 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:29:46.793268 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:29:46.793268 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:29:46.793268 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:29:46.793268 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:29:46.793268 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:29:46.793268 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:29:46.793268 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 581/1156] 10.222.0.81 () {56 vars in 1096 bytes} [Mon Jul 18 16:29:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:46.796913 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78416f40-9827-4c82-bade-09760dab5dda None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:46.851132 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:46.893741 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78416f40-9827-4c82-bade-09760dab5dda None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:46.927321 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f72854-53d0-44c4-b1e6-3bbb6c31fdaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:46.927998 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f72854-53d0-44c4-b1e6-3bbb6c31fdaf None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:46.928276 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f72854-53d0-44c4-b1e6-3bbb6c31fdaf None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:46.928545 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f72854-53d0-44c4-b1e6-3bbb6c31fdaf None admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:46.929281 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f72854-53d0-44c4-b1e6-3bbb6c31fdaf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:46.929622 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f72854-53d0-44c4-b1e6-3bbb6c31fdaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:46.930975 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f72854-53d0-44c4-b1e6-3bbb6c31fdaf None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:46.939063 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 576/1157] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Jul 18 16:29:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:46.944981 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1b8111-56ee-4f0c-a39b-b03c57a00577 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:47.045127 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1b8111-56ee-4f0c-a39b-b03c57a00577 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:47.079412 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3079dedc-7505-422d-8696-60eea2868389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:47.080308 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3079dedc-7505-422d-8696-60eea2868389 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:47.080586 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3079dedc-7505-422d-8696-60eea2868389 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:47.080856 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3079dedc-7505-422d-8696-60eea2868389 None admin] PATH_INFO: `/v3/users/d74c1c2208ab4f3b8e39319ddd48a94b` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:47.082069 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3079dedc-7505-422d-8696-60eea2868389 None admin] RBAC: Authorizing `identity:get_user(user_id=d74c1c2208ab4f3b8e39319ddd48a94b)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:47.083568 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3079dedc-7505-422d-8696-60eea2868389 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:47.085224 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 582/1158] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Jul 18 16:29:46 2022] GET /identity/v3/users/d74c1c2208ab4f3b8e39319ddd48a94b => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:47.091687 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f72854-53d0-44c4-b1e6-3bbb6c31fdaf None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:47.191202 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f72854-53d0-44c4-b1e6-3bbb6c31fdaf None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:47.208784 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:47.225513 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee414a7-eb9e-49ba-8855-913e42309da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:47.226174 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee414a7-eb9e-49ba-8855-913e42309da9 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:47.226476 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee414a7-eb9e-49ba-8855-913e42309da9 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:47.226752 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee414a7-eb9e-49ba-8855-913e42309da9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:47.292748 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee414a7-eb9e-49ba-8855-913e42309da9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:47.294239 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee414a7-eb9e-49ba-8855-913e42309da9 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:47.388853 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 577/1159] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Jul 18 16:29:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 16:29:47.394863 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3079dedc-7505-422d-8696-60eea2868389 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:47.429167 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:47.494041 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3079dedc-7505-422d-8696-60eea2868389 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:47.527250 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e91c2c-15bf-4fb3-bb68-9749e3c5f4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:47.528144 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e91c2c-15bf-4fb3-bb68-9749e3c5f4a9 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:47.528422 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e91c2c-15bf-4fb3-bb68-9749e3c5f4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:47.528697 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e91c2c-15bf-4fb3-bb68-9749e3c5f4a9 None admin] PATH_INFO: `/v3/projects/630d7d8a43f84be0a0f38bf6fb9a2a66` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:47.529867 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e91c2c-15bf-4fb3-bb68-9749e3c5f4a9 None admin] RBAC: Authorizing `identity:get_project(project_id=630d7d8a43f84be0a0f38bf6fb9a2a66)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:47.531290 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e91c2c-15bf-4fb3-bb68-9749e3c5f4a9 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:47.533028 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 583/1160] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Jul 18 16:29:47 2022] GET /identity/v3/projects/630d7d8a43f84be0a0f38bf6fb9a2a66 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:47.540182 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee414a7-eb9e-49ba-8855-913e42309da9 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:47.558534 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:47.640838 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee414a7-eb9e-49ba-8855-913e42309da9 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:47.673139 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8ef5a9-3699-4655-9505-41c249d4f8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:47.673778 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ef5a9-3699-4655-9505-41c249d4f8d3 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:47.674054 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ef5a9-3699-4655-9505-41c249d4f8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:47.674323 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ef5a9-3699-4655-9505-41c249d4f8d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:47.675131 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8ef5a9-3699-4655-9505-41c249d4f8d3 None admin] RBAC: Adding query filter params (role.id=fd83eab44cb343a2b532ce32a2ac31d8, scope.project.id=630d7d8a43f84be0a0f38bf6fb9a2a66, user.id=d74c1c2208ab4f3b8e39319ddd48a94b) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:47.675434 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8ef5a9-3699-4655-9505-41c249d4f8d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:47.676884 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8ef5a9-3699-4655-9505-41c249d4f8d3 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:47.683044 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 578/1161] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Jul 18 16:29:47 2022] GET /identity/v3/role_assignments?user.id=d74c1c2208ab4f3b8e39319ddd48a94b&scope.project.id=630d7d8a43f84be0a0f38bf6fb9a2a66&role.id=fd83eab44cb343a2b532ce32a2ac31d8 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:49.713058 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586a330-041a-482f-93bf-82eacfe2a56d None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:49.713634 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586a330-041a-482f-93bf-82eacfe2a56d None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:49.713634 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586a330-041a-482f-93bf-82eacfe2a56d None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:49.714968 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 584/1162] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:29:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:29:49.720246 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe25e23-46be-47e6-95c0-3dc93e80cb7a None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:49.720664 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe25e23-46be-47e6-95c0-3dc93e80cb7a None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:49.720776 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe25e23-46be-47e6-95c0-3dc93e80cb7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:49.737010 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-0fe25e23-46be-47e6-95c0-3dc93e80cb7a None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:49.738186 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-0fe25e23-46be-47e6-95c0-3dc93e80cb7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:49.803148 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 579/1163] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:29:49.825763 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f586a330-041a-482f-93bf-82eacfe2a56d None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:49.924999 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f586a330-041a-482f-93bf-82eacfe2a56d None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:49.927289 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:49.957256 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f67deaf-de45-4895-922d-f50e8308ae46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:49.957894 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67deaf-de45-4895-922d-f50e8308ae46 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:49.958179 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67deaf-de45-4895-922d-f50e8308ae46 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:49.958452 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67deaf-de45-4895-922d-f50e8308ae46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:50.025520 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f67deaf-de45-4895-922d-f50e8308ae46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:50.026952 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f67deaf-de45-4895-922d-f50e8308ae46 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:50.123620 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 585/1164] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Jul 18 16:29:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 16:29:50.129654 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe25e23-46be-47e6-95c0-3dc93e80cb7a None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:50.144723 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:50.230305 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe25e23-46be-47e6-95c0-3dc93e80cb7a None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:50.263911 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ef6ef-1ba7-4894-a934-8ea5a06f4d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:50.264698 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ef6ef-1ba7-4894-a934-8ea5a06f4d47 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:50.264982 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ef6ef-1ba7-4894-a934-8ea5a06f4d47 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:50.265257 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ef6ef-1ba7-4894-a934-8ea5a06f4d47 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:50.271810 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690ef6ef-1ba7-4894-a934-8ea5a06f4d47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:50.273267 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690ef6ef-1ba7-4894-a934-8ea5a06f4d47 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:50.287259 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-690ef6ef-1ba7-4894-a934-8ea5a06f4d47 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 18 16:29:50.287259 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:50.287259 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 18 16:29:50.287259 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 18 16:29:50.287259 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:29:50.287259 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:29:50.287259 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:29:50.287259 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:29:50.287259 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 18 16:29:50.287259 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:29:50.287259 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 16:29:50.287259 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:29:50.287259 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:50.287259 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:50.287259 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:50.287259 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:50.287259 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:50.288519 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:50.288519 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:50.288519 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:50.288519 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:50.288519 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:50.288519 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:50.288519 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:29:50.288519 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:29:50.288519 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:29:50.288519 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:29:50.288519 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:50.288519 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:50.288519 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:50.288519 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:50.288519 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:50.288519 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:50.290269 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:50.290269 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:50.290269 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:50.290269 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:50.290269 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:50.290269 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:50.290269 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:50.290269 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:50.290269 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:50.290269 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:50.290269 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 18 16:29:50.290269 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:29:50.290269 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 18 16:29:50.290269 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:29:50.290269 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 580/1165] 10.222.0.81 () {56 vars in 1117 bytes} [Mon Jul 18 16:29:50 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:29:50.295288 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f67deaf-de45-4895-922d-f50e8308ae46 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:50.298405 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:50.392172 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f67deaf-de45-4895-922d-f50e8308ae46 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:50.424545 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e27bafb-716a-4f18-9622-6c577685b7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:50.425199 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27bafb-716a-4f18-9622-6c577685b7b5 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:50.425482 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27bafb-716a-4f18-9622-6c577685b7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:50.425760 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27bafb-716a-4f18-9622-6c577685b7b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:50.426467 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e27bafb-716a-4f18-9622-6c577685b7b5 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:50.426771 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e27bafb-716a-4f18-9622-6c577685b7b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:50.428155 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e27bafb-716a-4f18-9622-6c577685b7b5 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:50.435809 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 586/1166] 10.222.0.81 () {56 vars in 1115 bytes} [Mon Jul 18 16:29:50 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:52.417483 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d917691-6e3f-4c4c-8d5e-cb19a9d2c6c8 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:52.418031 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d917691-6e3f-4c4c-8d5e-cb19a9d2c6c8 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:52.418031 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d917691-6e3f-4c4c-8d5e-cb19a9d2c6c8 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:52.419387 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 581/1167] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:29:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:29:52.424739 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a7633-9a29-4be6-9a28-2b698cd3b6a5 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:52.425210 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a7633-9a29-4be6-9a28-2b698cd3b6a5 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:52.425303 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a7633-9a29-4be6-9a28-2b698cd3b6a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:52.442546 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-d17a7633-9a29-4be6-9a28-2b698cd3b6a5 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:52.443768 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-d17a7633-9a29-4be6-9a28-2b698cd3b6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:52.507112 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:52.512636 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 587/1168] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:29:52.534896 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d917691-6e3f-4c4c-8d5e-cb19a9d2c6c8 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:52.609757 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:52.640888 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d917691-6e3f-4c4c-8d5e-cb19a9d2c6c8 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:52.674547 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2221b955-0f48-41b1-a78a-54af9abce78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:52.675120 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221b955-0f48-41b1-a78a-54af9abce78c None admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:52.675403 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221b955-0f48-41b1-a78a-54af9abce78c None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:52.675676 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221b955-0f48-41b1-a78a-54af9abce78c None admin] PATH_INFO: `/v3/domains` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:52.676497 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2221b955-0f48-41b1-a78a-54af9abce78c None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:52.677868 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2221b955-0f48-41b1-a78a-54af9abce78c None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:52.748400 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 582/1169] 10.222.0.81 () {60 vars in 1138 bytes} [Mon Jul 18 16:29:52 2022] POST /identity/v3/domains => generated 267 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:29:54.785045 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bf3b7-9861-42ed-b37f-a2259241d910 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:54.785608 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bf3b7-9861-42ed-b37f-a2259241d910 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:54.785608 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bf3b7-9861-42ed-b37f-a2259241d910 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:54.786973 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 588/1170] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:29:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:29:54.792880 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75eb8f-d7d1-44bf-9461-e1fcafb447dc None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:54.793334 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75eb8f-d7d1-44bf-9461-e1fcafb447dc None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:54.793428 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75eb8f-d7d1-44bf-9461-e1fcafb447dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:54.811117 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-9a75eb8f-d7d1-44bf-9461-e1fcafb447dc None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:54.812327 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-9a75eb8f-d7d1-44bf-9461-e1fcafb447dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:54.881340 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 583/1171] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:29:54.905042 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0bf3b7-9861-42ed-b37f-a2259241d910 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:55.008419 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0bf3b7-9861-42ed-b37f-a2259241d910 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:55.043192 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c93864-79b1-4625-8a5e-70fefccab556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:55.043992 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c93864-79b1-4625-8a5e-70fefccab556 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:55.044269 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c93864-79b1-4625-8a5e-70fefccab556 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:55.044535 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c93864-79b1-4625-8a5e-70fefccab556 None admin] PATH_INFO: `/v3/domains/6e89f55f735f43d88de812637bac00ec` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:55.054656 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c93864-79b1-4625-8a5e-70fefccab556 None admin] RBAC: Authorizing `identity:get_domain(domain_id=6e89f55f735f43d88de812637bac00ec)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:55.056122 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c93864-79b1-4625-8a5e-70fefccab556 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:55.057802 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 589/1172] 10.222.0.81 () {56 vars in 1183 bytes} [Mon Jul 18 16:29:54 2022] GET /identity/v3/domains/6e89f55f735f43d88de812637bac00ec => generated 267 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:55.064490 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a75eb8f-d7d1-44bf-9461-e1fcafb447dc None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:55.125183 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:55.168736 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a75eb8f-d7d1-44bf-9461-e1fcafb447dc None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:55.205330 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6622b692-3aa6-412b-91e5-55a12f3e6513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:55.205986 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6622b692-3aa6-412b-91e5-55a12f3e6513 None admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:55.206264 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6622b692-3aa6-412b-91e5-55a12f3e6513 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:55.206534 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6622b692-3aa6-412b-91e5-55a12f3e6513 None admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:55.207325 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6622b692-3aa6-412b-91e5-55a12f3e6513 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:55.208775 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6622b692-3aa6-412b-91e5-55a12f3e6513 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:55.405257 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 584/1173] 10.222.0.81 () {60 vars in 1141 bytes} [Mon Jul 18 16:29:55 2022] POST /identity/v3/projects => generated 361 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:29:57.483643 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb40fd-7d4b-456c-9ba1-c280934989fe None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:57.484145 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb40fd-7d4b-456c-9ba1-c280934989fe None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:57.484239 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb40fd-7d4b-456c-9ba1-c280934989fe None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:57.485593 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 590/1174] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:29:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:29:57.490952 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc7a7c-607d-4f3c-a470-fda4541ad53b None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:57.491342 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc7a7c-607d-4f3c-a470-fda4541ad53b None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:57.491503 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc7a7c-607d-4f3c-a470-fda4541ad53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:57.507923 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-f2bc7a7c-607d-4f3c-a470-fda4541ad53b None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:57.509093 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-f2bc7a7c-607d-4f3c-a470-fda4541ad53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:57.571818 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 585/1175] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:29:57.596213 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eb40fd-7d4b-456c-9ba1-c280934989fe None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:57.655851 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:57.697435 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eb40fd-7d4b-456c-9ba1-c280934989fe None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:57.730356 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385c4619-8c82-4a64-a969-2ee7a0f7caf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:57.731209 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c4619-8c82-4a64-a969-2ee7a0f7caf9 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:57.731492 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c4619-8c82-4a64-a969-2ee7a0f7caf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:57.731797 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c4619-8c82-4a64-a969-2ee7a0f7caf9 None admin] PATH_INFO: `/v3/domains/6e89f55f735f43d88de812637bac00ec` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:57.732967 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385c4619-8c82-4a64-a969-2ee7a0f7caf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=6e89f55f735f43d88de812637bac00ec)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:57.734390 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385c4619-8c82-4a64-a969-2ee7a0f7caf9 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:57.736044 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 591/1176] 10.222.0.81 () {56 vars in 1183 bytes} [Mon Jul 18 16:29:57 2022] GET /identity/v3/domains/6e89f55f735f43d88de812637bac00ec => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:57.742569 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc7a7c-607d-4f3c-a470-fda4541ad53b None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:57.785928 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:57.841624 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc7a7c-607d-4f3c-a470-fda4541ad53b None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:57.873734 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b7b678-b298-46cf-b667-51dddd51c384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:57.874386 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7b678-b298-46cf-b667-51dddd51c384 None admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:57.874665 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7b678-b298-46cf-b667-51dddd51c384 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:57.875012 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7b678-b298-46cf-b667-51dddd51c384 None admin] PATH_INFO: `/v3/users` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:57.875747 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b7b678-b298-46cf-b667-51dddd51c384 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:57.877150 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b7b678-b298-46cf-b667-51dddd51c384 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:57.957129 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 586/1177] 10.222.0.81 () {60 vars in 1132 bytes} [Mon Jul 18 16:29:57 2022] POST /identity/v3/users => generated 311 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:30:00.027477 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f233cff-1ebd-46fe-9702-1628903761be None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:00.028041 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f233cff-1ebd-46fe-9702-1628903761be None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:00.028041 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f233cff-1ebd-46fe-9702-1628903761be None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:00.029433 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 592/1178] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:30:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:30:00.034686 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc30b7f-fe70-4b2a-9c2c-60fe427f287b None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:00.035093 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc30b7f-fe70-4b2a-9c2c-60fe427f287b None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:00.035240 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc30b7f-fe70-4b2a-9c2c-60fe427f287b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:00.052810 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-8bc30b7f-fe70-4b2a-9c2c-60fe427f287b None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:30:00.054622 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-8bc30b7f-fe70-4b2a-9c2c-60fe427f287b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:30:00.136164 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 587/1179] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:30:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:30:00.159305 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f233cff-1ebd-46fe-9702-1628903761be None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:00.260751 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f233cff-1ebd-46fe-9702-1628903761be None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:00.285980 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:00.295013 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14568bd8-8be4-454e-a3eb-8e7d7bed7f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:00.295829 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14568bd8-8be4-454e-a3eb-8e7d7bed7f36 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:00.296147 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14568bd8-8be4-454e-a3eb-8e7d7bed7f36 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:00.311406 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14568bd8-8be4-454e-a3eb-8e7d7bed7f36 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:00.311406 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14568bd8-8be4-454e-a3eb-8e7d7bed7f36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:30:00.314071 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-14568bd8-8be4-454e-a3eb-8e7d7bed7f36 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:30:00.314071 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:00.314071 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:00.314071 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:00.314071 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:00.314071 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:00.314071 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:00.314071 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:00.314071 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:00.314071 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:00.314071 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:00.314071 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:00.314071 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:30:00.314071 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:30:00.314071 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:30:00.314071 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:30:00.315210 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:30:00.315210 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:30:00.315210 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:30:00.315210 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:30:00.315210 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:00.315210 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:00.315210 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:00.315210 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:00.315210 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:00.315210 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:00.315210 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:00.315210 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:00.315210 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:00.315210 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:00.315210 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:00.315210 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:00.316173 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:00.316173 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:00.316173 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:00.316173 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:00.316173 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:30:00.316173 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:30:00.316173 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:30:00.316173 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:30:00.316173 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:30:00.316173 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:30:00.316173 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:30:00.316173 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:30:00.316173 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 593/1180] 10.222.0.81 () {56 vars in 1096 bytes} [Mon Jul 18 16:30:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:30:00.321489 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc30b7f-fe70-4b2a-9c2c-60fe427f287b None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:00.350481 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:00.418375 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc30b7f-fe70-4b2a-9c2c-60fe427f287b None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:00.450545 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b24b59c-3417-4d45-af8b-6f649444cc11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:00.451199 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b24b59c-3417-4d45-af8b-6f649444cc11 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:00.451484 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b24b59c-3417-4d45-af8b-6f649444cc11 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:00.451790 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b24b59c-3417-4d45-af8b-6f649444cc11 None admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:00.452534 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b24b59c-3417-4d45-af8b-6f649444cc11 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:00.452837 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b24b59c-3417-4d45-af8b-6f649444cc11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:00.454197 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b24b59c-3417-4d45-af8b-6f649444cc11 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:00.462834 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 588/1181] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Jul 18 16:30:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:00.468698 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14568bd8-8be4-454e-a3eb-8e7d7bed7f36 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:00.576006 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14568bd8-8be4-454e-a3eb-8e7d7bed7f36 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:00.608893 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a696d7f2-ae14-4cba-a2e4-0bf73cfc93b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:00.609761 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a696d7f2-ae14-4cba-a2e4-0bf73cfc93b8 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:00.610043 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a696d7f2-ae14-4cba-a2e4-0bf73cfc93b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:00.610319 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a696d7f2-ae14-4cba-a2e4-0bf73cfc93b8 None admin] PATH_INFO: `/v3/users/2abc520cd0ae4e989262cfa460056e15` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:00.623495 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a696d7f2-ae14-4cba-a2e4-0bf73cfc93b8 None admin] RBAC: Authorizing `identity:get_user(user_id=2abc520cd0ae4e989262cfa460056e15)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:00.625049 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a696d7f2-ae14-4cba-a2e4-0bf73cfc93b8 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:00.626712 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 594/1182] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Jul 18 16:30:00 2022] GET /identity/v3/users/2abc520cd0ae4e989262cfa460056e15 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:00.633458 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b24b59c-3417-4d45-af8b-6f649444cc11 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:00.721732 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:00.730192 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b24b59c-3417-4d45-af8b-6f649444cc11 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:00.762997 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e403585b-8e12-4347-ba95-edbdf1af5cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:00.763966 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e403585b-8e12-4347-ba95-edbdf1af5cfc None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:00.764543 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e403585b-8e12-4347-ba95-edbdf1af5cfc None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:00.764820 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e403585b-8e12-4347-ba95-edbdf1af5cfc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:00.830089 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e403585b-8e12-4347-ba95-edbdf1af5cfc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:00.831443 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e403585b-8e12-4347-ba95-edbdf1af5cfc None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:01.011594 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:01.020502 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 589/1183] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Jul 18 16:30:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 16:30:01.026422 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a696d7f2-ae14-4cba-a2e4-0bf73cfc93b8 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:01.071443 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:01.124229 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a696d7f2-ae14-4cba-a2e4-0bf73cfc93b8 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:01.157795 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f1fa1-636c-42e3-9452-2f34692943ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:01.158641 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f1fa1-636c-42e3-9452-2f34692943ac None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:01.158922 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f1fa1-636c-42e3-9452-2f34692943ac None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:01.159195 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f1fa1-636c-42e3-9452-2f34692943ac None admin] PATH_INFO: `/v3/projects/bcba57ab7c4f4583a3a4587d72983140` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:01.160366 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115f1fa1-636c-42e3-9452-2f34692943ac None admin] RBAC: Authorizing `identity:get_project(project_id=bcba57ab7c4f4583a3a4587d72983140)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:01.161782 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115f1fa1-636c-42e3-9452-2f34692943ac None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:01.163504 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 595/1184] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Jul 18 16:30:01 2022] GET /identity/v3/projects/bcba57ab7c4f4583a3a4587d72983140 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:01.169738 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e403585b-8e12-4347-ba95-edbdf1af5cfc None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:01.265634 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e403585b-8e12-4347-ba95-edbdf1af5cfc None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:01.296762 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c22be0-78f0-4ca4-9a13-396a0cbf27bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:01.297398 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c22be0-78f0-4ca4-9a13-396a0cbf27bf None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:01.297674 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c22be0-78f0-4ca4-9a13-396a0cbf27bf None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:01.297949 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c22be0-78f0-4ca4-9a13-396a0cbf27bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:01.298757 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c22be0-78f0-4ca4-9a13-396a0cbf27bf None admin] RBAC: Adding query filter params (role.id=fd83eab44cb343a2b532ce32a2ac31d8, scope.project.id=bcba57ab7c4f4583a3a4587d72983140, user.id=2abc520cd0ae4e989262cfa460056e15) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:01.299059 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c22be0-78f0-4ca4-9a13-396a0cbf27bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:01.300517 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c22be0-78f0-4ca4-9a13-396a0cbf27bf None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:01.306247 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 590/1185] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Jul 18 16:30:01 2022] GET /identity/v3/role_assignments?user.id=2abc520cd0ae4e989262cfa460056e15&scope.project.id=bcba57ab7c4f4583a3a4587d72983140&role.id=fd83eab44cb343a2b532ce32a2ac31d8 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:03.339745 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7dcd1-3538-47eb-8193-723218976f1f None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:03.340337 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7dcd1-3538-47eb-8193-723218976f1f None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:03.340337 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7dcd1-3538-47eb-8193-723218976f1f None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:03.341667 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 596/1186] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:30:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:30:03.346974 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8efe66a-f444-493b-8439-a1c2e2999bbc None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:03.347444 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8efe66a-f444-493b-8439-a1c2e2999bbc None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:03.347537 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8efe66a-f444-493b-8439-a1c2e2999bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:03.364822 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-e8efe66a-f444-493b-8439-a1c2e2999bbc None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:30:03.366541 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-e8efe66a-f444-493b-8439-a1c2e2999bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:30:03.417732 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:03.435411 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 591/1187] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:30:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:30:03.460204 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb7dcd1-3538-47eb-8193-723218976f1f None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:03.562159 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb7dcd1-3538-47eb-8193-723218976f1f None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:03.575945 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:03.597111 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f6e0e-a0f1-4a46-9f44-bfa1b682a955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:03.597832 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f6e0e-a0f1-4a46-9f44-bfa1b682a955 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:03.598114 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f6e0e-a0f1-4a46-9f44-bfa1b682a955 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:03.598386 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f6e0e-a0f1-4a46-9f44-bfa1b682a955 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:03.609435 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8f6e0e-a0f1-4a46-9f44-bfa1b682a955 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:30:03.618157 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-2b8f6e0e-a0f1-4a46-9f44-bfa1b682a955 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:30:03.618157 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:03.618157 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:03.618157 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:03.618157 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:03.618157 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:03.618157 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:03.618157 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:03.618157 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:03.618157 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:03.618157 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:03.618157 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:03.618157 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:30:03.618157 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:30:03.618157 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:30:03.618157 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:30:03.619334 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:30:03.619334 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:30:03.619334 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:30:03.619334 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:30:03.619334 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:03.619334 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:03.619334 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:03.619334 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:03.619334 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:03.619334 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:03.619334 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:03.619334 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:03.619334 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:03.619334 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:03.619334 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:03.619334 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:03.620511 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:03.620511 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:03.620511 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:03.620511 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:03.620511 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:30:03.620511 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:30:03.620511 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:30:03.620511 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:30:03.620511 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:30:03.620511 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:30:03.620511 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:30:03.620511 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:30:03.620511 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 597/1188] 10.222.0.81 () {56 vars in 1096 bytes} [Mon Jul 18 16:30:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:30:03.625760 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8efe66a-f444-493b-8439-a1c2e2999bbc None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:03.724468 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8efe66a-f444-493b-8439-a1c2e2999bbc None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:03.758352 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5757bd01-a490-46c6-94c1-cf167ab950bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:03.759016 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757bd01-a490-46c6-94c1-cf167ab950bf None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:03.759297 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757bd01-a490-46c6-94c1-cf167ab950bf None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:03.759571 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757bd01-a490-46c6-94c1-cf167ab950bf None admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:03.760340 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5757bd01-a490-46c6-94c1-cf167ab950bf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:03.760646 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5757bd01-a490-46c6-94c1-cf167ab950bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:03.762003 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5757bd01-a490-46c6-94c1-cf167ab950bf None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:03.769903 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 592/1189] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Jul 18 16:30:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:03.775768 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f6e0e-a0f1-4a46-9f44-bfa1b682a955 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:03.875973 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f6e0e-a0f1-4a46-9f44-bfa1b682a955 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:03.908758 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d0e1e7-6807-4b4f-9320-8efdd05e5756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:03.909625 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d0e1e7-6807-4b4f-9320-8efdd05e5756 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:03.909912 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d0e1e7-6807-4b4f-9320-8efdd05e5756 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:03.910186 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d0e1e7-6807-4b4f-9320-8efdd05e5756 None admin] PATH_INFO: `/v3/users/2abc520cd0ae4e989262cfa460056e15` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:03.911367 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d0e1e7-6807-4b4f-9320-8efdd05e5756 None admin] RBAC: Authorizing `identity:get_user(user_id=2abc520cd0ae4e989262cfa460056e15)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:03.913341 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d0e1e7-6807-4b4f-9320-8efdd05e5756 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:03.914980 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 598/1190] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Jul 18 16:30:03 2022] GET /identity/v3/users/2abc520cd0ae4e989262cfa460056e15 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:03.921028 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5757bd01-a490-46c6-94c1-cf167ab950bf None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:03.973237 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:04.025281 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5757bd01-a490-46c6-94c1-cf167ab950bf None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:04.057437 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe92841-1347-43d6-98cb-32ab9065f6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:04.058477 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe92841-1347-43d6-98cb-32ab9065f6b9 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:04.058761 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe92841-1347-43d6-98cb-32ab9065f6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:04.059025 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe92841-1347-43d6-98cb-32ab9065f6b9 None admin] PATH_INFO: `/v3/projects/bcba57ab7c4f4583a3a4587d72983140` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:04.060205 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe92841-1347-43d6-98cb-32ab9065f6b9 None admin] RBAC: Authorizing `identity:get_project(project_id=bcba57ab7c4f4583a3a4587d72983140)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:04.061617 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe92841-1347-43d6-98cb-32ab9065f6b9 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:04.063297 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 593/1191] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Jul 18 16:30:03 2022] GET /identity/v3/projects/bcba57ab7c4f4583a3a4587d72983140 => generated 361 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:04.069679 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d0e1e7-6807-4b4f-9320-8efdd05e5756 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:04.111935 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:04.169770 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d0e1e7-6807-4b4f-9320-8efdd05e5756 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:04.203619 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1493addd-9fec-4172-b42f-9d8fba2fa9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:04.204590 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493addd-9fec-4172-b42f-9d8fba2fa9eb None admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:04.204874 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493addd-9fec-4172-b42f-9d8fba2fa9eb None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:04.205190 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493addd-9fec-4172-b42f-9d8fba2fa9eb None admin] PATH_INFO: `/v3/projects/bcba57ab7c4f4583a3a4587d72983140/users/2abc520cd0ae4e989262cfa460056e15/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:04.207163 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1493addd-9fec-4172-b42f-9d8fba2fa9eb None admin] RBAC: Authorizing `identity:create_grant(project_id=bcba57ab7c4f4583a3a4587d72983140, user_id=2abc520cd0ae4e989262cfa460056e15, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:04.208745 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1493addd-9fec-4172-b42f-9d8fba2fa9eb None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:04.358125 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 599/1192] 10.222.0.81 () {58 vars in 1439 bytes} [Mon Jul 18 16:30:04 2022] PUT /identity/v3/projects/bcba57ab7c4f4583a3a4587d72983140/users/2abc520cd0ae4e989262cfa460056e15/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:30:06.367515 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b591b95f-9c6b-468a-a77b-c401a2564d4f None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:06.368115 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b591b95f-9c6b-468a-a77b-c401a2564d4f None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:06.368115 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b591b95f-9c6b-468a-a77b-c401a2564d4f None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:06.369458 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 594/1193] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:30:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:30:06.374630 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e3675-7a75-40aa-8afc-b1cdf7d1b93e None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:06.375006 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e3675-7a75-40aa-8afc-b1cdf7d1b93e None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:06.375182 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e3675-7a75-40aa-8afc-b1cdf7d1b93e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:06.393110 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-c28e3675-7a75-40aa-8afc-b1cdf7d1b93e None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:30:06.394307 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-c28e3675-7a75-40aa-8afc-b1cdf7d1b93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:30:06.460386 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 600/1194] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:30:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:30:06.483369 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b591b95f-9c6b-468a-a77b-c401a2564d4f None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:06.585569 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b591b95f-9c6b-468a-a77b-c401a2564d4f None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:06.604484 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:06.623546 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c859a5-913e-4f38-8b10-14eedb8663f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:06.624282 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c859a5-913e-4f38-8b10-14eedb8663f9 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:06.624560 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c859a5-913e-4f38-8b10-14eedb8663f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:06.624833 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c859a5-913e-4f38-8b10-14eedb8663f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:06.635779 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c859a5-913e-4f38-8b10-14eedb8663f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:30:06.643308 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-61c859a5-913e-4f38-8b10-14eedb8663f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:30:06.643308 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:06.643308 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:06.643308 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:06.643308 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:06.643308 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:06.643308 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:06.643308 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:06.643308 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:06.643308 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:06.643308 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:06.643308 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:06.643308 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:30:06.643308 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:30:06.643308 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:30:06.643308 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:30:06.644728 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:30:06.644728 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:30:06.644728 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:30:06.644728 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:30:06.644728 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:06.644728 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:06.644728 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:06.644728 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:06.644728 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:06.644728 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:06.644728 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:06.644728 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:06.644728 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:06.644728 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:06.644728 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:06.644728 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:06.645822 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:06.645822 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:06.645822 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:06.645822 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:06.645822 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:30:06.645822 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:30:06.645822 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:30:06.645822 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:30:06.645822 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:30:06.645822 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:30:06.645822 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:30:06.645822 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:30:06.645822 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 595/1195] 10.222.0.81 () {56 vars in 1096 bytes} [Mon Jul 18 16:30:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:30:06.651339 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e3675-7a75-40aa-8afc-b1cdf7d1b93e None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:06.680749 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:06.749128 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e3675-7a75-40aa-8afc-b1cdf7d1b93e None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:06.782655 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b2bad-8f54-451e-ba0c-1d7fc1cf15ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:06.783319 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b2bad-8f54-451e-ba0c-1d7fc1cf15ef None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:06.783606 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b2bad-8f54-451e-ba0c-1d7fc1cf15ef None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:06.783918 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b2bad-8f54-451e-ba0c-1d7fc1cf15ef None admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:06.784668 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058b2bad-8f54-451e-ba0c-1d7fc1cf15ef None admin] RBAC: Adding query filter params (name=admin) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:06.785179 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058b2bad-8f54-451e-ba0c-1d7fc1cf15ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:06.786853 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058b2bad-8f54-451e-ba0c-1d7fc1cf15ef None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:06.795353 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 601/1196] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Jul 18 16:30:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:06.801252 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c859a5-913e-4f38-8b10-14eedb8663f9 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:06.899639 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c859a5-913e-4f38-8b10-14eedb8663f9 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:06.931504 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81888f-5b26-43b3-b497-b115da55112a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:06.932383 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81888f-5b26-43b3-b497-b115da55112a None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:06.932667 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81888f-5b26-43b3-b497-b115da55112a None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:06.932943 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81888f-5b26-43b3-b497-b115da55112a None admin] PATH_INFO: `/v3/users/2abc520cd0ae4e989262cfa460056e15` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:06.934116 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e81888f-5b26-43b3-b497-b115da55112a None admin] RBAC: Authorizing `identity:get_user(user_id=2abc520cd0ae4e989262cfa460056e15)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:06.935546 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e81888f-5b26-43b3-b497-b115da55112a None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:06.937208 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 596/1197] 10.222.0.81 () {56 vars in 1177 bytes} [Mon Jul 18 16:30:06 2022] GET /identity/v3/users/2abc520cd0ae4e989262cfa460056e15 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:06.943018 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b2bad-8f54-451e-ba0c-1d7fc1cf15ef None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:07.032730 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:07.041049 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b2bad-8f54-451e-ba0c-1d7fc1cf15ef None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:07.074901 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d031a48e-d549-49bb-bc0b-9d98c135be49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:07.075541 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d031a48e-d549-49bb-bc0b-9d98c135be49 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:07.075858 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d031a48e-d549-49bb-bc0b-9d98c135be49 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:07.076132 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d031a48e-d549-49bb-bc0b-9d98c135be49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:07.142019 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d031a48e-d549-49bb-bc0b-9d98c135be49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:07.143480 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d031a48e-d549-49bb-bc0b-9d98c135be49 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:07.230040 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:07.239065 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 602/1198] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Jul 18 16:30:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 16:30:07.251100 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81888f-5b26-43b3-b497-b115da55112a None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:07.290322 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:07.345011 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81888f-5b26-43b3-b497-b115da55112a None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:07.377531 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94c6e2-52aa-46e7-81c6-d8675e3de770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:07.378382 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94c6e2-52aa-46e7-81c6-d8675e3de770 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:07.378661 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94c6e2-52aa-46e7-81c6-d8675e3de770 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:07.378934 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94c6e2-52aa-46e7-81c6-d8675e3de770 None admin] PATH_INFO: `/v3/projects/bcba57ab7c4f4583a3a4587d72983140` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:07.380107 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a94c6e2-52aa-46e7-81c6-d8675e3de770 None admin] RBAC: Authorizing `identity:get_project(project_id=bcba57ab7c4f4583a3a4587d72983140)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:07.382311 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a94c6e2-52aa-46e7-81c6-d8675e3de770 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:07.384020 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 597/1199] 10.222.0.81 () {56 vars in 1186 bytes} [Mon Jul 18 16:30:07 2022] GET /identity/v3/projects/bcba57ab7c4f4583a3a4587d72983140 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:07.390176 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d031a48e-d549-49bb-bc0b-9d98c135be49 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:07.487210 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d031a48e-d549-49bb-bc0b-9d98c135be49 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:07.521201 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb1692b-e2a3-4d48-bc57-7cac34247d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:07.521841 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb1692b-e2a3-4d48-bc57-7cac34247d39 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:07.522658 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb1692b-e2a3-4d48-bc57-7cac34247d39 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:07.522939 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb1692b-e2a3-4d48-bc57-7cac34247d39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:07.523771 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb1692b-e2a3-4d48-bc57-7cac34247d39 None admin] RBAC: Adding query filter params (role.id=fd83eab44cb343a2b532ce32a2ac31d8, scope.project.id=bcba57ab7c4f4583a3a4587d72983140, user.id=2abc520cd0ae4e989262cfa460056e15) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:07.524079 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb1692b-e2a3-4d48-bc57-7cac34247d39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:07.525494 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb1692b-e2a3-4d48-bc57-7cac34247d39 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:07.531092 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 603/1200] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Jul 18 16:30:07 2022] GET /identity/v3/role_assignments?user.id=2abc520cd0ae4e989262cfa460056e15&scope.project.id=bcba57ab7c4f4583a3a4587d72983140&role.id=fd83eab44cb343a2b532ce32a2ac31d8 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:17.373429 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=44 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:17.528536 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=72 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:29.917943 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f644cf-0e34-4b79-b2c2-b28323e708f1 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:29.918543 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f644cf-0e34-4b79-b2c2-b28323e708f1 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:29.918543 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f644cf-0e34-4b79-b2c2-b28323e708f1 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:29.919979 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 598/1201] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:31:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:31:29.925390 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97326399-8599-4b28-97b1-f6d2fb71f55e None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:29.925853 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97326399-8599-4b28-97b1-f6d2fb71f55e None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:29.925986 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97326399-8599-4b28-97b1-f6d2fb71f55e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:29.942840 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-97326399-8599-4b28-97b1-f6d2fb71f55e None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:31:29.944046 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-97326399-8599-4b28-97b1-f6d2fb71f55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:31:30.010637 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 604/1202] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:31:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:31:30.035250 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f644cf-0e34-4b79-b2c2-b28323e708f1 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:30.136160 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f644cf-0e34-4b79-b2c2-b28323e708f1 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:30.173846 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4723e347-599e-459f-9b23-b8c4ec7ee0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:30.173846 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723e347-599e-459f-9b23-b8c4ec7ee0f9 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:30.174154 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723e347-599e-459f-9b23-b8c4ec7ee0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:30.174364 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723e347-599e-459f-9b23-b8c4ec7ee0f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:30.184988 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4723e347-599e-459f-9b23-b8c4ec7ee0f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:30.186434 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4723e347-599e-459f-9b23-b8c4ec7ee0f9 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:30.204139 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-4723e347-599e-459f-9b23-b8c4ec7ee0f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:31:30.204139 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:31:30.204139 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:31:30.204139 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:31:30.204139 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:31:30.204139 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:31:30.204139 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:31:30.204139 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:31:30.204139 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:31:30.204139 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:31:30.204139 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:31:30.204139 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:31:30.204139 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:31:30.204139 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:31:30.204139 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:31:30.205302 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:31:30.205302 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:31:30.205302 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:31:30.205302 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:31:30.205302 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:31:30.205302 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:31:30.205302 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:31:30.205302 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:31:30.205302 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:31:30.205302 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:31:30.205302 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:31:30.205302 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:31:30.205302 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:31:30.205302 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:31:30.205302 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:31:30.205302 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:31:30.205302 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:31:30.206979 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:31:30.206979 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:31:30.206979 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:31:30.206979 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:31:30.206979 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 599/1203] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:31:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:31:30.212057 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97326399-8599-4b28-97b1-f6d2fb71f55e None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:30.310008 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97326399-8599-4b28-97b1-f6d2fb71f55e None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:30.337900 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:30.343486 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b269d2-4a62-4ccc-9e67-372748394281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:30.344178 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b269d2-4a62-4ccc-9e67-372748394281 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:30.344459 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b269d2-4a62-4ccc-9e67-372748394281 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:30.344733 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b269d2-4a62-4ccc-9e67-372748394281 None admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:30.345442 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b269d2-4a62-4ccc-9e67-372748394281 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:31:30.345748 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b269d2-4a62-4ccc-9e67-372748394281 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:30.347130 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b269d2-4a62-4ccc-9e67-372748394281 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:30.358519 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 605/1204] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:31:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:31:30.364830 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4723e347-599e-459f-9b23-b8c4ec7ee0f9 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:30.420528 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:30.466260 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4723e347-599e-459f-9b23-b8c4ec7ee0f9 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:30.499340 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d9e298-f759-441c-87d1-d60010b149e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:30.500037 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9e298-f759-441c-87d1-d60010b149e2 None admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:30.500329 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9e298-f759-441c-87d1-d60010b149e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:30.500606 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9e298-f759-441c-87d1-d60010b149e2 None admin] PATH_INFO: `/v3/users` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:30.501299 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d9e298-f759-441c-87d1-d60010b149e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:30.503331 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d9e298-f759-441c-87d1-d60010b149e2 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:30.703090 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 600/1205] 10.222.0.81 () {60 vars in 1132 bytes} [Mon Jul 18 16:31:30 2022] POST /identity/v3/users => generated 251 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:31:32.763698 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15587026-7eef-40e5-8f2c-0115b6271a70 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:32.764280 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15587026-7eef-40e5-8f2c-0115b6271a70 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:32.764280 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15587026-7eef-40e5-8f2c-0115b6271a70 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:32.765660 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 606/1206] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:31:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:31:32.771801 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf6280-5615-4143-9123-216025ce94c5 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:32.772200 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf6280-5615-4143-9123-216025ce94c5 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:32.772362 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf6280-5615-4143-9123-216025ce94c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:32.789568 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-09cf6280-5615-4143-9123-216025ce94c5 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:31:32.790759 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-09cf6280-5615-4143-9123-216025ce94c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:31:32.856855 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 601/1207] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:31:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:31:32.880849 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15587026-7eef-40e5-8f2c-0115b6271a70 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:32.982690 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15587026-7eef-40e5-8f2c-0115b6271a70 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:33.016540 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d0773e-c1b3-4aea-82c2-f3020b00e4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:33.017250 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0773e-c1b3-4aea-82c2-f3020b00e4d9 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:33.017530 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0773e-c1b3-4aea-82c2-f3020b00e4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:33.017801 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0773e-c1b3-4aea-82c2-f3020b00e4d9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:33.028526 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d0773e-c1b3-4aea-82c2-f3020b00e4d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:31:33.036248 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-e8d0773e-c1b3-4aea-82c2-f3020b00e4d9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:31:33.036248 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:31:33.036248 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:31:33.036248 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:31:33.036248 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:31:33.036248 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:31:33.036248 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:31:33.036248 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:31:33.036248 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:31:33.036248 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:31:33.036248 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:31:33.036248 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:31:33.036248 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:31:33.036248 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:31:33.036248 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:31:33.036248 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:31:33.037607 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:31:33.037607 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:31:33.037607 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:31:33.037607 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:31:33.037607 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:31:33.037607 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:31:33.037607 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:31:33.037607 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:31:33.037607 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:31:33.037607 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:31:33.037607 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:31:33.037607 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:31:33.037607 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:31:33.037607 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:31:33.037607 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:31:33.037607 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:31:33.038512 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:31:33.038512 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:31:33.038512 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:31:33.038512 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:31:33.038512 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:31:33.038512 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:31:33.038512 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:31:33.038512 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:31:33.038512 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:31:33.038512 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:31:33.038512 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:31:33.038512 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:31:33.038512 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 607/1208] 10.222.0.81 () {56 vars in 1102 bytes} [Mon Jul 18 16:31:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:31:33.043777 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf6280-5615-4143-9123-216025ce94c5 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:33.083172 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:33.141390 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf6280-5615-4143-9123-216025ce94c5 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:33.175907 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611576ca-1085-4fba-8c2e-bfc725d54758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:33.176568 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611576ca-1085-4fba-8c2e-bfc725d54758 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:33.176849 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611576ca-1085-4fba-8c2e-bfc725d54758 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:33.177120 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611576ca-1085-4fba-8c2e-bfc725d54758 None admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:33.177867 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611576ca-1085-4fba-8c2e-bfc725d54758 None admin] RBAC: Adding query filter params (name=service) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:31:33.178165 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611576ca-1085-4fba-8c2e-bfc725d54758 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:33.179524 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611576ca-1085-4fba-8c2e-bfc725d54758 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:33.187299 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 602/1209] 10.222.0.81 () {56 vars in 1103 bytes} [Mon Jul 18 16:31:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:31:33.193630 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d0773e-c1b3-4aea-82c2-f3020b00e4d9 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:33.244364 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:33.293866 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d0773e-c1b3-4aea-82c2-f3020b00e4d9 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:33.327051 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a60921-1f9e-4b8c-8954-2cf1745764a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:33.327854 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a60921-1f9e-4b8c-8954-2cf1745764a9 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:33.328134 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a60921-1f9e-4b8c-8954-2cf1745764a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:33.328404 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a60921-1f9e-4b8c-8954-2cf1745764a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:33.338711 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a60921-1f9e-4b8c-8954-2cf1745764a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:33.340175 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a60921-1f9e-4b8c-8954-2cf1745764a9 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:33.356919 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-f6a60921-1f9e-4b8c-8954-2cf1745764a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:31:33.356919 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:31:33.356919 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:31:33.356919 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:31:33.356919 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:31:33.356919 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:31:33.356919 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:31:33.356919 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:31:33.356919 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:31:33.356919 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:31:33.356919 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:31:33.356919 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:31:33.356919 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:31:33.356919 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:31:33.356919 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:31:33.358204 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:31:33.358204 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:31:33.358204 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:31:33.358204 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:31:33.358204 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:31:33.358204 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:31:33.358204 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:31:33.358204 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:31:33.358204 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:31:33.358204 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:31:33.358204 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:31:33.358204 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:31:33.358204 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:31:33.358204 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:31:33.358204 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:31:33.358204 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:31:33.358204 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:31:33.359332 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:31:33.359332 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:31:33.359332 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:31:33.359332 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:31:33.359332 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 608/1210] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:31:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:31:33.364634 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611576ca-1085-4fba-8c2e-bfc725d54758 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:33.464729 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:33.467521 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611576ca-1085-4fba-8c2e-bfc725d54758 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:33.501711 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d1e96-90d7-4cb3-8deb-d0bf8bc47c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:33.503004 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d1e96-90d7-4cb3-8deb-d0bf8bc47c16 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:33.503283 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d1e96-90d7-4cb3-8deb-d0bf8bc47c16 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:33.503846 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d1e96-90d7-4cb3-8deb-d0bf8bc47c16 None admin] PATH_INFO: `/v3/domains` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:33.504553 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3d1e96-90d7-4cb3-8deb-d0bf8bc47c16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:31:33.504904 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3d1e96-90d7-4cb3-8deb-d0bf8bc47c16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:33.506253 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3d1e96-90d7-4cb3-8deb-d0bf8bc47c16 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:33.517054 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 603/1211] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:31:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:31:33.522958 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a60921-1f9e-4b8c-8954-2cf1745764a9 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:33.624917 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a60921-1f9e-4b8c-8954-2cf1745764a9 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:33.626418 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:33.660085 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610540c3-b84d-45b8-ad51-c0277c91e83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:33.660878 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610540c3-b84d-45b8-ad51-c0277c91e83c None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:33.661159 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610540c3-b84d-45b8-ad51-c0277c91e83c None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:33.661426 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610540c3-b84d-45b8-ad51-c0277c91e83c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:33.668338 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610540c3-b84d-45b8-ad51-c0277c91e83c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:33.669761 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610540c3-b84d-45b8-ad51-c0277c91e83c None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:33.683738 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-610540c3-b84d-45b8-ad51-c0277c91e83c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 18 16:31:33.683738 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:31:33.683738 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:31:33.683738 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:31:33.683738 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:31:33.683738 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:31:33.683738 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:31:33.683738 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:31:33.683738 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:31:33.683738 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:31:33.683738 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:31:33.683738 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:31:33.683738 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:31:33.683738 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:31:33.683738 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:31:33.683738 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:31:33.684813 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:31:33.684813 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:31:33.684813 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:31:33.684813 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:31:33.684813 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:31:33.684813 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:31:33.684813 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:31:33.684813 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:31:33.684813 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:31:33.684813 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:31:33.684813 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:31:33.684813 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:31:33.684813 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:31:33.684813 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:31:33.684813 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:31:33.684813 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:31:33.684813 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:31:33.684813 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:31:33.686085 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:31:33.686085 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:31:33.686085 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:31:33.686085 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:31:33.686085 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:31:33.686085 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:31:33.686085 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:31:33.686085 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:31:33.686085 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 18 16:31:33.686085 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:31:33.686085 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 609/1212] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:31:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:31:33.691254 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d1e96-90d7-4cb3-8deb-d0bf8bc47c16 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:33.803684 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d1e96-90d7-4cb3-8deb-d0bf8bc47c16 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:33.841666 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf68a71-b512-474b-b6ac-4d31a3a2386e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:33.842325 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf68a71-b512-474b-b6ac-4d31a3a2386e None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:33.842611 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf68a71-b512-474b-b6ac-4d31a3a2386e None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:33.842886 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf68a71-b512-474b-b6ac-4d31a3a2386e None admin] PATH_INFO: `/v3/users` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:33.843948 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf68a71-b512-474b-b6ac-4d31a3a2386e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:31:33.844271 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf68a71-b512-474b-b6ac-4d31a3a2386e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:33.845755 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf68a71-b512-474b-b6ac-4d31a3a2386e None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:33.864840 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 604/1213] 10.222.0.81 () {56 vars in 1143 bytes} [Mon Jul 18 16:31:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:31:33.870879 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610540c3-b84d-45b8-ad51-c0277c91e83c None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:33.971129 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610540c3-b84d-45b8-ad51-c0277c91e83c None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:34.006009 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb43fa31-2534-4b94-905c-16145e568299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:34.006652 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43fa31-2534-4b94-905c-16145e568299 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:34.006930 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43fa31-2534-4b94-905c-16145e568299 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:34.007201 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43fa31-2534-4b94-905c-16145e568299 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:34.035851 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:34.078780 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb43fa31-2534-4b94-905c-16145e568299 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:34.080297 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb43fa31-2534-4b94-905c-16145e568299 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:34.182810 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 610/1214] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Jul 18 16:31:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 16:31:34.188706 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf68a71-b512-474b-b6ac-4d31a3a2386e None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:34.208510 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:34.288479 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf68a71-b512-474b-b6ac-4d31a3a2386e None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:34.322119 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c176923-926c-4f58-8088-fca6d7d342c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:34.322892 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c176923-926c-4f58-8088-fca6d7d342c1 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:34.323179 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c176923-926c-4f58-8088-fca6d7d342c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:34.323449 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c176923-926c-4f58-8088-fca6d7d342c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:34.333665 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c176923-926c-4f58-8088-fca6d7d342c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:34.335099 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c176923-926c-4f58-8088-fca6d7d342c1 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:34.352343 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-5c176923-926c-4f58-8088-fca6d7d342c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:31:34.352343 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:31:34.352343 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:31:34.352343 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:31:34.352343 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:31:34.352343 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:31:34.352343 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:31:34.352343 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:31:34.352343 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:31:34.352343 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:31:34.352343 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:31:34.352343 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:31:34.352343 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:31:34.352343 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:31:34.352343 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:31:34.353428 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:31:34.353428 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:31:34.353428 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:31:34.353428 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:31:34.353428 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:31:34.353428 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:31:34.353428 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:31:34.353428 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:31:34.353428 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:31:34.353428 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:31:34.353428 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:31:34.353428 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:31:34.353428 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:31:34.353428 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:31:34.353428 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:31:34.353428 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:31:34.353428 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:31:34.354575 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:31:34.354575 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:31:34.354575 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:31:34.354575 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:31:34.354575 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 605/1215] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:31:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:31:34.359239 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb43fa31-2534-4b94-905c-16145e568299 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:34.419823 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:34.462484 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb43fa31-2534-4b94-905c-16145e568299 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:34.496064 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2782d92-4a7d-46ef-9289-b07d841fe031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:34.496793 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2782d92-4a7d-46ef-9289-b07d841fe031 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:34.497009 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2782d92-4a7d-46ef-9289-b07d841fe031 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:34.497284 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2782d92-4a7d-46ef-9289-b07d841fe031 None admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:34.497998 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2782d92-4a7d-46ef-9289-b07d841fe031 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:31:34.498305 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2782d92-4a7d-46ef-9289-b07d841fe031 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:34.499700 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2782d92-4a7d-46ef-9289-b07d841fe031 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:34.511986 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 611/1216] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:31:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:31:34.517640 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c176923-926c-4f58-8088-fca6d7d342c1 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:34.586935 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:34.616820 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c176923-926c-4f58-8088-fca6d7d342c1 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:34.650687 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481d3bd0-453e-41f6-a784-ebd4346084c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:34.651482 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d3bd0-453e-41f6-a784-ebd4346084c3 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:34.651797 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d3bd0-453e-41f6-a784-ebd4346084c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:34.652079 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d3bd0-453e-41f6-a784-ebd4346084c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:34.658898 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481d3bd0-453e-41f6-a784-ebd4346084c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:34.660461 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481d3bd0-453e-41f6-a784-ebd4346084c3 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:34.675628 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-481d3bd0-453e-41f6-a784-ebd4346084c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:31:34.675628 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:31:34.675628 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:31:34.675628 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:31:34.675628 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:31:34.675628 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:31:34.675628 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:31:34.675628 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:31:34.675628 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:31:34.675628 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:31:34.675628 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:31:34.675628 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:31:34.675628 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:31:34.675628 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:31:34.675628 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:31:34.676836 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:31:34.676836 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:31:34.676836 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:31:34.676836 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:31:34.676836 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:31:34.676836 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:31:34.676836 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:31:34.676836 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:31:34.676836 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:31:34.676836 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:31:34.676836 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:31:34.676836 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:31:34.676836 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:31:34.676836 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:31:34.676836 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:31:34.676836 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:31:34.676836 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:31:34.678047 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:31:34.678047 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:31:34.678047 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:31:34.678047 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:31:34.678047 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:31:34.678047 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:31:34.678047 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:31:34.678047 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:31:34.678047 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 606/1217] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Jul 18 16:31:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:31:34.682801 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2782d92-4a7d-46ef-9289-b07d841fe031 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:34.784611 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2782d92-4a7d-46ef-9289-b07d841fe031 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:34.807954 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:34.819892 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbaad74-4c5f-4150-819a-d9af21ce2af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:34.820642 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbaad74-4c5f-4150-819a-d9af21ce2af2 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:34.820927 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbaad74-4c5f-4150-819a-d9af21ce2af2 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:34.821203 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbaad74-4c5f-4150-819a-d9af21ce2af2 None admin] PATH_INFO: `/v3/projects` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:34.821988 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbaad74-4c5f-4150-819a-d9af21ce2af2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:31:34.822296 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbaad74-4c5f-4150-819a-d9af21ce2af2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:34.823744 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbaad74-4c5f-4150-819a-d9af21ce2af2 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:34.835754 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 612/1218] 10.222.0.81 () {56 vars in 1148 bytes} [Mon Jul 18 16:31:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:31:34.842088 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481d3bd0-453e-41f6-a784-ebd4346084c3 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:34.943703 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481d3bd0-453e-41f6-a784-ebd4346084c3 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:34.972792 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:34.978583 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba7c7ac-c1b7-4007-988e-b85748b1af8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:34.979225 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7c7ac-c1b7-4007-988e-b85748b1af8c None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:34.979503 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7c7ac-c1b7-4007-988e-b85748b1af8c None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:34.979804 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7c7ac-c1b7-4007-988e-b85748b1af8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:34.980619 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba7c7ac-c1b7-4007-988e-b85748b1af8c None admin] RBAC: Adding query filter params (role.id=a716f51ae5b44c918918ed808ad2b2b0, scope.project.id=9d1d84bf334d47e6bfba1141c1fc6f59, user.id=5700ad7df774415b89737c7dddcc5b2c) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:31:34.980927 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba7c7ac-c1b7-4007-988e-b85748b1af8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:34.982343 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba7c7ac-c1b7-4007-988e-b85748b1af8c None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:34.988256 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 607/1219] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Jul 18 16:31:34 2022] GET /identity/v3/role_assignments?user.id=5700ad7df774415b89737c7dddcc5b2c&scope.project.id=9d1d84bf334d47e6bfba1141c1fc6f59&role.id=a716f51ae5b44c918918ed808ad2b2b0 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:31:36.999324 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765c401-c107-463b-a786-6da70caf5215 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:36.999877 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765c401-c107-463b-a786-6da70caf5215 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:36.999877 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765c401-c107-463b-a786-6da70caf5215 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:37.001291 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 613/1220] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:31:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:31:37.007297 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc63c05-fda5-4568-b163-d0a62a04a40f None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:37.007704 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc63c05-fda5-4568-b163-d0a62a04a40f None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:37.007923 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc63c05-fda5-4568-b163-d0a62a04a40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:37.024292 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-9dc63c05-fda5-4568-b163-d0a62a04a40f None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:31:37.025458 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-9dc63c05-fda5-4568-b163-d0a62a04a40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:31:37.088770 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 608/1221] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:31:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:31:37.111004 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9765c401-c107-463b-a786-6da70caf5215 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:37.217157 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9765c401-c107-463b-a786-6da70caf5215 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:37.254859 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de71954-29dd-4d7e-9e0d-1cb230ca80ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:37.254859 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de71954-29dd-4d7e-9e0d-1cb230ca80ee None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:37.254859 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de71954-29dd-4d7e-9e0d-1cb230ca80ee None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:37.254859 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de71954-29dd-4d7e-9e0d-1cb230ca80ee None admin] PATH_INFO: `/v3/roles/service` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:37.264094 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de71954-29dd-4d7e-9e0d-1cb230ca80ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:31:37.271962 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-2de71954-29dd-4d7e-9e0d-1cb230ca80ee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:31:37.271962 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:31:37.271962 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:31:37.271962 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:31:37.271962 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:31:37.271962 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:31:37.271962 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:31:37.271962 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:31:37.271962 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:31:37.271962 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:31:37.271962 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:31:37.271962 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:31:37.271962 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:31:37.271962 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:31:37.271962 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:31:37.271962 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:31:37.273115 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:31:37.273115 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:31:37.273115 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:31:37.273115 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:31:37.273115 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:31:37.273115 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:31:37.273115 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:31:37.273115 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:31:37.273115 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:31:37.273115 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:31:37.273115 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:31:37.273115 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:31:37.273115 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:31:37.273115 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:31:37.273115 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:31:37.273115 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:31:37.274175 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:31:37.274175 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:31:37.274175 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:31:37.274175 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:31:37.274175 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:31:37.274175 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:31:37.274175 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:31:37.274175 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:31:37.274175 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:31:37.274175 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:31:37.274175 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:31:37.274175 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:31:37.274175 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 614/1222] 10.222.0.81 () {56 vars in 1102 bytes} [Mon Jul 18 16:31:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:31:37.279304 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc63c05-fda5-4568-b163-d0a62a04a40f None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:37.377296 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc63c05-fda5-4568-b163-d0a62a04a40f None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:37.400814 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:37.411605 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e31367-7a4c-47e6-9720-721532a64cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:37.412317 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e31367-7a4c-47e6-9720-721532a64cc2 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:37.412601 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e31367-7a4c-47e6-9720-721532a64cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:37.412876 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e31367-7a4c-47e6-9720-721532a64cc2 None admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:37.413613 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e31367-7a4c-47e6-9720-721532a64cc2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:31:37.413919 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e31367-7a4c-47e6-9720-721532a64cc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:37.415349 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e31367-7a4c-47e6-9720-721532a64cc2 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:37.423414 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 609/1223] 10.222.0.81 () {56 vars in 1103 bytes} [Mon Jul 18 16:31:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:31:37.429859 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de71954-29dd-4d7e-9e0d-1cb230ca80ee None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:37.474413 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:37.530320 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de71954-29dd-4d7e-9e0d-1cb230ca80ee None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:37.563964 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b98b2-1ff7-4237-823f-315460262d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:37.564747 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b98b2-1ff7-4237-823f-315460262d1e None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:37.565065 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b98b2-1ff7-4237-823f-315460262d1e None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:37.565339 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b98b2-1ff7-4237-823f-315460262d1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:37.575866 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053b98b2-1ff7-4237-823f-315460262d1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:37.577305 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053b98b2-1ff7-4237-823f-315460262d1e None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:37.594014 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-053b98b2-1ff7-4237-823f-315460262d1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:31:37.594014 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:31:37.594014 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:31:37.594014 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:31:37.594014 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:31:37.594014 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:31:37.594014 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:31:37.594014 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:31:37.594014 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:31:37.594014 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:31:37.594014 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:31:37.594014 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:31:37.594014 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:31:37.594014 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:31:37.594014 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:31:37.601607 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:31:37.601607 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:31:37.601607 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:31:37.601607 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:31:37.601607 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:31:37.601607 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:31:37.601607 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:31:37.601607 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:31:37.601607 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:31:37.601607 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:31:37.601607 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:31:37.601607 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:31:37.601607 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:31:37.601607 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:31:37.601607 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:31:37.601607 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:31:37.601607 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:31:37.602637 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:31:37.602637 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:31:37.602637 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:31:37.602637 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:31:37.602637 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 615/1224] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:31:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:31:37.602953 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e31367-7a4c-47e6-9720-721532a64cc2 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:37.709114 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e31367-7a4c-47e6-9720-721532a64cc2 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:37.742158 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff6c0d-5220-44a9-8ea8-6b66ee60a888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:37.742809 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff6c0d-5220-44a9-8ea8-6b66ee60a888 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:37.743093 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff6c0d-5220-44a9-8ea8-6b66ee60a888 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:37.743370 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff6c0d-5220-44a9-8ea8-6b66ee60a888 None admin] PATH_INFO: `/v3/domains` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:37.744109 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beff6c0d-5220-44a9-8ea8-6b66ee60a888 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:31:37.744416 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beff6c0d-5220-44a9-8ea8-6b66ee60a888 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:37.745808 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beff6c0d-5220-44a9-8ea8-6b66ee60a888 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:37.757581 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 610/1225] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:31:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:31:37.763384 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b98b2-1ff7-4237-823f-315460262d1e None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:37.856755 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:37.863238 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b98b2-1ff7-4237-823f-315460262d1e None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:37.897406 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c305041-b344-455c-a2b7-5878eac35776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:37.903667 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c305041-b344-455c-a2b7-5878eac35776 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:37.903667 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c305041-b344-455c-a2b7-5878eac35776 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:37.903667 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c305041-b344-455c-a2b7-5878eac35776 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:37.906016 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c305041-b344-455c-a2b7-5878eac35776 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:37.907439 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c305041-b344-455c-a2b7-5878eac35776 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:37.922413 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-6c305041-b344-455c-a2b7-5878eac35776 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 18 16:31:37.922413 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:31:37.922413 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:31:37.922413 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:31:37.922413 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:31:37.922413 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:31:37.922413 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:31:37.922413 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:31:37.922413 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:31:37.922413 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:31:37.922413 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:31:37.922413 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:31:37.922413 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:31:37.922413 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:31:37.922413 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:31:37.922413 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:31:37.923624 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:31:37.923624 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:31:37.923624 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:31:37.923624 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:31:37.923624 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:31:37.923624 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:31:37.923624 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:31:37.923624 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:31:37.923624 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:31:37.923624 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:31:37.923624 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:31:37.923624 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:31:37.923624 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:31:37.923624 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:31:37.923624 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:31:37.923624 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:31:37.923624 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:31:37.923624 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:31:37.925041 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:31:37.925041 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:31:37.925041 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:31:37.925041 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:31:37.925041 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:31:37.925041 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:31:37.925041 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:31:37.925041 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:31:37.925041 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 18 16:31:37.925041 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:31:37.925041 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 616/1226] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:31:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:31:37.929521 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff6c0d-5220-44a9-8ea8-6b66ee60a888 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:37.978075 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:38.029297 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff6c0d-5220-44a9-8ea8-6b66ee60a888 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:38.061848 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31942adc-28da-4c1a-b0ac-3d6a3c64c630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:38.062505 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31942adc-28da-4c1a-b0ac-3d6a3c64c630 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:38.062782 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31942adc-28da-4c1a-b0ac-3d6a3c64c630 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:38.063053 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31942adc-28da-4c1a-b0ac-3d6a3c64c630 None admin] PATH_INFO: `/v3/users` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:38.063892 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31942adc-28da-4c1a-b0ac-3d6a3c64c630 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:31:38.064198 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31942adc-28da-4c1a-b0ac-3d6a3c64c630 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:38.065714 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31942adc-28da-4c1a-b0ac-3d6a3c64c630 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:38.082502 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 611/1227] 10.222.0.81 () {56 vars in 1143 bytes} [Mon Jul 18 16:31:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:31:38.088648 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c305041-b344-455c-a2b7-5878eac35776 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:38.190330 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c305041-b344-455c-a2b7-5878eac35776 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:38.225080 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8280e4f9-8da8-4911-888c-27fd924eb2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:38.225936 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280e4f9-8da8-4911-888c-27fd924eb2d7 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:38.226223 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280e4f9-8da8-4911-888c-27fd924eb2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:38.226527 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280e4f9-8da8-4911-888c-27fd924eb2d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:38.236608 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8280e4f9-8da8-4911-888c-27fd924eb2d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:38.238123 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8280e4f9-8da8-4911-888c-27fd924eb2d7 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:38.256124 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-8280e4f9-8da8-4911-888c-27fd924eb2d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:31:38.256124 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:31:38.256124 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:31:38.256124 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:31:38.256124 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:31:38.256124 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:31:38.256124 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:31:38.256124 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:31:38.256124 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:31:38.256124 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:31:38.256124 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:31:38.256124 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:31:38.256124 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:31:38.256124 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:31:38.256124 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:31:38.257046 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:31:38.257046 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:31:38.257046 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:31:38.257046 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:31:38.257046 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:31:38.257046 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:31:38.257046 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:31:38.257046 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:31:38.257046 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:31:38.257046 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:31:38.257046 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:31:38.257046 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:31:38.257046 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:31:38.257046 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:31:38.257046 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:31:38.257046 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:31:38.257046 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:31:38.257996 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:31:38.257996 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:31:38.257996 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:31:38.257996 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:31:38.257996 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 617/1228] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:31:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:31:38.263418 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31942adc-28da-4c1a-b0ac-3d6a3c64c630 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:38.365721 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31942adc-28da-4c1a-b0ac-3d6a3c64c630 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:38.368140 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:38.400258 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d093db-abeb-441c-a2e8-525f138270af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:38.400915 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d093db-abeb-441c-a2e8-525f138270af None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:38.401196 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d093db-abeb-441c-a2e8-525f138270af None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:38.401472 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d093db-abeb-441c-a2e8-525f138270af None admin] PATH_INFO: `/v3/domains` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:38.402225 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d093db-abeb-441c-a2e8-525f138270af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:31:38.402589 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d093db-abeb-441c-a2e8-525f138270af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:38.403982 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d093db-abeb-441c-a2e8-525f138270af None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:38.415631 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 612/1229] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:31:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:31:38.421598 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8280e4f9-8da8-4911-888c-27fd924eb2d7 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:38.431059 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:38.521081 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8280e4f9-8da8-4911-888c-27fd924eb2d7 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:38.553609 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27286c5e-275e-40f6-ae68-07386c213d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:38.554411 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27286c5e-275e-40f6-ae68-07386c213d27 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:38.554690 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27286c5e-275e-40f6-ae68-07386c213d27 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:38.554959 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27286c5e-275e-40f6-ae68-07386c213d27 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:38.562523 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27286c5e-275e-40f6-ae68-07386c213d27 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:38.566076 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27286c5e-275e-40f6-ae68-07386c213d27 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:38.579235 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-27286c5e-275e-40f6-ae68-07386c213d27 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:31:38.579235 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:31:38.579235 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:31:38.579235 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:31:38.579235 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:31:38.579235 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:31:38.579235 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:31:38.579235 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:31:38.579235 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:31:38.579235 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:31:38.579235 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:31:38.579235 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:31:38.579235 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:31:38.579235 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:31:38.579235 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:31:38.580961 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:31:38.580961 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:31:38.580961 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:31:38.580961 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:31:38.580961 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:31:38.580961 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:31:38.580961 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:31:38.580961 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:31:38.580961 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:31:38.580961 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:31:38.580961 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:31:38.580961 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:31:38.580961 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:31:38.580961 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:31:38.580961 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:31:38.580961 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:31:38.580961 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:31:38.582193 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:31:38.582193 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:31:38.582193 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:31:38.582193 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:31:38.582193 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:31:38.582193 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:31:38.582193 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:31:38.582193 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:31:38.582193 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 618/1230] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Jul 18 16:31:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:31:38.586836 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d093db-abeb-441c-a2e8-525f138270af None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:38.689580 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d093db-abeb-441c-a2e8-525f138270af None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:38.723037 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90ed7f9-0dc4-4cc5-b7fb-ed88cec14ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:38.723613 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ed7f9-0dc4-4cc5-b7fb-ed88cec14ad8 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:38.723928 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ed7f9-0dc4-4cc5-b7fb-ed88cec14ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:38.724255 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ed7f9-0dc4-4cc5-b7fb-ed88cec14ad8 None admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:38.725037 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90ed7f9-0dc4-4cc5-b7fb-ed88cec14ad8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:31:38.725344 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90ed7f9-0dc4-4cc5-b7fb-ed88cec14ad8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:38.726794 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90ed7f9-0dc4-4cc5-b7fb-ed88cec14ad8 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:38.739264 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 613/1231] 10.222.0.81 () {56 vars in 1148 bytes} [Mon Jul 18 16:31:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:31:38.745469 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27286c5e-275e-40f6-ae68-07386c213d27 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:38.811760 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:38.846698 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27286c5e-275e-40f6-ae68-07386c213d27 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:38.880014 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92081df-58c6-4590-8b67-462877711f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:38.880896 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92081df-58c6-4590-8b67-462877711f7f None admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:38.881171 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92081df-58c6-4590-8b67-462877711f7f None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:38.881437 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92081df-58c6-4590-8b67-462877711f7f None admin] PATH_INFO: `/v3/projects/9d1d84bf334d47e6bfba1141c1fc6f59/users/5700ad7df774415b89737c7dddcc5b2c/roles/a716f51ae5b44c918918ed808ad2b2b0` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:38.895940 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92081df-58c6-4590-8b67-462877711f7f None admin] RBAC: Authorizing `identity:create_grant(project_id=9d1d84bf334d47e6bfba1141c1fc6f59, user_id=5700ad7df774415b89737c7dddcc5b2c, role_id=a716f51ae5b44c918918ed808ad2b2b0)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:38.897356 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92081df-58c6-4590-8b67-462877711f7f None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:39.045032 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 619/1232] 10.222.0.81 () {58 vars in 1439 bytes} [Mon Jul 18 16:31:38 2022] PUT /identity/v3/projects/9d1d84bf334d47e6bfba1141c1fc6f59/users/5700ad7df774415b89737c7dddcc5b2c/roles/a716f51ae5b44c918918ed808ad2b2b0 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:31:41.053453 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8e5e1-ec9b-4743-b7a4-4a24098d3ef3 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:41.054024 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8e5e1-ec9b-4743-b7a4-4a24098d3ef3 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:41.054024 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8e5e1-ec9b-4743-b7a4-4a24098d3ef3 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:41.055399 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 614/1233] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:31:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:31:41.060747 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24113cd-a6e6-4002-b819-b487f130a3ed None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:41.061148 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24113cd-a6e6-4002-b819-b487f130a3ed None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:41.061306 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24113cd-a6e6-4002-b819-b487f130a3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:41.078088 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-c24113cd-a6e6-4002-b819-b487f130a3ed None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:31:41.079792 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-c24113cd-a6e6-4002-b819-b487f130a3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:31:41.146769 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 620/1234] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:31:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:31:41.169855 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b8e5e1-ec9b-4743-b7a4-4a24098d3ef3 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:41.195396 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:41.273315 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b8e5e1-ec9b-4743-b7a4-4a24098d3ef3 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:41.305558 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe448ad-1b1e-419b-87b4-a3c9a0816412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:41.306275 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe448ad-1b1e-419b-87b4-a3c9a0816412 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:41.306562 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe448ad-1b1e-419b-87b4-a3c9a0816412 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:41.306835 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe448ad-1b1e-419b-87b4-a3c9a0816412 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:41.318255 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe448ad-1b1e-419b-87b4-a3c9a0816412 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:31:41.326144 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-abe448ad-1b1e-419b-87b4-a3c9a0816412 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:31:41.326144 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:31:41.326144 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:31:41.326144 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:31:41.326144 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:31:41.326144 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:31:41.326144 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:31:41.326144 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:31:41.326144 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:31:41.326144 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:31:41.326144 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:31:41.326144 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:31:41.326144 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:31:41.326144 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:31:41.326144 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:31:41.326144 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:31:41.327310 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:31:41.327310 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:31:41.327310 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:31:41.327310 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:31:41.327310 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:31:41.327310 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:31:41.327310 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:31:41.327310 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:31:41.327310 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:31:41.327310 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:31:41.327310 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:31:41.327310 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:31:41.327310 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:31:41.327310 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:31:41.327310 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:31:41.327310 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:31:41.328703 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:31:41.328703 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:31:41.328703 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:31:41.328703 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:31:41.328703 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:31:41.328703 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:31:41.328703 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:31:41.328703 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:31:41.328703 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:31:41.328703 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:31:41.328703 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:31:41.328703 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:31:41.328703 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 615/1235] 10.222.0.81 () {56 vars in 1102 bytes} [Mon Jul 18 16:31:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:31:41.334062 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24113cd-a6e6-4002-b819-b487f130a3ed None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:41.379465 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:41.430774 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24113cd-a6e6-4002-b819-b487f130a3ed None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:41.465319 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3bf67c-6aba-4b6d-b53d-db3a791e59a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:41.465999 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3bf67c-6aba-4b6d-b53d-db3a791e59a0 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:41.466279 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3bf67c-6aba-4b6d-b53d-db3a791e59a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:41.466550 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3bf67c-6aba-4b6d-b53d-db3a791e59a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:41.467304 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3bf67c-6aba-4b6d-b53d-db3a791e59a0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:31:41.467604 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3bf67c-6aba-4b6d-b53d-db3a791e59a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:41.469032 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3bf67c-6aba-4b6d-b53d-db3a791e59a0 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:41.477345 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 621/1236] 10.222.0.81 () {56 vars in 1103 bytes} [Mon Jul 18 16:31:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:31:41.483392 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe448ad-1b1e-419b-87b4-a3c9a0816412 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:41.568697 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:41.584109 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe448ad-1b1e-419b-87b4-a3c9a0816412 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:41.616692 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79c8317-d98f-4c3d-aa0c-1fc909455d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:41.617471 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c8317-d98f-4c3d-aa0c-1fc909455d3f None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:41.617746 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c8317-d98f-4c3d-aa0c-1fc909455d3f None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:41.618019 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c8317-d98f-4c3d-aa0c-1fc909455d3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:41.627540 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79c8317-d98f-4c3d-aa0c-1fc909455d3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:41.629259 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79c8317-d98f-4c3d-aa0c-1fc909455d3f None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:41.647071 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-a79c8317-d98f-4c3d-aa0c-1fc909455d3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:31:41.647071 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:31:41.647071 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:31:41.647071 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:31:41.647071 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:31:41.647071 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:31:41.647071 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:31:41.647071 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:31:41.647071 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:31:41.647071 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:31:41.647071 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:31:41.647071 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:31:41.647071 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:31:41.647071 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:31:41.647071 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:31:41.648333 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:31:41.648333 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:31:41.648333 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:31:41.648333 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:31:41.648333 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:31:41.648333 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:31:41.648333 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:31:41.648333 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:31:41.648333 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:31:41.648333 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:31:41.648333 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:31:41.648333 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:31:41.648333 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:31:41.648333 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:31:41.648333 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:31:41.648333 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:31:41.648333 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:31:41.649275 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:31:41.649275 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:31:41.649275 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:31:41.649275 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:31:41.649275 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 616/1237] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:31:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:31:41.654289 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3bf67c-6aba-4b6d-b53d-db3a791e59a0 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:41.753854 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3bf67c-6aba-4b6d-b53d-db3a791e59a0 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:41.762603 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:41.787167 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44775f3-f827-42b8-988b-937d4a3274fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:41.787847 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44775f3-f827-42b8-988b-937d4a3274fe None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:41.788127 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44775f3-f827-42b8-988b-937d4a3274fe None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:41.788398 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44775f3-f827-42b8-988b-937d4a3274fe None admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:41.789106 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44775f3-f827-42b8-988b-937d4a3274fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:31:41.789404 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44775f3-f827-42b8-988b-937d4a3274fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:41.790764 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44775f3-f827-42b8-988b-937d4a3274fe None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:41.802949 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 622/1238] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:31:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:31:41.808850 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79c8317-d98f-4c3d-aa0c-1fc909455d3f None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:41.912879 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79c8317-d98f-4c3d-aa0c-1fc909455d3f None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:41.946639 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d11b04c-8e82-449b-94cd-76d23edcdf75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:41.947435 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11b04c-8e82-449b-94cd-76d23edcdf75 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:41.947732 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11b04c-8e82-449b-94cd-76d23edcdf75 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:41.948021 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11b04c-8e82-449b-94cd-76d23edcdf75 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:41.950681 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:41.955907 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d11b04c-8e82-449b-94cd-76d23edcdf75 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:41.957438 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d11b04c-8e82-449b-94cd-76d23edcdf75 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:41.972793 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-3d11b04c-8e82-449b-94cd-76d23edcdf75 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 18 16:31:41.972793 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:31:41.972793 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:31:41.972793 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:31:41.972793 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:31:41.972793 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:31:41.972793 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:31:41.972793 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:31:41.972793 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:31:41.972793 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:31:41.972793 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:31:41.972793 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:31:41.972793 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:31:41.972793 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:31:41.972793 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:31:41.972793 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:31:41.974023 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:31:41.974023 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:31:41.974023 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:31:41.974023 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:31:41.974023 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:31:41.974023 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:31:41.974023 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:31:41.974023 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:31:41.974023 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:31:41.974023 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:31:41.974023 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:31:41.974023 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:31:41.974023 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:31:41.974023 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:31:41.974023 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:31:41.974023 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:31:41.974023 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:31:41.974023 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:31:41.975322 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:31:41.975322 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:31:41.975322 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:31:41.975322 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:31:41.975322 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:31:41.975322 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:31:41.975322 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:31:41.975322 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:31:41.975322 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 18 16:31:41.975322 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:31:41.975322 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 617/1239] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:31:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:31:41.982305 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44775f3-f827-42b8-988b-937d4a3274fe None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:42.083146 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44775f3-f827-42b8-988b-937d4a3274fe None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:42.116946 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54749164-3327-4ad2-bf1d-9876f517d543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:42.117611 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54749164-3327-4ad2-bf1d-9876f517d543 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:42.117896 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54749164-3327-4ad2-bf1d-9876f517d543 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:42.118171 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54749164-3327-4ad2-bf1d-9876f517d543 None admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:42.119000 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54749164-3327-4ad2-bf1d-9876f517d543 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:31:42.119310 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54749164-3327-4ad2-bf1d-9876f517d543 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:42.120781 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54749164-3327-4ad2-bf1d-9876f517d543 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:42.138754 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 623/1240] 10.222.0.81 () {56 vars in 1143 bytes} [Mon Jul 18 16:31:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:31:42.145320 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d11b04c-8e82-449b-94cd-76d23edcdf75 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:42.244474 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d11b04c-8e82-449b-94cd-76d23edcdf75 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:42.279427 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ae0fa0-0f14-427c-8e76-5a9697d8c57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:42.280283 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae0fa0-0f14-427c-8e76-5a9697d8c57c None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:42.280396 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae0fa0-0f14-427c-8e76-5a9697d8c57c None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:42.280642 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae0fa0-0f14-427c-8e76-5a9697d8c57c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:42.340130 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:42.346484 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ae0fa0-0f14-427c-8e76-5a9697d8c57c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:42.347849 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ae0fa0-0f14-427c-8e76-5a9697d8c57c None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:42.442797 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 618/1241] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Jul 18 16:31:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 16:31:42.448957 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54749164-3327-4ad2-bf1d-9876f517d543 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:42.477753 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:42.547674 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54749164-3327-4ad2-bf1d-9876f517d543 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:42.582475 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475d3a47-4f79-4a8b-9d71-11cb8d50f922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:42.583264 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d3a47-4f79-4a8b-9d71-11cb8d50f922 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:42.583544 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d3a47-4f79-4a8b-9d71-11cb8d50f922 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:42.583875 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d3a47-4f79-4a8b-9d71-11cb8d50f922 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:42.593758 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475d3a47-4f79-4a8b-9d71-11cb8d50f922 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:42.596729 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475d3a47-4f79-4a8b-9d71-11cb8d50f922 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:42.612961 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-475d3a47-4f79-4a8b-9d71-11cb8d50f922 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:31:42.612961 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:31:42.612961 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:31:42.612961 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:31:42.612961 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:31:42.612961 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:31:42.612961 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:31:42.612961 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:31:42.612961 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:31:42.612961 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:31:42.612961 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:31:42.612961 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:31:42.612961 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:31:42.612961 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:31:42.612961 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:31:42.614084 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:31:42.614084 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:31:42.614084 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:31:42.614084 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:31:42.614084 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:31:42.614084 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:31:42.614084 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:31:42.614084 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:31:42.614084 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:31:42.614084 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:31:42.614084 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:31:42.614084 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:31:42.614084 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:31:42.614084 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:31:42.614084 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:31:42.614084 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:31:42.614084 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:31:42.615274 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:31:42.615274 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:31:42.615274 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:31:42.615274 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:31:42.615274 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 624/1242] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:31:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:31:42.620185 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ae0fa0-0f14-427c-8e76-5a9697d8c57c None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:42.715853 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:42.721521 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ae0fa0-0f14-427c-8e76-5a9697d8c57c None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:42.754632 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb6fa87-10ca-4d62-b0dc-826f27648565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:42.755298 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6fa87-10ca-4d62-b0dc-826f27648565 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:42.755574 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6fa87-10ca-4d62-b0dc-826f27648565 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:42.755884 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6fa87-10ca-4d62-b0dc-826f27648565 None admin] PATH_INFO: `/v3/domains` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:42.756602 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb6fa87-10ca-4d62-b0dc-826f27648565 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:31:42.756957 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb6fa87-10ca-4d62-b0dc-826f27648565 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:42.758282 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb6fa87-10ca-4d62-b0dc-826f27648565 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:42.769998 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 619/1243] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:31:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:31:42.775999 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475d3a47-4f79-4a8b-9d71-11cb8d50f922 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:42.853030 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:42.873642 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475d3a47-4f79-4a8b-9d71-11cb8d50f922 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:42.908498 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99970a70-d397-4ec2-9d74-ab59cc9b7216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:42.909280 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99970a70-d397-4ec2-9d74-ab59cc9b7216 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:42.909564 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99970a70-d397-4ec2-9d74-ab59cc9b7216 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:42.909839 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99970a70-d397-4ec2-9d74-ab59cc9b7216 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:42.916305 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99970a70-d397-4ec2-9d74-ab59cc9b7216 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:42.917868 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99970a70-d397-4ec2-9d74-ab59cc9b7216 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:42.931235 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-99970a70-d397-4ec2-9d74-ab59cc9b7216 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:31:42.931235 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:31:42.931235 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:31:42.931235 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:31:42.931235 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:31:42.931235 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:31:42.931235 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:31:42.931235 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:31:42.931235 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:31:42.931235 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:31:42.931235 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:31:42.931235 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:31:42.931235 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:31:42.931235 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:31:42.931235 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:31:42.941059 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:31:42.941059 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:31:42.941059 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:31:42.941059 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:31:42.941059 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:31:42.941059 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:31:42.941059 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:31:42.941059 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:31:42.941059 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:31:42.941059 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:31:42.941059 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:31:42.941059 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:31:42.941059 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:31:42.941059 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:31:42.941059 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:31:42.941059 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:31:42.941059 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:31:42.942218 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:31:42.942218 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:31:42.942218 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:31:42.942218 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:31:42.942218 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:31:42.942218 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:31:42.942218 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:31:42.942218 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:31:42.942218 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 625/1244] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Jul 18 16:31:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:31:42.942861 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb6fa87-10ca-4d62-b0dc-826f27648565 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:43.038735 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb6fa87-10ca-4d62-b0dc-826f27648565 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:43.073466 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee661ec-fa7b-4068-99ca-b240d979e24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:43.074122 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee661ec-fa7b-4068-99ca-b240d979e24a None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:43.074405 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee661ec-fa7b-4068-99ca-b240d979e24a None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:43.074680 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee661ec-fa7b-4068-99ca-b240d979e24a None admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:43.075458 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee661ec-fa7b-4068-99ca-b240d979e24a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:31:43.075802 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee661ec-fa7b-4068-99ca-b240d979e24a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:43.077380 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee661ec-fa7b-4068-99ca-b240d979e24a None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:43.089525 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 620/1245] 10.222.0.81 () {56 vars in 1148 bytes} [Mon Jul 18 16:31:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:31:43.096036 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99970a70-d397-4ec2-9d74-ab59cc9b7216 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:43.195744 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99970a70-d397-4ec2-9d74-ab59cc9b7216 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:43.228375 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c719ac20-faef-4891-9f88-cf1d81841e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:43.229028 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719ac20-faef-4891-9f88-cf1d81841e33 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:43.229317 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719ac20-faef-4891-9f88-cf1d81841e33 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:43.229591 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719ac20-faef-4891-9f88-cf1d81841e33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:43.230443 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c719ac20-faef-4891-9f88-cf1d81841e33 None admin] RBAC: Adding query filter params (role.id=a716f51ae5b44c918918ed808ad2b2b0, scope.project.id=9d1d84bf334d47e6bfba1141c1fc6f59, user.id=5700ad7df774415b89737c7dddcc5b2c) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:31:43.230727 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c719ac20-faef-4891-9f88-cf1d81841e33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:43.232217 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c719ac20-faef-4891-9f88-cf1d81841e33 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:43.238878 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 626/1246] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Jul 18 16:31:43 2022] GET /identity/v3/role_assignments?user.id=5700ad7df774415b89737c7dddcc5b2c&scope.project.id=9d1d84bf334d47e6bfba1141c1fc6f59&role.id=a716f51ae5b44c918918ed808ad2b2b0 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:31:45.274875 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2726c-3289-4fe2-9ba8-9607053653f4 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:45.275442 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2726c-3289-4fe2-9ba8-9607053653f4 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:45.275442 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2726c-3289-4fe2-9ba8-9607053653f4 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:45.276802 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 621/1247] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:31:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:31:45.281988 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c68ea71-1204-42a5-a338-81da19fc0316 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:45.283149 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c68ea71-1204-42a5-a338-81da19fc0316 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:45.283149 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c68ea71-1204-42a5-a338-81da19fc0316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:45.287716 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:45.300040 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-4c68ea71-1204-42a5-a338-81da19fc0316 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:31:45.301423 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-4c68ea71-1204-42a5-a338-81da19fc0316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:31:45.366434 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 627/1248] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:31:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:31:45.390676 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f2726c-3289-4fe2-9ba8-9607053653f4 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:45.408782 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:45.492081 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f2726c-3289-4fe2-9ba8-9607053653f4 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:45.527355 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3072225a-baf5-4081-98a3-ccaea40fd8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:45.528090 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072225a-baf5-4081-98a3-ccaea40fd8e5 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:45.528375 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072225a-baf5-4081-98a3-ccaea40fd8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:45.528650 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072225a-baf5-4081-98a3-ccaea40fd8e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:45.538711 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3072225a-baf5-4081-98a3-ccaea40fd8e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:31:45.546389 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-3072225a-baf5-4081-98a3-ccaea40fd8e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:31:45.546389 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:31:45.546389 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:31:45.546389 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:31:45.546389 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:31:45.546389 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:31:45.546389 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:31:45.546389 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:31:45.546389 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:31:45.546389 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:31:45.546389 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:31:45.546389 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:31:45.546389 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:31:45.546389 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:31:45.546389 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:31:45.546389 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:31:45.547561 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:31:45.547561 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:31:45.547561 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:31:45.547561 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:31:45.547561 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:31:45.547561 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:31:45.547561 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:31:45.547561 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:31:45.547561 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:31:45.547561 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:31:45.547561 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:31:45.547561 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:31:45.547561 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:31:45.547561 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:31:45.547561 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:31:45.547561 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:31:45.548981 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:31:45.548981 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:31:45.548981 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:31:45.548981 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:31:45.548981 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:31:45.548981 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:31:45.548981 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:31:45.548981 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:31:45.548981 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:31:45.548981 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:31:45.548981 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:31:45.548981 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:31:45.548981 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 622/1249] 10.222.0.81 () {56 vars in 1096 bytes} [Mon Jul 18 16:31:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:31:45.554211 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c68ea71-1204-42a5-a338-81da19fc0316 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:45.652493 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c68ea71-1204-42a5-a338-81da19fc0316 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:45.682287 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:45.687364 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6296d1c2-2d9d-4a81-ab7f-aca74c046330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:45.688059 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296d1c2-2d9d-4a81-ab7f-aca74c046330 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:45.688344 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296d1c2-2d9d-4a81-ab7f-aca74c046330 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:45.688616 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296d1c2-2d9d-4a81-ab7f-aca74c046330 None admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:45.689379 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6296d1c2-2d9d-4a81-ab7f-aca74c046330 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:31:45.689684 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6296d1c2-2d9d-4a81-ab7f-aca74c046330 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:45.691046 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6296d1c2-2d9d-4a81-ab7f-aca74c046330 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:45.701650 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 628/1250] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Jul 18 16:31:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:31:45.707143 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3072225a-baf5-4081-98a3-ccaea40fd8e5 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:45.785457 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:45.808075 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3072225a-baf5-4081-98a3-ccaea40fd8e5 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:45.840853 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ffd0d0-22e6-4cd3-850f-28d5d5739046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:45.841632 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffd0d0-22e6-4cd3-850f-28d5d5739046 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:45.841913 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffd0d0-22e6-4cd3-850f-28d5d5739046 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:45.842215 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffd0d0-22e6-4cd3-850f-28d5d5739046 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:45.853379 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ffd0d0-22e6-4cd3-850f-28d5d5739046 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:45.854818 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ffd0d0-22e6-4cd3-850f-28d5d5739046 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:45.872075 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-36ffd0d0-22e6-4cd3-850f-28d5d5739046 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:31:45.872075 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:31:45.872075 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:31:45.872075 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:31:45.872075 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:31:45.872075 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:31:45.872075 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:31:45.872075 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:31:45.872075 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:31:45.872075 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:31:45.872075 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:31:45.872075 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:31:45.872075 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:31:45.872075 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:31:45.872075 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:31:45.873177 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:31:45.873177 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:31:45.873177 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:31:45.873177 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:31:45.873177 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:31:45.873177 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:31:45.873177 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:31:45.873177 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:31:45.873177 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:31:45.873177 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:31:45.873177 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:31:45.873177 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:31:45.873177 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:31:45.873177 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:31:45.873177 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:31:45.873177 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:31:45.873177 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:31:45.874151 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:31:45.874151 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:31:45.874151 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:31:45.874151 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:31:45.874151 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 623/1251] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:31:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:31:45.879658 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6296d1c2-2d9d-4a81-ab7f-aca74c046330 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:45.981060 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6296d1c2-2d9d-4a81-ab7f-aca74c046330 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:46.013375 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce12c1d-9688-4c26-ace5-3b78f0fcf459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:46.014060 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce12c1d-9688-4c26-ace5-3b78f0fcf459 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:46.014349 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce12c1d-9688-4c26-ace5-3b78f0fcf459 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:46.014611 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce12c1d-9688-4c26-ace5-3b78f0fcf459 None admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:46.015315 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce12c1d-9688-4c26-ace5-3b78f0fcf459 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:31:46.015616 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce12c1d-9688-4c26-ace5-3b78f0fcf459 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:46.016994 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce12c1d-9688-4c26-ace5-3b78f0fcf459 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:46.029430 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 629/1252] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:31:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:31:46.036202 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ffd0d0-22e6-4cd3-850f-28d5d5739046 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:46.136392 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ffd0d0-22e6-4cd3-850f-28d5d5739046 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:46.163558 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:46.171515 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e579da3-10f2-4492-8d47-1719be4b2a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:46.171895 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e579da3-10f2-4492-8d47-1719be4b2a89 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:46.172183 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e579da3-10f2-4492-8d47-1719be4b2a89 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:46.172459 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e579da3-10f2-4492-8d47-1719be4b2a89 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:46.180611 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e579da3-10f2-4492-8d47-1719be4b2a89 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:46.182060 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e579da3-10f2-4492-8d47-1719be4b2a89 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:46.196353 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-2e579da3-10f2-4492-8d47-1719be4b2a89 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 18 16:31:46.196353 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:31:46.196353 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:31:46.196353 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:31:46.196353 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:31:46.196353 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:31:46.196353 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:31:46.196353 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:31:46.196353 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:31:46.196353 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:31:46.196353 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:31:46.196353 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:31:46.196353 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:31:46.196353 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:31:46.196353 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:31:46.196353 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:31:46.198937 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:31:46.198937 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:31:46.198937 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:31:46.198937 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:31:46.198937 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:31:46.198937 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:31:46.198937 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:31:46.198937 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:31:46.198937 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:31:46.198937 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:31:46.198937 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:31:46.198937 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:31:46.198937 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:31:46.198937 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:31:46.198937 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:31:46.198937 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:31:46.198937 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:31:46.198937 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:31:46.200175 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:31:46.200175 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:31:46.200175 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:31:46.200175 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:31:46.200175 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:31:46.200175 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:31:46.200175 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:31:46.200175 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:31:46.200175 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 18 16:31:46.200175 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:31:46.200175 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 624/1253] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:31:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:31:46.203430 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce12c1d-9688-4c26-ace5-3b78f0fcf459 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:46.258615 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:46.302445 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce12c1d-9688-4c26-ace5-3b78f0fcf459 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:46.335286 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba06c5-c8a9-4588-98bf-83a28a66e4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:46.335973 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba06c5-c8a9-4588-98bf-83a28a66e4fc None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:46.336256 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba06c5-c8a9-4588-98bf-83a28a66e4fc None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:46.336529 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba06c5-c8a9-4588-98bf-83a28a66e4fc None admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:46.337347 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ba06c5-c8a9-4588-98bf-83a28a66e4fc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:31:46.337650 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ba06c5-c8a9-4588-98bf-83a28a66e4fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:46.339065 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ba06c5-c8a9-4588-98bf-83a28a66e4fc None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:46.357050 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 630/1254] 10.222.0.81 () {56 vars in 1143 bytes} [Mon Jul 18 16:31:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:31:46.363073 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e579da3-10f2-4492-8d47-1719be4b2a89 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:46.461991 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e579da3-10f2-4492-8d47-1719be4b2a89 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:46.496179 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7443a3b3-a68b-42d2-9723-b500598c60a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:46.496827 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7443a3b3-a68b-42d2-9723-b500598c60a0 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:46.497110 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7443a3b3-a68b-42d2-9723-b500598c60a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:46.497385 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7443a3b3-a68b-42d2-9723-b500598c60a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:46.552428 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:46.564858 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7443a3b3-a68b-42d2-9723-b500598c60a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:46.566246 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7443a3b3-a68b-42d2-9723-b500598c60a0 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:46.662554 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 625/1255] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Jul 18 16:31:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 16:31:46.669010 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba06c5-c8a9-4588-98bf-83a28a66e4fc None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:46.766207 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba06c5-c8a9-4588-98bf-83a28a66e4fc None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:46.778788 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:46.798298 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1820cb6d-9b69-40ad-b53c-cc620eaf95f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:46.799612 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820cb6d-9b69-40ad-b53c-cc620eaf95f9 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:46.799988 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820cb6d-9b69-40ad-b53c-cc620eaf95f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:46.800261 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820cb6d-9b69-40ad-b53c-cc620eaf95f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:46.809866 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1820cb6d-9b69-40ad-b53c-cc620eaf95f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:46.811291 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1820cb6d-9b69-40ad-b53c-cc620eaf95f9 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:46.828898 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-1820cb6d-9b69-40ad-b53c-cc620eaf95f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:31:46.828898 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:31:46.828898 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:31:46.828898 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:31:46.828898 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:31:46.828898 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:31:46.828898 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:31:46.828898 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:31:46.828898 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:31:46.828898 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:31:46.828898 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:31:46.828898 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:31:46.828898 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:31:46.828898 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:31:46.828898 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:31:46.830496 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:31:46.830496 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:31:46.830496 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:31:46.830496 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:31:46.830496 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:31:46.830496 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:31:46.830496 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:31:46.830496 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:31:46.830496 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:31:46.830496 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:31:46.830496 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:31:46.830496 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:31:46.830496 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:31:46.830496 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:31:46.830496 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:31:46.830496 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:31:46.830496 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:31:46.831501 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:31:46.831501 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:31:46.831501 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:31:46.831501 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:31:46.831501 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 631/1256] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:31:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:31:46.835976 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7443a3b3-a68b-42d2-9723-b500598c60a0 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:46.921112 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:46.933422 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7443a3b3-a68b-42d2-9723-b500598c60a0 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:46.966670 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40188b95-77fe-4a71-9195-1f328b6b617e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:46.967326 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40188b95-77fe-4a71-9195-1f328b6b617e None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:46.967608 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40188b95-77fe-4a71-9195-1f328b6b617e None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:46.969603 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40188b95-77fe-4a71-9195-1f328b6b617e None admin] PATH_INFO: `/v3/domains` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:46.969603 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40188b95-77fe-4a71-9195-1f328b6b617e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:31:46.969603 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40188b95-77fe-4a71-9195-1f328b6b617e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:46.970341 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40188b95-77fe-4a71-9195-1f328b6b617e None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:46.981284 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 626/1257] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:31:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:31:46.987562 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1820cb6d-9b69-40ad-b53c-cc620eaf95f9 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:47.086735 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1820cb6d-9b69-40ad-b53c-cc620eaf95f9 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:47.122218 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d525f4f5-96c8-4879-b184-b9dd21c04298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:47.123076 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d525f4f5-96c8-4879-b184-b9dd21c04298 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:47.123355 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d525f4f5-96c8-4879-b184-b9dd21c04298 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:47.123626 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d525f4f5-96c8-4879-b184-b9dd21c04298 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:47.134422 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d525f4f5-96c8-4879-b184-b9dd21c04298 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:47.134422 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d525f4f5-96c8-4879-b184-b9dd21c04298 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:47.147139 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-d525f4f5-96c8-4879-b184-b9dd21c04298 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:31:47.147139 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:31:47.147139 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:31:47.147139 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:31:47.147139 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:31:47.147139 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:31:47.147139 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:31:47.147139 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:31:47.147139 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:31:47.147139 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:31:47.147139 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:31:47.147139 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:31:47.147139 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:31:47.147139 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:31:47.147139 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:31:47.148301 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:31:47.148301 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:31:47.148301 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:31:47.148301 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:31:47.148301 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:31:47.148301 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:31:47.148301 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:31:47.148301 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:31:47.148301 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:31:47.148301 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:31:47.148301 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:31:47.148301 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:31:47.148301 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:31:47.148301 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:31:47.148301 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:31:47.148301 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:31:47.148301 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:31:47.149428 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:31:47.149428 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:31:47.149428 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:31:47.149428 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:31:47.149428 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:31:47.149428 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:31:47.149428 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:31:47.149428 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:31:47.149428 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 632/1258] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Jul 18 16:31:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:31:47.154319 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40188b95-77fe-4a71-9195-1f328b6b617e None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:47.252908 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40188b95-77fe-4a71-9195-1f328b6b617e None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:47.287190 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1084a69-e0e8-404b-9881-4c03368d4fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:47.287914 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1084a69-e0e8-404b-9881-4c03368d4fc4 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:47.288202 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1084a69-e0e8-404b-9881-4c03368d4fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:47.288479 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1084a69-e0e8-404b-9881-4c03368d4fc4 None admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:47.289255 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1084a69-e0e8-404b-9881-4c03368d4fc4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:31:47.289563 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1084a69-e0e8-404b-9881-4c03368d4fc4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:47.290986 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1084a69-e0e8-404b-9881-4c03368d4fc4 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:47.303806 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 627/1259] 10.222.0.81 () {56 vars in 1148 bytes} [Mon Jul 18 16:31:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:31:47.310041 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d525f4f5-96c8-4879-b184-b9dd21c04298 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:47.337195 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:47.410983 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d525f4f5-96c8-4879-b184-b9dd21c04298 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:47.444161 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f0b7f-c5d5-4150-ac3d-d611583feabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:47.444811 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f0b7f-c5d5-4150-ac3d-d611583feabf None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:47.445096 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f0b7f-c5d5-4150-ac3d-d611583feabf None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:47.445373 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f0b7f-c5d5-4150-ac3d-d611583feabf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:47.446200 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58f0b7f-c5d5-4150-ac3d-d611583feabf None admin] RBAC: Adding query filter params (role.id=fd83eab44cb343a2b532ce32a2ac31d8, scope.project.id=9d1d84bf334d47e6bfba1141c1fc6f59, user.id=5700ad7df774415b89737c7dddcc5b2c) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:31:47.446505 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58f0b7f-c5d5-4150-ac3d-d611583feabf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:47.447957 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58f0b7f-c5d5-4150-ac3d-d611583feabf None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:47.454110 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 633/1260] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Jul 18 16:31:47 2022] GET /identity/v3/role_assignments?user.id=5700ad7df774415b89737c7dddcc5b2c&scope.project.id=9d1d84bf334d47e6bfba1141c1fc6f59&role.id=fd83eab44cb343a2b532ce32a2ac31d8 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:31:49.454838 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4febca27-b5c3-48c7-a994-c3f096d2806d None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:49.455409 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4febca27-b5c3-48c7-a994-c3f096d2806d None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:49.455409 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4febca27-b5c3-48c7-a994-c3f096d2806d None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:49.456787 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 628/1261] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:31:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:31:49.462346 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf9273-9c53-49bf-9550-dba8f7382971 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:49.462782 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf9273-9c53-49bf-9550-dba8f7382971 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:49.463415 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf9273-9c53-49bf-9550-dba8f7382971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:49.480976 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-67cf9273-9c53-49bf-9550-dba8f7382971 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:31:49.482157 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-67cf9273-9c53-49bf-9550-dba8f7382971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:31:49.550426 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 634/1262] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:31:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:31:49.573014 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4febca27-b5c3-48c7-a994-c3f096d2806d None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:49.583680 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:49.687591 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4febca27-b5c3-48c7-a994-c3f096d2806d None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:49.723850 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f2a55-cede-4133-8098-409cf2a7a941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:49.724658 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f2a55-cede-4133-8098-409cf2a7a941 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:49.724938 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f2a55-cede-4133-8098-409cf2a7a941 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:49.725212 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f2a55-cede-4133-8098-409cf2a7a941 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:49.735406 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416f2a55-cede-4133-8098-409cf2a7a941 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:31:49.743186 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-416f2a55-cede-4133-8098-409cf2a7a941 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:31:49.743186 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:31:49.743186 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:31:49.743186 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:31:49.743186 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:31:49.743186 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:31:49.743186 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:31:49.743186 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:31:49.743186 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:31:49.743186 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:31:49.743186 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:31:49.743186 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:31:49.743186 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:31:49.743186 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:31:49.743186 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:31:49.743186 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:31:49.744447 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:31:49.744447 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:31:49.744447 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:31:49.744447 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:31:49.744447 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:31:49.744447 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:31:49.744447 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:31:49.744447 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:31:49.744447 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:31:49.744447 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:31:49.744447 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:31:49.744447 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:31:49.744447 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:31:49.744447 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:31:49.744447 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:31:49.744447 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:31:49.750324 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:31:49.750324 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:31:49.750324 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:31:49.750324 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:31:49.750324 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:31:49.750324 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:31:49.750324 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:31:49.750324 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:31:49.750324 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:31:49.750324 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:31:49.750324 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:31:49.750324 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:31:49.750324 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 629/1263] 10.222.0.81 () {56 vars in 1096 bytes} [Mon Jul 18 16:31:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:31:49.751260 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cf9273-9c53-49bf-9550-dba8f7382971 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:49.770163 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:49.850127 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cf9273-9c53-49bf-9550-dba8f7382971 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:49.885129 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c4775-a4d0-477d-ab74-6777a7dd0a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:49.885784 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c4775-a4d0-477d-ab74-6777a7dd0a9c None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:49.886069 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c4775-a4d0-477d-ab74-6777a7dd0a9c None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:49.886337 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c4775-a4d0-477d-ab74-6777a7dd0a9c None admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:49.887065 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3c4775-a4d0-477d-ab74-6777a7dd0a9c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:31:49.887369 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3c4775-a4d0-477d-ab74-6777a7dd0a9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:49.888805 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3c4775-a4d0-477d-ab74-6777a7dd0a9c None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:49.897215 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 635/1264] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Jul 18 16:31:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:31:49.903217 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f2a55-cede-4133-8098-409cf2a7a941 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:49.968537 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:50.015026 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f2a55-cede-4133-8098-409cf2a7a941 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:50.050626 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad774c3f-87d8-436b-a81b-d6c85b11f914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:50.051410 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad774c3f-87d8-436b-a81b-d6c85b11f914 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:50.051688 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad774c3f-87d8-436b-a81b-d6c85b11f914 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:50.051994 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad774c3f-87d8-436b-a81b-d6c85b11f914 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:50.063215 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad774c3f-87d8-436b-a81b-d6c85b11f914 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:50.064724 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad774c3f-87d8-436b-a81b-d6c85b11f914 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:50.083142 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-ad774c3f-87d8-436b-a81b-d6c85b11f914 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:31:50.083142 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:31:50.083142 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:31:50.083142 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:31:50.083142 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:31:50.083142 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:31:50.083142 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:31:50.083142 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:31:50.083142 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:31:50.083142 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:31:50.083142 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:31:50.083142 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:31:50.083142 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:31:50.083142 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:31:50.083142 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:31:50.100908 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:31:50.100908 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:31:50.100908 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:31:50.100908 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:31:50.100908 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:31:50.100908 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:31:50.100908 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:31:50.100908 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:31:50.100908 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:31:50.100908 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:31:50.100908 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:31:50.100908 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:31:50.100908 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:31:50.100908 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:31:50.100908 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:31:50.100908 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:31:50.100908 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:31:50.101856 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:31:50.101856 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:31:50.101856 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:31:50.101856 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:31:50.101856 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 630/1265] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:31:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:31:50.102157 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c4775-a4d0-477d-ab74-6777a7dd0a9c None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:50.173469 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:50.196505 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c4775-a4d0-477d-ab74-6777a7dd0a9c None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:50.231394 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f947ee-49a8-46d7-9936-457c282e77cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:50.232099 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f947ee-49a8-46d7-9936-457c282e77cf None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:50.232383 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f947ee-49a8-46d7-9936-457c282e77cf None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:50.232661 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f947ee-49a8-46d7-9936-457c282e77cf None admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:50.233378 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f947ee-49a8-46d7-9936-457c282e77cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:31:50.233683 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f947ee-49a8-46d7-9936-457c282e77cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:50.235044 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f947ee-49a8-46d7-9936-457c282e77cf None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:50.247263 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 636/1266] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:31:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:31:50.253643 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad774c3f-87d8-436b-a81b-d6c85b11f914 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:50.368539 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad774c3f-87d8-436b-a81b-d6c85b11f914 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:50.393755 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:50.408517 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a182b-be2e-4aa8-bec5-2f8b16a8dd60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:50.409324 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a182b-be2e-4aa8-bec5-2f8b16a8dd60 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:50.409605 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a182b-be2e-4aa8-bec5-2f8b16a8dd60 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:50.409881 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a182b-be2e-4aa8-bec5-2f8b16a8dd60 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:50.418262 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3a182b-be2e-4aa8-bec5-2f8b16a8dd60 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:50.419779 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3a182b-be2e-4aa8-bec5-2f8b16a8dd60 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:50.434339 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-2f3a182b-be2e-4aa8-bec5-2f8b16a8dd60 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 18 16:31:50.434339 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:31:50.434339 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:31:50.434339 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:31:50.434339 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:31:50.434339 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:31:50.434339 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:31:50.434339 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:31:50.434339 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:31:50.434339 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:31:50.434339 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:31:50.434339 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:31:50.434339 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:31:50.434339 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:31:50.434339 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:31:50.434339 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:31:50.435506 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:31:50.435506 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:31:50.435506 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:31:50.435506 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:31:50.435506 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:31:50.435506 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:31:50.435506 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:31:50.435506 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:31:50.435506 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:31:50.435506 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:31:50.435506 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:31:50.435506 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:31:50.435506 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:31:50.435506 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:31:50.435506 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:31:50.435506 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:31:50.435506 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:31:50.435506 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:31:50.436743 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:31:50.436743 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:31:50.436743 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:31:50.436743 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:31:50.436743 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:31:50.436743 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:31:50.436743 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:31:50.436743 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:31:50.436743 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 18 16:31:50.436743 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:31:50.436743 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 631/1267] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:31:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:31:50.441541 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f947ee-49a8-46d7-9936-457c282e77cf None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:50.542904 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f947ee-49a8-46d7-9936-457c282e77cf None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:50.575439 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5dc42-6379-4726-bb22-982b2a67e483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:50.581443 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5dc42-6379-4726-bb22-982b2a67e483 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:50.581443 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5dc42-6379-4726-bb22-982b2a67e483 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:50.581443 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5dc42-6379-4726-bb22-982b2a67e483 None admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:50.581443 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d5dc42-6379-4726-bb22-982b2a67e483 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:31:50.581443 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d5dc42-6379-4726-bb22-982b2a67e483 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:50.581443 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d5dc42-6379-4726-bb22-982b2a67e483 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:50.588713 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:50.596747 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 637/1268] 10.222.0.81 () {56 vars in 1143 bytes} [Mon Jul 18 16:31:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:31:50.602765 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a182b-be2e-4aa8-bec5-2f8b16a8dd60 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:50.702570 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a182b-be2e-4aa8-bec5-2f8b16a8dd60 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:50.734632 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c8b7dd-f681-4428-9910-de2bca6bd98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:50.735412 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8b7dd-f681-4428-9910-de2bca6bd98e None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:50.736248 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8b7dd-f681-4428-9910-de2bca6bd98e None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:50.736622 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8b7dd-f681-4428-9910-de2bca6bd98e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:50.747085 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c8b7dd-f681-4428-9910-de2bca6bd98e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:50.748572 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c8b7dd-f681-4428-9910-de2bca6bd98e None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:50.766218 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-06c8b7dd-f681-4428-9910-de2bca6bd98e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:31:50.766218 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:31:50.766218 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:31:50.766218 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:31:50.766218 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:31:50.766218 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:31:50.766218 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:31:50.766218 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:31:50.766218 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:31:50.766218 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:31:50.766218 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:31:50.766218 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:31:50.766218 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:31:50.766218 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:31:50.766218 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:31:50.767339 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:31:50.767339 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:31:50.767339 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:31:50.767339 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:31:50.767339 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:31:50.767339 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:31:50.767339 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:31:50.767339 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:31:50.767339 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:31:50.767339 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:31:50.767339 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:31:50.767339 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:31:50.767339 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:31:50.767339 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:31:50.767339 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:31:50.767339 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:31:50.767339 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:31:50.768381 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:31:50.768381 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:31:50.768381 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:31:50.768381 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:31:50.768381 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 632/1269] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:31:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:31:50.773663 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5dc42-6379-4726-bb22-982b2a67e483 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:50.872785 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5dc42-6379-4726-bb22-982b2a67e483 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:50.906065 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d860999-1ec8-40df-b0af-7491015e4ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:50.906718 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d860999-1ec8-40df-b0af-7491015e4ae8 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:50.906997 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d860999-1ec8-40df-b0af-7491015e4ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:50.907271 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d860999-1ec8-40df-b0af-7491015e4ae8 None admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:50.908516 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d860999-1ec8-40df-b0af-7491015e4ae8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:31:50.908819 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d860999-1ec8-40df-b0af-7491015e4ae8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:50.910172 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d860999-1ec8-40df-b0af-7491015e4ae8 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:50.921176 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 638/1270] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:31:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:31:50.927731 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c8b7dd-f681-4428-9910-de2bca6bd98e None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:50.958479 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:51.023048 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c8b7dd-f681-4428-9910-de2bca6bd98e None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:51.056475 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b9360-09a0-490c-a14e-3dc4bedfa827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:51.057287 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b9360-09a0-490c-a14e-3dc4bedfa827 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:51.057570 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b9360-09a0-490c-a14e-3dc4bedfa827 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:51.057842 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b9360-09a0-490c-a14e-3dc4bedfa827 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:51.064328 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0b9360-09a0-490c-a14e-3dc4bedfa827 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:51.065749 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0b9360-09a0-490c-a14e-3dc4bedfa827 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:51.079060 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-8a0b9360-09a0-490c-a14e-3dc4bedfa827 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:31:51.079060 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:31:51.079060 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:31:51.079060 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:31:51.079060 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:31:51.079060 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:31:51.079060 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:31:51.079060 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:31:51.079060 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:31:51.079060 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:31:51.079060 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:31:51.079060 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:31:51.079060 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:31:51.079060 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:31:51.079060 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:31:51.080295 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:31:51.080295 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:31:51.080295 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:31:51.080295 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:31:51.080295 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:31:51.080295 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:31:51.080295 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:31:51.080295 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:31:51.080295 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:31:51.080295 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:31:51.080295 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:31:51.080295 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:31:51.080295 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:31:51.080295 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:31:51.080295 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:31:51.080295 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:31:51.080295 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:31:51.081625 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:31:51.081625 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:31:51.081625 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:31:51.081625 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:31:51.081625 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:31:51.081625 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:31:51.081625 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:31:51.081625 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:31:51.081625 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 633/1271] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Jul 18 16:31:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:31:51.086158 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d860999-1ec8-40df-b0af-7491015e4ae8 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:51.145422 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:51.186997 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d860999-1ec8-40df-b0af-7491015e4ae8 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:51.219185 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e318f7dc-e9b4-416d-8b63-507c4ae7f677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:51.219774 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e318f7dc-e9b4-416d-8b63-507c4ae7f677 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:51.220601 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e318f7dc-e9b4-416d-8b63-507c4ae7f677 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:51.220884 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e318f7dc-e9b4-416d-8b63-507c4ae7f677 None admin] PATH_INFO: `/v3/projects` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:51.221661 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e318f7dc-e9b4-416d-8b63-507c4ae7f677 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:31:51.221966 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e318f7dc-e9b4-416d-8b63-507c4ae7f677 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:51.223390 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e318f7dc-e9b4-416d-8b63-507c4ae7f677 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:51.234952 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 639/1272] 10.222.0.81 () {56 vars in 1148 bytes} [Mon Jul 18 16:31:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:31:51.241326 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b9360-09a0-490c-a14e-3dc4bedfa827 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:51.330693 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:51.338970 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b9360-09a0-490c-a14e-3dc4bedfa827 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:51.371125 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ad3ca1-b387-4f52-ba4b-2b7b94411003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:51.372021 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad3ca1-b387-4f52-ba4b-2b7b94411003 None admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:51.372302 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad3ca1-b387-4f52-ba4b-2b7b94411003 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:51.372569 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad3ca1-b387-4f52-ba4b-2b7b94411003 None admin] PATH_INFO: `/v3/projects/9d1d84bf334d47e6bfba1141c1fc6f59/users/5700ad7df774415b89737c7dddcc5b2c/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:51.374459 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ad3ca1-b387-4f52-ba4b-2b7b94411003 None admin] RBAC: Authorizing `identity:create_grant(project_id=9d1d84bf334d47e6bfba1141c1fc6f59, user_id=5700ad7df774415b89737c7dddcc5b2c, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:51.375888 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ad3ca1-b387-4f52-ba4b-2b7b94411003 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:51.501306 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 634/1273] 10.222.0.81 () {58 vars in 1439 bytes} [Mon Jul 18 16:31:51 2022] PUT /identity/v3/projects/9d1d84bf334d47e6bfba1141c1fc6f59/users/5700ad7df774415b89737c7dddcc5b2c/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:31:53.481539 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f0661-7043-4afd-9514-af4d6e38a024 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:53.551472 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f0661-7043-4afd-9514-af4d6e38a024 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:53.551472 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f0661-7043-4afd-9514-af4d6e38a024 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:53.551472 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 640/1274] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:31:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:31:53.551847 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea1177-83ce-4c8c-a432-0e489dd8a097 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:53.551847 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea1177-83ce-4c8c-a432-0e489dd8a097 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:53.551847 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea1177-83ce-4c8c-a432-0e489dd8a097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:53.551847 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-32ea1177-83ce-4c8c-a432-0e489dd8a097 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:31:53.551847 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-32ea1177-83ce-4c8c-a432-0e489dd8a097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:31:53.576960 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 635/1275] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:31:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:31:53.600461 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f0661-7043-4afd-9514-af4d6e38a024 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:53.702433 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f0661-7043-4afd-9514-af4d6e38a024 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:53.719514 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:53.736205 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cba9be5-0fc0-4874-9746-1d08cb7de6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:53.736990 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba9be5-0fc0-4874-9746-1d08cb7de6b0 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:53.737265 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba9be5-0fc0-4874-9746-1d08cb7de6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:53.737532 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba9be5-0fc0-4874-9746-1d08cb7de6b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:53.747686 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cba9be5-0fc0-4874-9746-1d08cb7de6b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:31:53.756260 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-2cba9be5-0fc0-4874-9746-1d08cb7de6b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:31:53.756260 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:31:53.756260 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:31:53.756260 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:31:53.756260 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:31:53.756260 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:31:53.756260 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:31:53.756260 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:31:53.756260 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:31:53.756260 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:31:53.756260 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:31:53.756260 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:31:53.756260 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:31:53.756260 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:31:53.756260 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:31:53.756260 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:31:53.763463 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:31:53.763463 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:31:53.763463 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:31:53.763463 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:31:53.763463 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:31:53.763463 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:31:53.763463 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:31:53.763463 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:31:53.763463 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:31:53.763463 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:31:53.763463 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:31:53.763463 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:31:53.763463 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:31:53.763463 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:31:53.763463 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:31:53.763463 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:31:53.764593 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:31:53.764593 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:31:53.764593 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:31:53.764593 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:31:53.764593 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:31:53.764593 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:31:53.764593 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:31:53.764593 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:31:53.764593 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:31:53.764593 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:31:53.764593 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:31:53.764593 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:31:53.764593 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 641/1276] 10.222.0.81 () {56 vars in 1096 bytes} [Mon Jul 18 16:31:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:31:53.765533 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ea1177-83ce-4c8c-a432-0e489dd8a097 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:53.845668 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:53.863304 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ea1177-83ce-4c8c-a432-0e489dd8a097 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:53.897003 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dd9ddc-49da-4fd3-bbe1-15a1d1a3d1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:53.897728 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd9ddc-49da-4fd3-bbe1-15a1d1a3d1cc None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:53.898006 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd9ddc-49da-4fd3-bbe1-15a1d1a3d1cc None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:53.898302 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd9ddc-49da-4fd3-bbe1-15a1d1a3d1cc None admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:53.899041 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dd9ddc-49da-4fd3-bbe1-15a1d1a3d1cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:31:53.899343 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dd9ddc-49da-4fd3-bbe1-15a1d1a3d1cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:53.900726 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dd9ddc-49da-4fd3-bbe1-15a1d1a3d1cc None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:53.909229 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 636/1277] 10.222.0.81 () {56 vars in 1099 bytes} [Mon Jul 18 16:31:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:31:53.915129 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cba9be5-0fc0-4874-9746-1d08cb7de6b0 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:54.015679 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cba9be5-0fc0-4874-9746-1d08cb7de6b0 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:54.049619 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6f8a09-5135-47ac-b101-fd3e06bb5118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:54.050402 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f8a09-5135-47ac-b101-fd3e06bb5118 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:54.050679 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f8a09-5135-47ac-b101-fd3e06bb5118 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:54.050952 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f8a09-5135-47ac-b101-fd3e06bb5118 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:54.061595 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6f8a09-5135-47ac-b101-fd3e06bb5118 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:54.063051 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6f8a09-5135-47ac-b101-fd3e06bb5118 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:54.079471 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-de6f8a09-5135-47ac-b101-fd3e06bb5118 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:31:54.079471 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:31:54.079471 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:31:54.079471 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:31:54.079471 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:31:54.079471 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:31:54.079471 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:31:54.079471 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:31:54.079471 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:31:54.079471 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:31:54.079471 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:31:54.079471 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:31:54.079471 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:31:54.079471 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:31:54.079471 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:31:54.080598 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:31:54.080598 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:31:54.080598 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:31:54.080598 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:31:54.080598 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:31:54.080598 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:31:54.080598 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:31:54.080598 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:31:54.080598 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:31:54.080598 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:31:54.080598 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:31:54.080598 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:31:54.080598 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:31:54.080598 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:31:54.080598 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:31:54.080598 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:31:54.080598 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:31:54.081617 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:31:54.081617 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:31:54.081617 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:31:54.081617 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:31:54.081617 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 642/1278] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:31:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:31:54.086545 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dd9ddc-49da-4fd3-bbe1-15a1d1a3d1cc None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:54.186215 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dd9ddc-49da-4fd3-bbe1-15a1d1a3d1cc None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:54.218263 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb7b06-dd4e-4c27-b324-5670aa0393eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:54.218916 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb7b06-dd4e-4c27-b324-5670aa0393eb None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:54.219193 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb7b06-dd4e-4c27-b324-5670aa0393eb None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:54.219461 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb7b06-dd4e-4c27-b324-5670aa0393eb None admin] PATH_INFO: `/v3/domains` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:54.220740 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fb7b06-dd4e-4c27-b324-5670aa0393eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:31:54.221037 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fb7b06-dd4e-4c27-b324-5670aa0393eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:54.222384 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fb7b06-dd4e-4c27-b324-5670aa0393eb None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:54.233521 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 637/1279] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:31:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:31:54.239410 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6f8a09-5135-47ac-b101-fd3e06bb5118 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:54.270912 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:54.338601 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6f8a09-5135-47ac-b101-fd3e06bb5118 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:54.371498 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72a2679-0e3d-470b-ab77-ed5c252d49b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:54.372320 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a2679-0e3d-470b-ab77-ed5c252d49b2 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:54.372715 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a2679-0e3d-470b-ab77-ed5c252d49b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:54.373000 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a2679-0e3d-470b-ab77-ed5c252d49b2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:54.380351 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72a2679-0e3d-470b-ab77-ed5c252d49b2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:54.389012 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72a2679-0e3d-470b-ab77-ed5c252d49b2 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:54.396949 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-a72a2679-0e3d-470b-ab77-ed5c252d49b2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 18 16:31:54.396949 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:31:54.396949 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:31:54.396949 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:31:54.396949 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:31:54.396949 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:31:54.396949 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:31:54.396949 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:31:54.396949 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:31:54.396949 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:31:54.396949 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:31:54.396949 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:31:54.396949 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:31:54.396949 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:31:54.396949 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:31:54.396949 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:31:54.398080 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:31:54.398080 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:31:54.398080 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:31:54.398080 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:31:54.398080 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:31:54.398080 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:31:54.398080 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:31:54.398080 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:31:54.398080 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:31:54.398080 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:31:54.398080 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:31:54.398080 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:31:54.398080 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:31:54.398080 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:31:54.398080 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:31:54.398080 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:31:54.398080 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:31:54.398080 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:31:54.399302 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:31:54.399302 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:31:54.399302 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:31:54.399302 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:31:54.399302 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:31:54.399302 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:31:54.399302 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:31:54.399302 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:31:54.399302 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 18 16:31:54.399302 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:31:54.399302 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 643/1280] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:31:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:31:54.404087 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb7b06-dd4e-4c27-b324-5670aa0393eb None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:54.408517 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:54.500977 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb7b06-dd4e-4c27-b324-5670aa0393eb None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:54.533661 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e316d1-7845-4302-8db4-2b540e5141a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:54.534245 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e316d1-7845-4302-8db4-2b540e5141a1 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:54.534524 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e316d1-7845-4302-8db4-2b540e5141a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:54.534797 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e316d1-7845-4302-8db4-2b540e5141a1 None admin] PATH_INFO: `/v3/users` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:54.535610 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e316d1-7845-4302-8db4-2b540e5141a1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:31:54.535946 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e316d1-7845-4302-8db4-2b540e5141a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:54.537344 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e316d1-7845-4302-8db4-2b540e5141a1 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:54.553852 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 638/1281] 10.222.0.81 () {56 vars in 1143 bytes} [Mon Jul 18 16:31:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:31:54.563689 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72a2679-0e3d-470b-ab77-ed5c252d49b2 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:54.656931 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:54.666425 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72a2679-0e3d-470b-ab77-ed5c252d49b2 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:54.699700 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85a2b6e-ff0f-463e-98dc-b5c2d1174275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:54.700373 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a2b6e-ff0f-463e-98dc-b5c2d1174275 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:54.700659 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a2b6e-ff0f-463e-98dc-b5c2d1174275 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:54.700939 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a2b6e-ff0f-463e-98dc-b5c2d1174275 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:54.766288 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85a2b6e-ff0f-463e-98dc-b5c2d1174275 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:54.768334 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85a2b6e-ff0f-463e-98dc-b5c2d1174275 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:54.856366 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:54.866558 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 644/1282] 10.222.0.81 () {58 vars in 1282 bytes} [Mon Jul 18 16:31:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 16:31:54.872495 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e316d1-7845-4302-8db4-2b540e5141a1 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:54.933430 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:54.971789 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e316d1-7845-4302-8db4-2b540e5141a1 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:55.004304 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6b86dc-c20d-4730-ab7d-ce25d4c66626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:55.005084 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b86dc-c20d-4730-ab7d-ce25d4c66626 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:55.005362 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b86dc-c20d-4730-ab7d-ce25d4c66626 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:55.005633 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b86dc-c20d-4730-ab7d-ce25d4c66626 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:55.015691 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6b86dc-c20d-4730-ab7d-ce25d4c66626 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:55.017134 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6b86dc-c20d-4730-ab7d-ce25d4c66626 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:55.033655 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-1b6b86dc-c20d-4730-ab7d-ce25d4c66626 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:31:55.033655 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:31:55.033655 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:31:55.033655 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:31:55.033655 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:31:55.033655 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:31:55.033655 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:31:55.033655 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:31:55.033655 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:31:55.033655 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:31:55.033655 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:31:55.033655 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:31:55.033655 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:31:55.033655 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:31:55.033655 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:31:55.034949 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:31:55.034949 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:31:55.034949 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:31:55.034949 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:31:55.034949 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:31:55.034949 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:31:55.034949 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:31:55.034949 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:31:55.034949 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:31:55.034949 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:31:55.034949 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:31:55.034949 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:31:55.034949 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:31:55.034949 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:31:55.034949 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:31:55.034949 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:31:55.034949 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:31:55.035944 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:31:55.035944 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:31:55.035944 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:31:55.035944 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:31:55.035944 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 639/1283] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:31:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:31:55.041112 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85a2b6e-ff0f-463e-98dc-b5c2d1174275 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:55.143136 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85a2b6e-ff0f-463e-98dc-b5c2d1174275 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:55.176312 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cea3ad-7c42-43e1-b901-c0cacd556330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:55.176962 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cea3ad-7c42-43e1-b901-c0cacd556330 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:55.177233 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cea3ad-7c42-43e1-b901-c0cacd556330 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:55.177503 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cea3ad-7c42-43e1-b901-c0cacd556330 None admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:55.178203 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cea3ad-7c42-43e1-b901-c0cacd556330 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:31:55.178506 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cea3ad-7c42-43e1-b901-c0cacd556330 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:55.179903 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cea3ad-7c42-43e1-b901-c0cacd556330 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:55.190943 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 645/1284] 10.222.0.81 () {56 vars in 1109 bytes} [Mon Jul 18 16:31:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:31:55.196670 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6b86dc-c20d-4730-ab7d-ce25d4c66626 None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:55.300257 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6b86dc-c20d-4730-ab7d-ce25d4c66626 None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:55.313826 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:55.333567 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefcafdb-4a58-48a8-9523-61c4cb84618e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:55.334408 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefcafdb-4a58-48a8-9523-61c4cb84618e None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:55.334693 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefcafdb-4a58-48a8-9523-61c4cb84618e None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:55.334968 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefcafdb-4a58-48a8-9523-61c4cb84618e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:55.341554 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefcafdb-4a58-48a8-9523-61c4cb84618e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:55.342982 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefcafdb-4a58-48a8-9523-61c4cb84618e None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:55.357532 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application [None req-eefcafdb-4a58-48a8-9523-61c4cb84618e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:31:55.357532 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:31:55.357532 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:31:55.357532 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:31:55.357532 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:31:55.357532 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:31:55.357532 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:31:55.357532 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:31:55.357532 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:31:55.357532 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:31:55.357532 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:31:55.357532 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:31:55.357532 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:31:55.357532 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:31:55.357532 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:31:55.371443 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:31:55.371443 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:31:55.371443 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:31:55.371443 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:31:55.371443 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:31:55.371443 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:31:55.371443 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:31:55.371443 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:31:55.371443 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application with Lock( Jul 18 16:31:55.371443 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:31:55.371443 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:31:55.371443 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:31:55.371443 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:31:55.371443 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:31:55.371443 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:31:55.371443 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:31:55.371443 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:31:55.372422 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:31:55.372422 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:31:55.372422 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:31:55.372422 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:31:55.372422 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:31:55.372422 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:31:55.372422 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:31:55.372422 dv-cinder-846173-3-smb devstack@keystone.service[80545]: ERROR keystone.server.flask.application Jul 18 16:31:55.372422 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 640/1285] 10.222.0.81 () {56 vars in 1111 bytes} [Mon Jul 18 16:31:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:31:55.372960 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cea3ad-7c42-43e1-b901-c0cacd556330 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:55.416807 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:55.468207 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cea3ad-7c42-43e1-b901-c0cacd556330 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:55.502626 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e58d7e1-03a9-48fc-b6da-b744567ee882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:55.503537 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58d7e1-03a9-48fc-b6da-b744567ee882 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:55.503854 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58d7e1-03a9-48fc-b6da-b744567ee882 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:55.504132 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58d7e1-03a9-48fc-b6da-b744567ee882 None admin] PATH_INFO: `/v3/projects` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:55.504908 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e58d7e1-03a9-48fc-b6da-b744567ee882 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:31:55.505213 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e58d7e1-03a9-48fc-b6da-b744567ee882 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:55.506950 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e58d7e1-03a9-48fc-b6da-b744567ee882 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:55.520692 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 646/1286] 10.222.0.81 () {56 vars in 1148 bytes} [Mon Jul 18 16:31:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:31:55.527024 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefcafdb-4a58-48a8-9523-61c4cb84618e None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:55.626809 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefcafdb-4a58-48a8-9523-61c4cb84618e None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:55.661189 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db4a00d-2152-409f-a227-d02a9c470224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:55.661667 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4a00d-2152-409f-a227-d02a9c470224 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:55.661946 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4a00d-2152-409f-a227-d02a9c470224 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:55.662210 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4a00d-2152-409f-a227-d02a9c470224 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:55.663033 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db4a00d-2152-409f-a227-d02a9c470224 None admin] RBAC: Adding query filter params (role.id=fd83eab44cb343a2b532ce32a2ac31d8, scope.project.id=9d1d84bf334d47e6bfba1141c1fc6f59, user.id=5700ad7df774415b89737c7dddcc5b2c) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:31:55.663340 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db4a00d-2152-409f-a227-d02a9c470224 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:55.664790 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db4a00d-2152-409f-a227-d02a9c470224 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:55.681249 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 641/1287] 10.222.0.81 () {56 vars in 1374 bytes} [Mon Jul 18 16:31:55 2022] GET /identity/v3/role_assignments?user.id=5700ad7df774415b89737c7dddcc5b2c&scope.project.id=9d1d84bf334d47e6bfba1141c1fc6f59&role.id=fd83eab44cb343a2b532ce32a2ac31d8 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:31:57.757774 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911975e-9bf8-4be9-8e92-97b9db994046 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:57.758346 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911975e-9bf8-4be9-8e92-97b9db994046 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:57.758346 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911975e-9bf8-4be9-8e92-97b9db994046 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:57.759729 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 647/1288] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:31:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:31:57.764900 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012fa7d-631e-4137-899a-96f03cfeb7f5 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:57.765334 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012fa7d-631e-4137-899a-96f03cfeb7f5 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:57.765444 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012fa7d-631e-4137-899a-96f03cfeb7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:57.782243 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-d012fa7d-631e-4137-899a-96f03cfeb7f5 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:31:57.783443 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-d012fa7d-631e-4137-899a-96f03cfeb7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:31:57.812042 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:57.849198 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 642/1289] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:31:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:31:57.871267 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911975e-9bf8-4be9-8e92-97b9db994046 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:57.981167 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911975e-9bf8-4be9-8e92-97b9db994046 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:57.992013 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:58.014771 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae69bb-ec19-4ebb-8c81-5ee2f394ddfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:58.015488 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae69bb-ec19-4ebb-8c81-5ee2f394ddfc None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:58.015797 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae69bb-ec19-4ebb-8c81-5ee2f394ddfc None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:58.016096 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae69bb-ec19-4ebb-8c81-5ee2f394ddfc None admin] PATH_INFO: `/v3/services/placement` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:58.016704 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ae69bb-ec19-4ebb-8c81-5ee2f394ddfc None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:58.018051 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ae69bb-ec19-4ebb-8c81-5ee2f394ddfc None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:58.029445 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-57ae69bb-ec19-4ebb-8c81-5ee2f394ddfc None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 16:31:58.029445 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:31:58.029445 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 16:31:58.029445 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 16:31:58.029445 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 16:31:58.029445 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 16:31:58.029445 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 16:31:58.029445 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:31:58.029445 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 16:31:58.029445 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:31:58.029445 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 16:31:58.029445 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:31:58.029445 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:31:58.029445 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:31:58.029445 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:31:58.029445 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:31:58.029445 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:31:58.030739 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:31:58.030739 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:31:58.030739 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:31:58.030739 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:31:58.030739 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:31:58.030739 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:31:58.030739 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 16:31:58.030739 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 16:31:58.030739 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 16:31:58.030739 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 16:31:58.030739 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:31:58.030739 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:31:58.030739 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:31:58.030739 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:31:58.030739 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:31:58.030739 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:31:58.031977 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:31:58.031977 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:31:58.031977 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:31:58.031977 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:31:58.031977 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:31:58.031977 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:31:58.031977 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:31:58.031977 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:31:58.031977 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:31:58.031977 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:31:58.031977 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 16:31:58.031977 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:31:58.031977 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 16:31:58.031977 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:31:58.031977 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 648/1290] 10.222.0.81 () {56 vars in 1117 bytes} [Mon Jul 18 16:31:57 2022] GET /identity/v3/services/placement => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:31:58.036945 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d012fa7d-631e-4137-899a-96f03cfeb7f5 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:58.140617 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d012fa7d-631e-4137-899a-96f03cfeb7f5 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:58.174839 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81950fea-5cc2-4206-868f-0f32c1c99585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:58.175495 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81950fea-5cc2-4206-868f-0f32c1c99585 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:58.175802 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81950fea-5cc2-4206-868f-0f32c1c99585 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:58.176078 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81950fea-5cc2-4206-868f-0f32c1c99585 None admin] PATH_INFO: `/v3/services` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:58.176769 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81950fea-5cc2-4206-868f-0f32c1c99585 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:31:58.177072 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81950fea-5cc2-4206-868f-0f32c1c99585 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:58.178424 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81950fea-5cc2-4206-868f-0f32c1c99585 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:58.183201 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 643/1291] 10.222.0.81 () {56 vars in 1116 bytes} [Mon Jul 18 16:31:58 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:31:58.189728 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae69bb-ec19-4ebb-8c81-5ee2f394ddfc None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:58.290188 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae69bb-ec19-4ebb-8c81-5ee2f394ddfc None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:58.323430 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32948d2-c963-4c57-b82a-b529c3734889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:58.324108 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32948d2-c963-4c57-b82a-b529c3734889 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:58.324388 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32948d2-c963-4c57-b82a-b529c3734889 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:58.324661 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32948d2-c963-4c57-b82a-b529c3734889 None admin] PATH_INFO: `/v3/services` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:58.325347 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32948d2-c963-4c57-b82a-b529c3734889 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:31:58.325648 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32948d2-c963-4c57-b82a-b529c3734889 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:58.327018 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32948d2-c963-4c57-b82a-b529c3734889 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:58.331370 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 649/1292] 10.222.0.81 () {56 vars in 1116 bytes} [Mon Jul 18 16:31:58 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:32:00.326716 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155c012-c685-4803-825b-2065aae19dc9 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:32:00.327251 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155c012-c685-4803-825b-2065aae19dc9 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:32:00.327251 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155c012-c685-4803-825b-2065aae19dc9 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:32:00.328666 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 644/1293] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:32:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:32:00.334168 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7834ff-fe1c-4feb-92ad-2a452b604e1d None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:32:00.334607 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7834ff-fe1c-4feb-92ad-2a452b604e1d None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:32:00.334706 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7834ff-fe1c-4feb-92ad-2a452b604e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:32:00.352146 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-2a7834ff-fe1c-4feb-92ad-2a452b604e1d None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:32:00.353340 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-2a7834ff-fe1c-4feb-92ad-2a452b604e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:32:00.384543 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:32:00.422181 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 650/1294] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:32:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:32:00.444473 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155c012-c685-4803-825b-2065aae19dc9 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:32:00.476506 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:32:00.551567 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155c012-c685-4803-825b-2065aae19dc9 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:32:00.584304 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70208c8-8ea4-4cd4-b34c-1f9ba2bb13cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:32:00.584897 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70208c8-8ea4-4cd4-b34c-1f9ba2bb13cb None admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:32:00.585178 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70208c8-8ea4-4cd4-b34c-1f9ba2bb13cb None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:32:00.585450 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70208c8-8ea4-4cd4-b34c-1f9ba2bb13cb None admin] PATH_INFO: `/v3/services` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:32:00.586163 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70208c8-8ea4-4cd4-b34c-1f9ba2bb13cb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:32:00.587516 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70208c8-8ea4-4cd4-b34c-1f9ba2bb13cb None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:32:00.677945 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 645/1295] 10.222.0.81 () {60 vars in 1141 bytes} [Mon Jul 18 16:32:00 2022] POST /identity/v3/services => generated 246 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:32:02.714147 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b983f8-c5b6-4155-a0b0-dec4057f2309 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:32:02.714713 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b983f8-c5b6-4155-a0b0-dec4057f2309 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:32:02.714713 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b983f8-c5b6-4155-a0b0-dec4057f2309 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:32:02.716046 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 651/1296] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:32:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:32:02.721507 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb9a71-1adb-4fcf-afd7-8e1eebd1fd6d None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:32:02.724768 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb9a71-1adb-4fcf-afd7-8e1eebd1fd6d None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:32:02.724768 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb9a71-1adb-4fcf-afd7-8e1eebd1fd6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:32:02.739430 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-6fcb9a71-1adb-4fcf-afd7-8e1eebd1fd6d None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:32:02.740709 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-6fcb9a71-1adb-4fcf-afd7-8e1eebd1fd6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:32:02.818041 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 646/1297] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:32:02 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:32:02.841043 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b983f8-c5b6-4155-a0b0-dec4057f2309 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:32:02.956627 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b983f8-c5b6-4155-a0b0-dec4057f2309 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:32:02.994443 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa4f47-f0f4-4576-8fc5-b89bfed5e796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:32:02.995244 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa4f47-f0f4-4576-8fc5-b89bfed5e796 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:32:02.995536 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa4f47-f0f4-4576-8fc5-b89bfed5e796 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:32:02.995833 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa4f47-f0f4-4576-8fc5-b89bfed5e796 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:32:02.996483 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fa4f47-f0f4-4576-8fc5-b89bfed5e796 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:32:02.997912 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fa4f47-f0f4-4576-8fc5-b89bfed5e796 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:32:03.010067 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-e5fa4f47-f0f4-4576-8fc5-b89bfed5e796 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 16:32:03.010067 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:32:03.010067 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 16:32:03.010067 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 16:32:03.010067 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 16:32:03.010067 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 16:32:03.010067 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 16:32:03.010067 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:32:03.010067 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 16:32:03.010067 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:32:03.010067 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 16:32:03.010067 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:32:03.010067 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:32:03.010067 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:32:03.010067 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:32:03.010067 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:32:03.010067 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:32:03.011265 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:32:03.011265 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:32:03.011265 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:32:03.011265 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:32:03.011265 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:32:03.011265 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:32:03.011265 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 16:32:03.011265 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 16:32:03.011265 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 16:32:03.011265 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 16:32:03.011265 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:32:03.011265 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:32:03.011265 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:32:03.011265 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:32:03.011265 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:32:03.011265 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:32:03.012224 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:32:03.012224 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:32:03.012224 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:32:03.012224 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:32:03.012224 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:32:03.012224 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:32:03.012224 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:32:03.012224 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:32:03.012224 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:32:03.012224 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:32:03.012224 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 16:32:03.012224 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:32:03.012224 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 16:32:03.012224 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:32:03.012224 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 652/1298] 10.222.0.81 () {56 vars in 1117 bytes} [Mon Jul 18 16:32:02 2022] GET /identity/v3/services/placement => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:32:03.017689 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcb9a71-1adb-4fcf-afd7-8e1eebd1fd6d None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:32:03.036153 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:32:03.117257 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcb9a71-1adb-4fcf-afd7-8e1eebd1fd6d None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:32:03.150576 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a712899-62e3-4aba-b8d9-fea6526d241c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:32:03.151243 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a712899-62e3-4aba-b8d9-fea6526d241c None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:32:03.151529 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a712899-62e3-4aba-b8d9-fea6526d241c None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:32:03.151853 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a712899-62e3-4aba-b8d9-fea6526d241c None admin] PATH_INFO: `/v3/services` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:32:03.152646 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a712899-62e3-4aba-b8d9-fea6526d241c None admin] RBAC: Adding query filter params (name=placement) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:32:03.152959 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a712899-62e3-4aba-b8d9-fea6526d241c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:32:03.154320 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a712899-62e3-4aba-b8d9-fea6526d241c None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:32:03.160196 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 647/1299] 10.222.0.81 () {56 vars in 1116 bytes} [Mon Jul 18 16:32:03 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:32:03.168793 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa4f47-f0f4-4576-8fc5-b89bfed5e796 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:32:03.212616 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:32:03.287592 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa4f47-f0f4-4576-8fc5-b89bfed5e796 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:32:03.322537 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff42333-99c1-468a-823a-dc855f779f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:32:03.325215 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff42333-99c1-468a-823a-dc855f779f29 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:32:03.325215 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff42333-99c1-468a-823a-dc855f779f29 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:32:03.325215 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff42333-99c1-468a-823a-dc855f779f29 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:32:03.325215 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff42333-99c1-468a-823a-dc855f779f29 None admin] RBAC: Adding query filter params (interface=public, service_id=c4644f3e90d646f186b9683a45058d26, region_id=RegionOne) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:32:03.325215 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff42333-99c1-468a-823a-dc855f779f29 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:32:03.326192 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff42333-99c1-468a-823a-dc855f779f29 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:32:03.331490 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 653/1300] 10.222.0.81 () {56 vars in 1251 bytes} [Mon Jul 18 16:32:03 2022] GET /identity/v3/endpoints?service_id=c4644f3e90d646f186b9683a45058d26&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:32:03.337289 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a712899-62e3-4aba-b8d9-fea6526d241c None admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:32:03.437756 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a712899-62e3-4aba-b8d9-fea6526d241c None admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:32:03.472690 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ae42aa-ac9c-48c5-84df-61aa31b2bb34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:32:03.473370 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae42aa-ac9c-48c5-84df-61aa31b2bb34 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:32:03.473652 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae42aa-ac9c-48c5-84df-61aa31b2bb34 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:32:03.473927 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae42aa-ac9c-48c5-84df-61aa31b2bb34 None admin] PATH_INFO: `/v3/services` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:32:03.474609 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ae42aa-ac9c-48c5-84df-61aa31b2bb34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:32:03.476057 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ae42aa-ac9c-48c5-84df-61aa31b2bb34 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:32:03.480573 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:32:03.485283 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 648/1301] 10.222.0.81 () {56 vars in 1087 bytes} [Mon Jul 18 16:32:03 2022] GET /identity/v3/services => generated 2191 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:32:05.529393 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba19fd0-2ec2-40af-b4e2-81f69c705f02 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:32:05.529947 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba19fd0-2ec2-40af-b4e2-81f69c705f02 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:32:05.529947 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba19fd0-2ec2-40af-b4e2-81f69c705f02 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:32:05.531316 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 654/1302] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:32:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:32:05.537063 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44842383-0d7b-486e-ad83-d9917b192407 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:32:05.537497 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44842383-0d7b-486e-ad83-d9917b192407 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:32:05.537621 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44842383-0d7b-486e-ad83-d9917b192407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:32:05.554242 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-44842383-0d7b-486e-ad83-d9917b192407 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:32:05.555433 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-44842383-0d7b-486e-ad83-d9917b192407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:32:05.621826 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 649/1303] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:32:05 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:32:05.645942 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba19fd0-2ec2-40af-b4e2-81f69c705f02 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:32:05.745317 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:32:05.763246 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba19fd0-2ec2-40af-b4e2-81f69c705f02 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:32:05.785715 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c624cec2-54a3-4741-b126-c278e774f452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:32:05.786498 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624cec2-54a3-4741-b126-c278e774f452 None admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:32:05.786777 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624cec2-54a3-4741-b126-c278e774f452 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:32:05.787046 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624cec2-54a3-4741-b126-c278e774f452 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:32:05.787690 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c624cec2-54a3-4741-b126-c278e774f452 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:32:05.789089 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c624cec2-54a3-4741-b126-c278e774f452 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:32:05.800753 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application [None req-c624cec2-54a3-4741-b126-c278e774f452 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 16:32:05.800753 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:32:05.800753 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 16:32:05.800753 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 16:32:05.800753 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 16:32:05.800753 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 16:32:05.800753 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 16:32:05.800753 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:32:05.800753 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 16:32:05.800753 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:32:05.800753 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 16:32:05.800753 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:32:05.800753 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:32:05.800753 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:32:05.800753 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:32:05.800753 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:32:05.800753 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:32:05.805130 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:32:05.805130 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:32:05.805130 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:32:05.805130 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:32:05.805130 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:32:05.805130 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:32:05.805130 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 16:32:05.805130 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 16:32:05.805130 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 16:32:05.805130 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 16:32:05.805130 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:32:05.805130 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:32:05.805130 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:32:05.805130 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:32:05.805130 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:32:05.805130 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:32:05.806172 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:32:05.806172 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application with Lock( Jul 18 16:32:05.806172 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:32:05.806172 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:32:05.806172 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:32:05.806172 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:32:05.806172 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:32:05.806172 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:32:05.806172 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:32:05.806172 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:32:05.806172 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 16:32:05.806172 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:32:05.806172 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 16:32:05.806172 dv-cinder-846173-3-smb devstack@keystone.service[80544]: ERROR keystone.server.flask.application Jul 18 16:32:05.806172 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 655/1304] 10.222.0.81 () {56 vars in 1117 bytes} [Mon Jul 18 16:32:05 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:32:05.808319 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44842383-0d7b-486e-ad83-d9917b192407 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:32:05.885007 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:32:05.907193 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44842383-0d7b-486e-ad83-d9917b192407 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:32:05.941134 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5d3905-f379-4b94-a66e-72050998aea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:32:05.941803 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d3905-f379-4b94-a66e-72050998aea5 None admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:32:05.942088 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d3905-f379-4b94-a66e-72050998aea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:32:05.942366 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d3905-f379-4b94-a66e-72050998aea5 None admin] PATH_INFO: `/v3/services` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:32:05.943075 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5d3905-f379-4b94-a66e-72050998aea5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:32:05.943386 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5d3905-f379-4b94-a66e-72050998aea5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:32:05.944798 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5d3905-f379-4b94-a66e-72050998aea5 None admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:32:05.950487 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 650/1305] 10.222.0.81 () {56 vars in 1116 bytes} [Mon Jul 18 16:32:05 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:32:05.958079 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c624cec2-54a3-4741-b126-c278e774f452 None admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:32:06.060953 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c624cec2-54a3-4741-b126-c278e774f452 None admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:32:06.094346 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3d81ae-5884-4d90-81b5-50cf434d2e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:32:06.095035 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d81ae-5884-4d90-81b5-50cf434d2e62 None admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:32:06.095318 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d81ae-5884-4d90-81b5-50cf434d2e62 None admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:32:06.095601 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d81ae-5884-4d90-81b5-50cf434d2e62 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:32:06.096439 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3d81ae-5884-4d90-81b5-50cf434d2e62 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:32:06.097801 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3d81ae-5884-4d90-81b5-50cf434d2e62 None admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:32:06.284654 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 656/1306] 10.222.0.81 () {60 vars in 1144 bytes} [Mon Jul 18 16:32:05 2022] POST /identity/v3/endpoints => generated 331 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:32:15.986898 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=30 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:32:16.279901 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:40:48.368284 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67997a9-4aa3-48ed-8652-8a8409b0c685 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:40:48.368284 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67997a9-4aa3-48ed-8652-8a8409b0c685 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:40:48.368284 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67997a9-4aa3-48ed-8652-8a8409b0c685 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:40:48.369427 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35cabbc-c206-4b0c-aa20-a51405fd7ac4 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:40:48.369841 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35cabbc-c206-4b0c-aa20-a51405fd7ac4 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:40:48.369980 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35cabbc-c206-4b0c-aa20-a51405fd7ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:40:48.373832 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 651/1307] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:40:48 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:40:48.470264 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-b35cabbc-c206-4b0c-aa20-a51405fd7ac4 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:40:48.472404 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-b35cabbc-c206-4b0c-aa20-a51405fd7ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:40:48.600999 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 657/1308] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:40:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:40:48.654493 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649068c-5856-44c8-a99c-4b0f57c2b4d1 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:40:48.655055 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649068c-5856-44c8-a99c-4b0f57c2b4d1 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:40:48.655487 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649068c-5856-44c8-a99c-4b0f57c2b4d1 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:40:48.657267 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 652/1309] 10.222.0.81 () {54 vars in 965 bytes} [Mon Jul 18 16:40:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:40:48.664297 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cfc98a-ce2c-428c-a05b-ee6fe1f765e1 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:40:48.665025 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cfc98a-ce2c-428c-a05b-ee6fe1f765e1 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:40:48.665423 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cfc98a-ce2c-428c-a05b-ee6fe1f765e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:40:48.816660 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-e2cfc98a-ce2c-428c-a05b-ee6fe1f765e1 None None] MFA Rules not processed for user `b742c540de6545249fe3245047d00c81`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:40:48.819136 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-e2cfc98a-ce2c-428c-a05b-ee6fe1f765e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:40:48.877472 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:40:48.954486 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 658/1310] 10.222.0.81 () {58 vars in 1062 bytes} [Mon Jul 18 16:40:48 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:40:48.962999 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f649068c-5856-44c8-a99c-4b0f57c2b4d1 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:40:48.964750 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-f649068c-5856-44c8-a99c-4b0f57c2b4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:40:49.092541 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f649068c-5856-44c8-a99c-4b0f57c2b4d1 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:40:49.182313 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bfdb9e-d3f0-4c0e-a30a-64d1ef4fe242 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:40:49.183231 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bfdb9e-d3f0-4c0e-a30a-64d1ef4fe242 service neutron] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:40:49.183691 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bfdb9e-d3f0-4c0e-a30a-64d1ef4fe242 service neutron] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:40:49.184156 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bfdb9e-d3f0-4c0e-a30a-64d1ef4fe242 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:40:49.185957 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-02bfdb9e-d3f0-4c0e-a30a-64d1ef4fe242 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:40:49.244233 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:40:49.305289 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bfdb9e-d3f0-4c0e-a30a-64d1ef4fe242 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:40:49.306773 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bfdb9e-d3f0-4c0e-a30a-64d1ef4fe242 service neutron] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:40:49.328992 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 653/1311] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:40:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:40:51.649748 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49b42c-7540-4148-9c8d-3eff114a9799 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:40:51.650337 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49b42c-7540-4148-9c8d-3eff114a9799 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:40:51.650434 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49b42c-7540-4148-9c8d-3eff114a9799 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:40:51.652023 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 659/1312] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:40:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:40:51.657942 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2119e0f-e0bd-4875-b9f7-7258d08f40e1 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:40:51.658481 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2119e0f-e0bd-4875-b9f7-7258d08f40e1 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:40:51.658481 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2119e0f-e0bd-4875-b9f7-7258d08f40e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:40:51.747841 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-c2119e0f-e0bd-4875-b9f7-7258d08f40e1 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:40:51.749120 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-c2119e0f-e0bd-4875-b9f7-7258d08f40e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:40:51.854565 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 654/1313] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:40:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:40:51.909301 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63caa5a-b2a8-4718-9f3f-9f2c2cbcad68 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:40:51.909618 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63caa5a-b2a8-4718-9f3f-9f2c2cbcad68 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:40:51.909904 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63caa5a-b2a8-4718-9f3f-9f2c2cbcad68 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:40:51.911300 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 660/1314] 10.222.0.81 () {54 vars in 965 bytes} [Mon Jul 18 16:40:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:40:51.917573 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb96b1-364d-4d1e-811c-df9ee5548752 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:40:51.917866 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb96b1-364d-4d1e-811c-df9ee5548752 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:40:51.918144 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb96b1-364d-4d1e-811c-df9ee5548752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:40:51.929295 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:40:51.996406 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-0beb96b1-364d-4d1e-811c-df9ee5548752 None None] MFA Rules not processed for user `b742c540de6545249fe3245047d00c81`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:40:52.118061 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-0beb96b1-364d-4d1e-811c-df9ee5548752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:40:52.118061 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 655/1315] 10.222.0.81 () {58 vars in 1062 bytes} [Mon Jul 18 16:40:51 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:40:52.118840 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63caa5a-b2a8-4718-9f3f-9f2c2cbcad68 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:40:52.118840 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-e63caa5a-b2a8-4718-9f3f-9f2c2cbcad68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:40:52.202005 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63caa5a-b2a8-4718-9f3f-9f2c2cbcad68 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:40:52.274428 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:40:52.276788 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8befd134-51fd-4e3b-833c-7ded2675e111 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:40:52.277435 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8befd134-51fd-4e3b-833c-7ded2675e111 service neutron] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:40:52.277720 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8befd134-51fd-4e3b-833c-7ded2675e111 service neutron] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:40:52.277999 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8befd134-51fd-4e3b-833c-7ded2675e111 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:40:52.279626 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-8befd134-51fd-4e3b-833c-7ded2675e111 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:40:52.398319 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8befd134-51fd-4e3b-833c-7ded2675e111 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:40:52.399648 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8befd134-51fd-4e3b-833c-7ded2675e111 service neutron] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:40:52.417927 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 661/1316] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:40:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:40:55.235819 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca41131-bd2b-428f-b994-4a37c64b0476 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:40:55.236321 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca41131-bd2b-428f-b994-4a37c64b0476 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:40:55.236426 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca41131-bd2b-428f-b994-4a37c64b0476 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:40:55.238640 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 656/1317] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:40:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:40:55.243655 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d13fde-4037-4aaf-ab4c-846e72b11962 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:40:55.244130 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d13fde-4037-4aaf-ab4c-846e72b11962 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:40:55.244230 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d13fde-4037-4aaf-ab4c-846e72b11962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:40:55.308843 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-c4d13fde-4037-4aaf-ab4c-846e72b11962 None None] MFA Rules not processed for user `c43109bed5da4b9d873232adae450346`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:40:55.310048 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-c4d13fde-4037-4aaf-ab4c-846e72b11962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:40:55.360778 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:40:55.405213 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 662/1318] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:40:55 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:40:55.446435 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca41131-bd2b-428f-b994-4a37c64b0476 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:40:55.451933 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-5ca41131-bd2b-428f-b994-4a37c64b0476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:40:55.555819 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca41131-bd2b-428f-b994-4a37c64b0476 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:40:55.558656 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:40:55.628993 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a6715e-1288-4f74-bff6-ee70b17c7495 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:40:55.629638 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a6715e-1288-4f74-bff6-ee70b17c7495 service neutron] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:40:55.629919 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a6715e-1288-4f74-bff6-ee70b17c7495 service neutron] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:40:55.630187 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a6715e-1288-4f74-bff6-ee70b17c7495 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:40:55.632136 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-34a6715e-1288-4f74-bff6-ee70b17c7495 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:40:55.737742 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a6715e-1288-4f74-bff6-ee70b17c7495 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:40:55.739731 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a6715e-1288-4f74-bff6-ee70b17c7495 service neutron] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:40:55.767753 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 657/1319] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:40:55 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:40:58.749073 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c9d23-202e-4c7a-87fa-3ac414cfffc5 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:40:58.749625 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c9d23-202e-4c7a-87fa-3ac414cfffc5 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:40:58.749625 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c9d23-202e-4c7a-87fa-3ac414cfffc5 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:40:58.750984 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 663/1320] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:40:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:40:58.756856 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e54725-8df1-4513-bb8f-716cc907567c None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:40:58.757288 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e54725-8df1-4513-bb8f-716cc907567c None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:40:58.757402 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e54725-8df1-4513-bb8f-716cc907567c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:40:58.796119 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:40:58.821131 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-44e54725-8df1-4513-bb8f-716cc907567c None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:40:58.822357 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-44e54725-8df1-4513-bb8f-716cc907567c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:40:58.916716 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 658/1321] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:40:58 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:40:58.955294 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8c9d23-202e-4c7a-87fa-3ac414cfffc5 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:40:58.956884 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-cd8c9d23-202e-4c7a-87fa-3ac414cfffc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:40:59.061649 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8c9d23-202e-4c7a-87fa-3ac414cfffc5 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:40:59.138462 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e59b39b-40ba-4e88-90dd-7e96f24757f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:40:59.139116 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e59b39b-40ba-4e88-90dd-7e96f24757f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:40:59.139397 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e59b39b-40ba-4e88-90dd-7e96f24757f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:40:59.139669 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e59b39b-40ba-4e88-90dd-7e96f24757f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:40:59.141389 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-9e59b39b-40ba-4e88-90dd-7e96f24757f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:40:59.148902 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:40:59.249587 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e59b39b-40ba-4e88-90dd-7e96f24757f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:40:59.251000 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e59b39b-40ba-4e88-90dd-7e96f24757f2 service neutron] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:40:59.270144 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 664/1322] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:40:58 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:41:02.482972 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545252e7-d4b1-4b06-8b6a-ee6289a95217 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:41:02.483498 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545252e7-d4b1-4b06-8b6a-ee6289a95217 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:41:02.483595 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545252e7-d4b1-4b06-8b6a-ee6289a95217 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:41:02.484948 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 659/1323] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:41:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:41:02.490720 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d5cc9d-434f-4323-bdfd-46f04944fb38 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:41:02.497488 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d5cc9d-434f-4323-bdfd-46f04944fb38 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:41:02.497488 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d5cc9d-434f-4323-bdfd-46f04944fb38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:41:02.562077 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-72d5cc9d-434f-4323-bdfd-46f04944fb38 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:41:02.563309 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-72d5cc9d-434f-4323-bdfd-46f04944fb38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:41:02.631067 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:41:02.673646 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 665/1324] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:41:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:41:02.711276 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545252e7-d4b1-4b06-8b6a-ee6289a95217 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:41:02.712986 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-545252e7-d4b1-4b06-8b6a-ee6289a95217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:41:02.834819 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545252e7-d4b1-4b06-8b6a-ee6289a95217 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:41:02.849329 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:41:02.920326 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429a89a1-7eb3-497c-8ec2-c657d4b6d14f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:41:02.921158 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a89a1-7eb3-497c-8ec2-c657d4b6d14f service neutron] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:41:02.921445 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a89a1-7eb3-497c-8ec2-c657d4b6d14f service neutron] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:41:02.921716 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a89a1-7eb3-497c-8ec2-c657d4b6d14f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:41:02.923431 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-429a89a1-7eb3-497c-8ec2-c657d4b6d14f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:41:03.042263 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429a89a1-7eb3-497c-8ec2-c657d4b6d14f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:41:03.043726 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429a89a1-7eb3-497c-8ec2-c657d4b6d14f service neutron] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:41:03.062309 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 660/1325] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:41:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:41:05.217637 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d009512-651a-467f-9d2d-6a0eeae3fa60 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:41:05.218174 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d009512-651a-467f-9d2d-6a0eeae3fa60 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:41:05.218174 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d009512-651a-467f-9d2d-6a0eeae3fa60 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:41:05.219575 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 666/1326] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:41:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:41:05.225839 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba72440-7ff6-476f-928c-192ea2ac2857 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:41:05.226299 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba72440-7ff6-476f-928c-192ea2ac2857 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:41:05.226575 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba72440-7ff6-476f-928c-192ea2ac2857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:41:05.276526 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:41:05.296152 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-7ba72440-7ff6-476f-928c-192ea2ac2857 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:41:05.297380 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-7ba72440-7ff6-476f-928c-192ea2ac2857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:41:05.395670 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 661/1327] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:41:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:41:05.432580 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d009512-651a-467f-9d2d-6a0eeae3fa60 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:41:05.434091 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-9d009512-651a-467f-9d2d-6a0eeae3fa60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:41:05.546337 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d009512-651a-467f-9d2d-6a0eeae3fa60 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:41:05.619740 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed0659a-c662-4af3-82c6-5e060f94fe38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:41:05.620380 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0659a-c662-4af3-82c6-5e060f94fe38 service neutron] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:41:05.620754 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0659a-c662-4af3-82c6-5e060f94fe38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:41:05.620931 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0659a-c662-4af3-82c6-5e060f94fe38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:41:05.622552 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-0ed0659a-c662-4af3-82c6-5e060f94fe38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:41:05.639902 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:41:05.738092 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed0659a-c662-4af3-82c6-5e060f94fe38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:41:05.739505 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed0659a-c662-4af3-82c6-5e060f94fe38 service neutron] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:41:05.758114 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 667/1328] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:41:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:41:07.986326 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0c4f0-3801-421d-b570-a6d6f03cb907 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:41:07.987488 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0c4f0-3801-421d-b570-a6d6f03cb907 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:41:07.987488 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0c4f0-3801-421d-b570-a6d6f03cb907 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:41:07.988899 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 662/1329] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:41:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:41:07.995137 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc97343-dc7c-4c1b-9308-cdee5439b9a6 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:41:07.995693 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc97343-dc7c-4c1b-9308-cdee5439b9a6 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:41:07.995693 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc97343-dc7c-4c1b-9308-cdee5439b9a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:41:08.066977 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-fdc97343-dc7c-4c1b-9308-cdee5439b9a6 None None] MFA Rules not processed for user `c43109bed5da4b9d873232adae450346`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:41:08.068230 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-fdc97343-dc7c-4c1b-9308-cdee5439b9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:41:08.138351 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:41:08.172570 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 668/1330] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:41:07 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:41:08.210179 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f0c4f0-3801-421d-b570-a6d6f03cb907 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:41:08.211755 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-b6f0c4f0-3801-421d-b570-a6d6f03cb907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:41:08.319739 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f0c4f0-3801-421d-b570-a6d6f03cb907 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:41:08.339913 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:41:08.404555 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c1c31-69a8-43fa-83bc-01c33f45ce47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:41:08.405208 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c1c31-69a8-43fa-83bc-01c33f45ce47 service neutron] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:41:08.405486 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c1c31-69a8-43fa-83bc-01c33f45ce47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:41:08.405758 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c1c31-69a8-43fa-83bc-01c33f45ce47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:41:08.407407 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-0c4c1c31-69a8-43fa-83bc-01c33f45ce47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:41:08.519954 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4c1c31-69a8-43fa-83bc-01c33f45ce47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:41:08.521390 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4c1c31-69a8-43fa-83bc-01c33f45ce47 service neutron] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:41:08.541435 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 663/1331] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:41:08 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:41:11.107359 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ad71a-2e39-4b67-8030-d6d4424e1a1f None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:41:11.107929 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ad71a-2e39-4b67-8030-d6d4424e1a1f None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:41:11.108048 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ad71a-2e39-4b67-8030-d6d4424e1a1f None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:41:11.109370 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 669/1332] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:41:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:41:11.115179 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ca211-9998-42a6-8a37-9e2a567f25bd None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:41:11.115594 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ca211-9998-42a6-8a37-9e2a567f25bd None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:41:11.115838 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ca211-9998-42a6-8a37-9e2a567f25bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:41:11.184789 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:41:11.187777 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-5f0ca211-9998-42a6-8a37-9e2a567f25bd None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:41:11.189026 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-5f0ca211-9998-42a6-8a37-9e2a567f25bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:41:11.284439 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 664/1333] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:41:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:41:11.321306 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ad71a-2e39-4b67-8030-d6d4424e1a1f None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:41:11.322839 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-e89ad71a-2e39-4b67-8030-d6d4424e1a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:41:11.426083 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ad71a-2e39-4b67-8030-d6d4424e1a1f None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:41:11.500511 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47da1108-ee47-4bc8-af0f-ef2ea6ed0d4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:41:11.501156 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da1108-ee47-4bc8-af0f-ef2ea6ed0d4d service neutron] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:41:11.501437 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da1108-ee47-4bc8-af0f-ef2ea6ed0d4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:41:11.501711 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da1108-ee47-4bc8-af0f-ef2ea6ed0d4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:41:11.503409 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-47da1108-ee47-4bc8-af0f-ef2ea6ed0d4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:41:11.530624 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:41:11.615163 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47da1108-ee47-4bc8-af0f-ef2ea6ed0d4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:41:11.616645 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47da1108-ee47-4bc8-af0f-ef2ea6ed0d4d service neutron] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:41:11.635015 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 670/1334] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:41:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:41:13.716720 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cacbb6-19d5-4b34-b0fa-954b622a90af None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:41:13.717227 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cacbb6-19d5-4b34-b0fa-954b622a90af None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:41:13.717227 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cacbb6-19d5-4b34-b0fa-954b622a90af None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:41:13.718570 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 665/1335] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:41:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:41:13.724251 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26733d7f-4b6d-4384-92ed-85b584bf0c4f None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:41:13.724683 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26733d7f-4b6d-4384-92ed-85b584bf0c4f None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:41:13.724800 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26733d7f-4b6d-4384-92ed-85b584bf0c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:41:13.791663 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-26733d7f-4b6d-4384-92ed-85b584bf0c4f None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:41:13.792925 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-26733d7f-4b6d-4384-92ed-85b584bf0c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:41:13.879174 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:41:13.901185 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 671/1336] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:41:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:41:13.942076 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cacbb6-19d5-4b34-b0fa-954b622a90af None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:41:13.943598 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-24cacbb6-19d5-4b34-b0fa-954b622a90af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:41:14.046929 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cacbb6-19d5-4b34-b0fa-954b622a90af None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:41:14.075169 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:41:14.121972 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba3c723-1239-483b-a86a-e223b2845e67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:41:14.122617 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3c723-1239-483b-a86a-e223b2845e67 service neutron] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:41:14.122892 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3c723-1239-483b-a86a-e223b2845e67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:41:14.123161 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3c723-1239-483b-a86a-e223b2845e67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:41:14.124853 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-0ba3c723-1239-483b-a86a-e223b2845e67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:41:14.233370 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba3c723-1239-483b-a86a-e223b2845e67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:41:14.234796 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba3c723-1239-483b-a86a-e223b2845e67 service neutron] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:41:14.256162 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 666/1337] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:41:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:41:17.444946 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592cd11-01d6-4ad9-b159-b40ee0576658 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:41:17.445754 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592cd11-01d6-4ad9-b159-b40ee0576658 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:41:17.445947 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592cd11-01d6-4ad9-b159-b40ee0576658 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:41:17.447479 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 672/1338] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:41:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:41:17.452773 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adcce97-a3ae-4c03-9d20-b9a0daf4fb40 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:41:17.453190 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adcce97-a3ae-4c03-9d20-b9a0daf4fb40 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:41:17.453314 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adcce97-a3ae-4c03-9d20-b9a0daf4fb40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:41:17.522125 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-9adcce97-a3ae-4c03-9d20-b9a0daf4fb40 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:41:17.523348 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-9adcce97-a3ae-4c03-9d20-b9a0daf4fb40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:41:17.539772 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:41:17.633479 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 667/1339] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:41:17 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:41:17.674996 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1592cd11-01d6-4ad9-b159-b40ee0576658 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:41:17.676611 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-1592cd11-01d6-4ad9-b159-b40ee0576658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:41:17.782766 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1592cd11-01d6-4ad9-b159-b40ee0576658 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:41:17.857799 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a0661b-a32d-4797-85f9-056428124ac1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:41:17.858445 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a0661b-a32d-4797-85f9-056428124ac1 service neutron] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:41:17.858728 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a0661b-a32d-4797-85f9-056428124ac1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:41:17.859008 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a0661b-a32d-4797-85f9-056428124ac1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:41:17.860680 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-c7a0661b-a32d-4797-85f9-056428124ac1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:41:17.897810 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:41:17.973063 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a0661b-a32d-4797-85f9-056428124ac1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:41:17.974504 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a0661b-a32d-4797-85f9-056428124ac1 service neutron] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:41:17.995019 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 673/1340] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:41:17 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:41:22.397257 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b363ba0-4f08-4f0b-83dd-b2db345baa42 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:41:22.397822 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b363ba0-4f08-4f0b-83dd-b2db345baa42 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:41:22.397822 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b363ba0-4f08-4f0b-83dd-b2db345baa42 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:41:22.399187 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 668/1341] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:41:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:41:22.404881 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d23e7a-991a-473c-964a-3809d102d6eb None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:41:22.405425 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d23e7a-991a-473c-964a-3809d102d6eb None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:41:22.405425 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d23e7a-991a-473c-964a-3809d102d6eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:41:22.490393 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-b9d23e7a-991a-473c-964a-3809d102d6eb None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:41:22.491655 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-b9d23e7a-991a-473c-964a-3809d102d6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:41:22.605899 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:41:22.623756 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 674/1342] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:41:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:41:22.669350 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b363ba0-4f08-4f0b-83dd-b2db345baa42 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:41:22.670990 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-3b363ba0-4f08-4f0b-83dd-b2db345baa42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:41:22.805143 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b363ba0-4f08-4f0b-83dd-b2db345baa42 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:41:22.850179 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:41:22.894211 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b8ca25-a30e-4134-ad00-a9f5ad2fc201 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:41:22.894780 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8ca25-a30e-4134-ad00-a9f5ad2fc201 service neutron] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:41:22.895064 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8ca25-a30e-4134-ad00-a9f5ad2fc201 service neutron] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:41:22.895339 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8ca25-a30e-4134-ad00-a9f5ad2fc201 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:41:22.897059 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-c8b8ca25-a30e-4134-ad00-a9f5ad2fc201 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:41:23.043311 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b8ca25-a30e-4134-ad00-a9f5ad2fc201 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:41:23.047795 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b8ca25-a30e-4134-ad00-a9f5ad2fc201 service neutron] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:41:23.070032 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 669/1343] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:41:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:41:26.922833 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c335e5c-ebf1-4f66-99de-6a239ccd1d63 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:41:26.923419 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c335e5c-ebf1-4f66-99de-6a239ccd1d63 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:41:26.923419 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c335e5c-ebf1-4f66-99de-6a239ccd1d63 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:41:26.924860 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 675/1344] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:41:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:41:26.930282 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39e7a3-a5ff-4b20-a105-94188ff204b1 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:41:26.930747 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39e7a3-a5ff-4b20-a105-94188ff204b1 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:41:26.930854 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39e7a3-a5ff-4b20-a105-94188ff204b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:41:27.001744 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-ed39e7a3-a5ff-4b20-a105-94188ff204b1 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:41:27.002969 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-ed39e7a3-a5ff-4b20-a105-94188ff204b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:41:27.024161 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:41:27.122021 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 670/1345] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:41:26 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:41:27.163925 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c335e5c-ebf1-4f66-99de-6a239ccd1d63 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:41:27.165541 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-2c335e5c-ebf1-4f66-99de-6a239ccd1d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:41:27.283497 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c335e5c-ebf1-4f66-99de-6a239ccd1d63 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:41:27.363026 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848baa5b-48a6-491e-8fbf-18e37b3e9fce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:41:27.363026 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848baa5b-48a6-491e-8fbf-18e37b3e9fce service neutron] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:41:27.363026 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848baa5b-48a6-491e-8fbf-18e37b3e9fce service neutron] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:41:27.363026 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848baa5b-48a6-491e-8fbf-18e37b3e9fce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:41:27.364629 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-848baa5b-48a6-491e-8fbf-18e37b3e9fce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:41:27.413403 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:41:27.490814 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848baa5b-48a6-491e-8fbf-18e37b3e9fce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:41:27.492337 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848baa5b-48a6-491e-8fbf-18e37b3e9fce service neutron] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:41:27.513647 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 676/1346] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:41:27 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:41:32.307665 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b637f39a-d349-49b2-9c8b-243ddf611889 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:41:32.308250 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b637f39a-d349-49b2-9c8b-243ddf611889 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:41:32.308349 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b637f39a-d349-49b2-9c8b-243ddf611889 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:41:32.309954 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 671/1347] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:41:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:41:32.316180 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf679a-88c3-4e4d-98f2-1c6925d7e7a1 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:41:32.317413 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf679a-88c3-4e4d-98f2-1c6925d7e7a1 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:41:32.317413 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf679a-88c3-4e4d-98f2-1c6925d7e7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:41:32.392314 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-7acf679a-88c3-4e4d-98f2-1c6925d7e7a1 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:41:32.393676 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-7acf679a-88c3-4e4d-98f2-1c6925d7e7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:41:32.505670 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:41:32.510596 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 677/1348] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:41:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:41:32.548493 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b637f39a-d349-49b2-9c8b-243ddf611889 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:41:32.554799 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-b637f39a-d349-49b2-9c8b-243ddf611889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:41:32.668511 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b637f39a-d349-49b2-9c8b-243ddf611889 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:41:32.719442 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:41:32.747651 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403adcba-01e3-487f-bcdd-6e09b1286b42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:41:32.748344 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403adcba-01e3-487f-bcdd-6e09b1286b42 service neutron] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:41:32.748629 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403adcba-01e3-487f-bcdd-6e09b1286b42 service neutron] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:41:32.748908 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403adcba-01e3-487f-bcdd-6e09b1286b42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:41:32.750592 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-403adcba-01e3-487f-bcdd-6e09b1286b42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:41:32.874134 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403adcba-01e3-487f-bcdd-6e09b1286b42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:41:32.875616 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403adcba-01e3-487f-bcdd-6e09b1286b42 service neutron] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:41:32.898629 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 672/1349] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:41:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:41:37.893097 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f17de7-238b-4b76-8c45-d07f1d748497 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:41:37.893565 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f17de7-238b-4b76-8c45-d07f1d748497 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:41:37.893656 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f17de7-238b-4b76-8c45-d07f1d748497 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:41:37.896058 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 678/1350] 10.222.0.81 () {54 vars in 921 bytes} [Mon Jul 18 16:41:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:41:37.901339 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1c726-aace-4578-9dc2-c3435ca66a5b None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:41:37.915515 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1c726-aace-4578-9dc2-c3435ca66a5b None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:41:37.915515 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1c726-aace-4578-9dc2-c3435ca66a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:41:37.988221 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-1df1c726-aace-4578-9dc2-c3435ca66a5b None None] MFA Rules not processed for user `5700ad7df774415b89737c7dddcc5b2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:41:37.989727 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-1df1c726-aace-4578-9dc2-c3435ca66a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:41:38.028492 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:41:38.126004 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 673/1351] 10.222.0.81 () {58 vars in 1018 bytes} [Mon Jul 18 16:41:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:41:42.368479 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7da0ff-5f7f-4b38-9787-e23fdcd7181a None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:41:42.368999 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7da0ff-5f7f-4b38-9787-e23fdcd7181a None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:41:42.368999 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7da0ff-5f7f-4b38-9787-e23fdcd7181a None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:41:42.370408 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 679/1352] 10.222.0.81 () {54 vars in 921 bytes} [Mon Jul 18 16:41:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:41:42.377393 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0bfabb-9315-4874-a738-f0e8940bf9e6 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:41:42.378373 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0bfabb-9315-4874-a738-f0e8940bf9e6 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:41:42.378906 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0bfabb-9315-4874-a738-f0e8940bf9e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:41:42.476918 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-df0bfabb-9315-4874-a738-f0e8940bf9e6 None None] MFA Rules not processed for user `5700ad7df774415b89737c7dddcc5b2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:41:42.478303 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-df0bfabb-9315-4874-a738-f0e8940bf9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:41:42.565648 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:41:42.603939 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 674/1353] 10.222.0.81 () {58 vars in 1018 bytes} [Mon Jul 18 16:41:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:41:44.019564 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c830c3-3a9b-403c-98db-f1e8a410ae92 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:41:44.020118 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c830c3-3a9b-403c-98db-f1e8a410ae92 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:41:44.020118 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c830c3-3a9b-403c-98db-f1e8a410ae92 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:41:44.021497 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 680/1354] 10.222.0.81 () {54 vars in 921 bytes} [Mon Jul 18 16:41:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:41:44.026680 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0533ee-1e98-4b95-b7cc-61bcf3c7816d None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:41:44.027161 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0533ee-1e98-4b95-b7cc-61bcf3c7816d None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:41:44.027258 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0533ee-1e98-4b95-b7cc-61bcf3c7816d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:41:44.107652 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-ed0533ee-1e98-4b95-b7cc-61bcf3c7816d None None] MFA Rules not processed for user `5700ad7df774415b89737c7dddcc5b2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:41:44.108887 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-ed0533ee-1e98-4b95-b7cc-61bcf3c7816d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:41:44.225767 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 675/1355] 10.222.0.81 () {58 vars in 1018 bytes} [Mon Jul 18 16:41:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:41:47.805442 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6f7f3-eabc-49f0-bdde-d90442e6475d None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:41:47.805965 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6f7f3-eabc-49f0-bdde-d90442e6475d None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:41:47.806061 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6f7f3-eabc-49f0-bdde-d90442e6475d None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:41:47.807376 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 681/1356] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:41:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:41:47.813323 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a34e3-ba30-45e8-a380-aebb491bc0b9 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:41:47.813769 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a34e3-ba30-45e8-a380-aebb491bc0b9 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:41:47.814022 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a34e3-ba30-45e8-a380-aebb491bc0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:41:47.877447 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:41:47.919231 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-f76a34e3-ba30-45e8-a380-aebb491bc0b9 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:41:47.920638 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-f76a34e3-ba30-45e8-a380-aebb491bc0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:41:48.032774 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 676/1357] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:41:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:41:48.090678 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371659a8-c010-4600-93d0-61ff4b883376 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:41:48.091691 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371659a8-c010-4600-93d0-61ff4b883376 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:41:48.092380 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371659a8-c010-4600-93d0-61ff4b883376 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:41:48.094337 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 682/1358] 10.222.0.81 () {54 vars in 962 bytes} [Mon Jul 18 16:41:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:41:48.102495 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258862b7-dd31-47a5-8215-2647522e0727 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:41:48.111249 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258862b7-dd31-47a5-8215-2647522e0727 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:41:48.111249 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258862b7-dd31-47a5-8215-2647522e0727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:41:48.192618 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-258862b7-dd31-47a5-8215-2647522e0727 None None] MFA Rules not processed for user `07f0c5bf1bee48a0bafdf7a9e4537c70`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:41:48.193791 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-258862b7-dd31-47a5-8215-2647522e0727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:41:48.252775 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:41:48.331625 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 677/1359] 10.222.0.81 () {58 vars in 1059 bytes} [Mon Jul 18 16:41:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:41:48.339223 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371659a8-c010-4600-93d0-61ff4b883376 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:41:48.341453 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-371659a8-c010-4600-93d0-61ff4b883376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:41:48.510374 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371659a8-c010-4600-93d0-61ff4b883376 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:41:48.596043 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:41:48.644563 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42496981-c188-4a6d-80e8-da94a2764ead service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07f0c5bf1bee48a0bafdf7a9e4537c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:41:48.645271 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42496981-c188-4a6d-80e8-da94a2764ead service nova] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:41:48.645553 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42496981-c188-4a6d-80e8-da94a2764ead service nova] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:41:48.645828 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42496981-c188-4a6d-80e8-da94a2764ead service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:41:48.647565 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-42496981-c188-4a6d-80e8-da94a2764ead service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:41:48.767453 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42496981-c188-4a6d-80e8-da94a2764ead service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:41:48.769146 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42496981-c188-4a6d-80e8-da94a2764ead service nova] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:41:48.790496 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 683/1360] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:41:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:41:51.141460 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f93800-6051-4a92-a1c0-464305c96204 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:41:51.142247 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f93800-6051-4a92-a1c0-464305c96204 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:41:51.142247 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f93800-6051-4a92-a1c0-464305c96204 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:41:51.143700 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 678/1361] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:41:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:41:51.149655 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea1ca6b-a361-4fc8-9cc8-56ca8d63715a None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:41:51.150474 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea1ca6b-a361-4fc8-9cc8-56ca8d63715a None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:41:51.150474 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea1ca6b-a361-4fc8-9cc8-56ca8d63715a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:41:51.276733 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-9ea1ca6b-a361-4fc8-9cc8-56ca8d63715a None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:41:51.279276 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-9ea1ca6b-a361-4fc8-9cc8-56ca8d63715a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:41:51.375316 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:41:51.505304 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 684/1362] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:41:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:41:51.553022 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f93800-6051-4a92-a1c0-464305c96204 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:41:51.554814 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-84f93800-6051-4a92-a1c0-464305c96204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:41:51.798428 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f93800-6051-4a92-a1c0-464305c96204 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:41:51.809355 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:41:51.932932 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5292b872-5a7b-45a4-8c70-6400eca6580e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07f0c5bf1bee48a0bafdf7a9e4537c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:41:51.933794 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5292b872-5a7b-45a4-8c70-6400eca6580e service nova] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:41:51.934198 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5292b872-5a7b-45a4-8c70-6400eca6580e service nova] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:41:51.934589 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5292b872-5a7b-45a4-8c70-6400eca6580e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:41:51.936561 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-5292b872-5a7b-45a4-8c70-6400eca6580e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:41:52.059052 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5292b872-5a7b-45a4-8c70-6400eca6580e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:41:52.061006 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5292b872-5a7b-45a4-8c70-6400eca6580e service nova] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:41:52.090305 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 679/1363] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:41:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:41:54.747335 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ce3bd-6409-43b7-a8f9-c3f56a35102c None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:41:54.748036 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ce3bd-6409-43b7-a8f9-c3f56a35102c None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:41:54.748036 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ce3bd-6409-43b7-a8f9-c3f56a35102c None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:41:54.749633 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 685/1364] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:41:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:41:54.755511 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd1a3d9-a912-4dcf-857b-346c04d10413 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:41:54.756465 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd1a3d9-a912-4dcf-857b-346c04d10413 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:41:54.756961 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd1a3d9-a912-4dcf-857b-346c04d10413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:41:54.772479 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:41:54.844941 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-fdd1a3d9-a912-4dcf-857b-346c04d10413 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:41:54.846225 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-fdd1a3d9-a912-4dcf-857b-346c04d10413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:41:54.963017 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 680/1365] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:41:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:41:55.017526 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff8262c-c587-4e57-8a84-4bbb1aeb54d9 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:41:55.017854 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff8262c-c587-4e57-8a84-4bbb1aeb54d9 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:41:55.018478 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff8262c-c587-4e57-8a84-4bbb1aeb54d9 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:41:55.020777 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 686/1366] 10.222.0.81 () {54 vars in 962 bytes} [Mon Jul 18 16:41:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:41:55.027341 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c56379-78f8-4889-ab09-db80a00d3e2d None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:41:55.027696 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c56379-78f8-4889-ab09-db80a00d3e2d None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:41:55.027908 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c56379-78f8-4889-ab09-db80a00d3e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:41:55.145276 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-41c56379-78f8-4889-ab09-db80a00d3e2d None None] MFA Rules not processed for user `07f0c5bf1bee48a0bafdf7a9e4537c70`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:41:55.147589 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-41c56379-78f8-4889-ab09-db80a00d3e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:41:55.197075 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:41:55.296309 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 681/1367] 10.222.0.81 () {58 vars in 1059 bytes} [Mon Jul 18 16:41:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:41:55.304683 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff8262c-c587-4e57-8a84-4bbb1aeb54d9 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:41:55.306376 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-2ff8262c-c587-4e57-8a84-4bbb1aeb54d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:41:55.470442 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff8262c-c587-4e57-8a84-4bbb1aeb54d9 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:41:55.495024 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:41:55.597716 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938141ee-4b4e-4f86-adab-ce8eb59f8534 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07f0c5bf1bee48a0bafdf7a9e4537c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:41:55.598611 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938141ee-4b4e-4f86-adab-ce8eb59f8534 service nova] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:41:55.599077 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938141ee-4b4e-4f86-adab-ce8eb59f8534 service nova] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:41:55.599518 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938141ee-4b4e-4f86-adab-ce8eb59f8534 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:41:55.601370 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-938141ee-4b4e-4f86-adab-ce8eb59f8534 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:41:55.708550 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938141ee-4b4e-4f86-adab-ce8eb59f8534 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:41:55.710406 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938141ee-4b4e-4f86-adab-ce8eb59f8534 service nova] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:41:55.731810 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 687/1368] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:41:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:41:56.420446 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c6d04b-2d67-4e9f-8795-cf0d77c8e3d7 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:41:56.420966 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c6d04b-2d67-4e9f-8795-cf0d77c8e3d7 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:41:56.420966 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c6d04b-2d67-4e9f-8795-cf0d77c8e3d7 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:41:56.422625 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 682/1369] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:41:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:41:56.427882 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e9d1a-71a7-42ce-ac20-b78e0330e7f8 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:41:56.428343 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e9d1a-71a7-42ce-ac20-b78e0330e7f8 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:41:56.428455 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e9d1a-71a7-42ce-ac20-b78e0330e7f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:41:56.468109 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:41:56.509725 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-f90e9d1a-71a7-42ce-ac20-b78e0330e7f8 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:41:56.510956 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-f90e9d1a-71a7-42ce-ac20-b78e0330e7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:41:56.617776 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 688/1370] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:41:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:41:56.968491 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916bad7-0a1e-4cde-89ff-2670d891baa7 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:41:56.968491 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916bad7-0a1e-4cde-89ff-2670d891baa7 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:41:56.968491 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916bad7-0a1e-4cde-89ff-2670d891baa7 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:41:56.971627 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 683/1371] 10.222.0.81 () {54 vars in 964 bytes} [Mon Jul 18 16:41:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:41:56.976047 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5116191-31ba-4a5b-afdc-1178a33b289c None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:41:56.976047 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5116191-31ba-4a5b-afdc-1178a33b289c None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:41:56.976047 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5116191-31ba-4a5b-afdc-1178a33b289c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:41:57.181413 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-a5116191-31ba-4a5b-afdc-1178a33b289c None None] MFA Rules not processed for user `baaee55accfa458a9832127c5ab77656`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:41:57.182641 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-a5116191-31ba-4a5b-afdc-1178a33b289c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:41:57.233436 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:41:57.267869 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 689/1372] 10.222.0.81 () {58 vars in 1061 bytes} [Mon Jul 18 16:41:56 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:41:57.273166 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916bad7-0a1e-4cde-89ff-2670d891baa7 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:41:57.274669 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-0916bad7-0a1e-4cde-89ff-2670d891baa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:41:57.389863 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916bad7-0a1e-4cde-89ff-2670d891baa7 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:41:57.437999 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:41:57.488192 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb6693-b812-4e05-9cb0-eddfcb2c48fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:41:57.488799 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb6693-b812-4e05-9cb0-eddfcb2c48fe service cinder] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:41:57.489156 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb6693-b812-4e05-9cb0-eddfcb2c48fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:41:57.489508 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb6693-b812-4e05-9cb0-eddfcb2c48fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:41:57.491276 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-a4eb6693-b812-4e05-9cb0-eddfcb2c48fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:41:57.613274 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eb6693-b812-4e05-9cb0-eddfcb2c48fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:41:57.614909 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eb6693-b812-4e05-9cb0-eddfcb2c48fe service cinder] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:41:57.639899 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 684/1373] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:41:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:41:58.021149 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710209e-e6f4-4cd7-ab72-e69a3b913e79 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:41:58.021677 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710209e-e6f4-4cd7-ab72-e69a3b913e79 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:41:58.021677 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710209e-e6f4-4cd7-ab72-e69a3b913e79 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:41:58.023202 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 690/1374] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:41:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:41:58.028575 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab085e-c223-4833-b501-dc270410572c None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:41:58.028863 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab085e-c223-4833-b501-dc270410572c None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:41:58.029152 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab085e-c223-4833-b501-dc270410572c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:41:58.097443 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-afab085e-c223-4833-b501-dc270410572c None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:41:58.098649 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-afab085e-c223-4833-b501-dc270410572c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:41:58.119798 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:41:58.199319 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 685/1375] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:41:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:41:58.245138 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1710209e-e6f4-4cd7-ab72-e69a3b913e79 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:41:58.246829 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-1710209e-e6f4-4cd7-ab72-e69a3b913e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:41:58.410986 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1710209e-e6f4-4cd7-ab72-e69a3b913e79 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:41:58.465915 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:41:58.534909 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1844f1-eb5c-4972-898d-d9a081a5f432 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07f0c5bf1bee48a0bafdf7a9e4537c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:41:58.535574 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1844f1-eb5c-4972-898d-d9a081a5f432 service nova] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:41:58.535889 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1844f1-eb5c-4972-898d-d9a081a5f432 service nova] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:41:58.536169 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1844f1-eb5c-4972-898d-d9a081a5f432 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:41:58.537857 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-5a1844f1-eb5c-4972-898d-d9a081a5f432 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:41:58.628887 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1844f1-eb5c-4972-898d-d9a081a5f432 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:41:58.630661 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1844f1-eb5c-4972-898d-d9a081a5f432 service nova] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:41:58.650468 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 691/1376] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:41:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:42:00.855178 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaade79-9178-481f-acb9-78cce0270a04 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:00.855682 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaade79-9178-481f-acb9-78cce0270a04 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:00.855809 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaade79-9178-481f-acb9-78cce0270a04 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:00.857310 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 686/1377] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:42:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:42:00.862803 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe05e04-00e9-490e-b0a0-fc87b96f0a6b None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:00.863587 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe05e04-00e9-490e-b0a0-fc87b96f0a6b None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:00.863911 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe05e04-00e9-490e-b0a0-fc87b96f0a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:00.936473 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-dbe05e04-00e9-490e-b0a0-fc87b96f0a6b None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:42:00.939747 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-dbe05e04-00e9-490e-b0a0-fc87b96f0a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:00.947732 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:01.058101 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 692/1378] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:42:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:42:01.105368 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaade79-9178-481f-acb9-78cce0270a04 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:42:01.106847 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-0eaade79-9178-481f-acb9-78cce0270a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:01.264270 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaade79-9178-481f-acb9-78cce0270a04 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:42:01.267851 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:01.420321 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c238cb-2bd4-4dfa-8178-9fc6d53d9822 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07f0c5bf1bee48a0bafdf7a9e4537c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:42:01.421003 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c238cb-2bd4-4dfa-8178-9fc6d53d9822 service nova] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:01.421870 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c238cb-2bd4-4dfa-8178-9fc6d53d9822 service nova] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:01.422250 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c238cb-2bd4-4dfa-8178-9fc6d53d9822 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:01.424326 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-08c238cb-2bd4-4dfa-8178-9fc6d53d9822 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:01.651422 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c238cb-2bd4-4dfa-8178-9fc6d53d9822 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:42:01.653112 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c238cb-2bd4-4dfa-8178-9fc6d53d9822 service nova] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:42:01.675022 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 687/1379] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:42:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:42:03.914539 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95164d70-6fdc-4967-b219-118cc27534d9 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:03.915111 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95164d70-6fdc-4967-b219-118cc27534d9 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:03.915111 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95164d70-6fdc-4967-b219-118cc27534d9 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:03.916495 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 693/1380] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:42:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:42:03.921712 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb4aa8-d0f2-415f-b5f6-73314765787c None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:03.922139 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb4aa8-d0f2-415f-b5f6-73314765787c None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:03.922253 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb4aa8-d0f2-415f-b5f6-73314765787c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:03.932435 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:03.987280 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-66eb4aa8-d0f2-415f-b5f6-73314765787c None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:42:03.988430 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-66eb4aa8-d0f2-415f-b5f6-73314765787c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:04.092060 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 688/1381] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:42:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:42:04.135839 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95164d70-6fdc-4967-b219-118cc27534d9 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:42:04.137596 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-95164d70-6fdc-4967-b219-118cc27534d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:04.284404 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:04.294919 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95164d70-6fdc-4967-b219-118cc27534d9 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:42:04.418505 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76987295-3383-4db6-a8ed-c3fcf3ee4fe9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07f0c5bf1bee48a0bafdf7a9e4537c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:42:04.419152 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76987295-3383-4db6-a8ed-c3fcf3ee4fe9 service nova] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:04.419432 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76987295-3383-4db6-a8ed-c3fcf3ee4fe9 service nova] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:04.419703 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76987295-3383-4db6-a8ed-c3fcf3ee4fe9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:04.421416 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-76987295-3383-4db6-a8ed-c3fcf3ee4fe9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:04.555590 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76987295-3383-4db6-a8ed-c3fcf3ee4fe9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:42:04.557164 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76987295-3383-4db6-a8ed-c3fcf3ee4fe9 service nova] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:42:04.570480 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:04.581235 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 694/1382] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:42:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:42:06.959407 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8cc87-9c24-4b9d-8204-6c14f31b0610 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:06.960063 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8cc87-9c24-4b9d-8204-6c14f31b0610 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:06.960390 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8cc87-9c24-4b9d-8204-6c14f31b0610 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:06.962934 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 689/1383] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:42:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:42:06.971254 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb663bd0-e6a0-45b3-a6cf-b68b7f19aa67 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:06.972057 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb663bd0-e6a0-45b3-a6cf-b68b7f19aa67 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:06.972057 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb663bd0-e6a0-45b3-a6cf-b68b7f19aa67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:07.076718 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-fb663bd0-e6a0-45b3-a6cf-b68b7f19aa67 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:42:07.078485 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-fb663bd0-e6a0-45b3-a6cf-b68b7f19aa67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:07.185795 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 695/1384] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:42:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:42:07.231979 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b8cc87-9c24-4b9d-8204-6c14f31b0610 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:42:07.233579 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-a1b8cc87-9c24-4b9d-8204-6c14f31b0610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:07.326653 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:07.394451 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b8cc87-9c24-4b9d-8204-6c14f31b0610 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:42:07.535547 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1158481-7b8c-40bc-a5a6-ec2bacf2dcab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07f0c5bf1bee48a0bafdf7a9e4537c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:42:07.536223 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1158481-7b8c-40bc-a5a6-ec2bacf2dcab service nova] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:07.536480 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1158481-7b8c-40bc-a5a6-ec2bacf2dcab service nova] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:07.536751 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1158481-7b8c-40bc-a5a6-ec2bacf2dcab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:07.538381 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-b1158481-7b8c-40bc-a5a6-ec2bacf2dcab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:07.589420 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:07.636288 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1158481-7b8c-40bc-a5a6-ec2bacf2dcab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:42:07.638410 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1158481-7b8c-40bc-a5a6-ec2bacf2dcab service nova] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:42:07.664064 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 690/1385] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:42:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:42:10.300823 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6541c12-d0a2-4940-afe9-ee67877fe4c3 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:10.301395 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6541c12-d0a2-4940-afe9-ee67877fe4c3 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:10.301395 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6541c12-d0a2-4940-afe9-ee67877fe4c3 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:10.302746 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 696/1386] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:42:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:42:10.309023 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b55fc-0a58-437f-ba92-4e5a9d21111f None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:10.309524 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b55fc-0a58-437f-ba92-4e5a9d21111f None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:10.309829 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b55fc-0a58-437f-ba92-4e5a9d21111f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:10.394922 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-ec1b55fc-0a58-437f-ba92-4e5a9d21111f None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:42:10.396178 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-ec1b55fc-0a58-437f-ba92-4e5a9d21111f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:10.514076 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 691/1387] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:42:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:42:10.576621 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6541c12-d0a2-4940-afe9-ee67877fe4c3 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:42:10.578826 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-e6541c12-d0a2-4940-afe9-ee67877fe4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:10.678157 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:10.762791 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6541c12-d0a2-4940-afe9-ee67877fe4c3 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:42:10.901167 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fcafc5-654b-4847-842c-0a3dea013432 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07f0c5bf1bee48a0bafdf7a9e4537c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:42:10.901167 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fcafc5-654b-4847-842c-0a3dea013432 service nova] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:10.901625 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fcafc5-654b-4847-842c-0a3dea013432 service nova] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:10.901716 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fcafc5-654b-4847-842c-0a3dea013432 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:10.903394 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-96fcafc5-654b-4847-842c-0a3dea013432 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:10.971815 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:11.048505 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fcafc5-654b-4847-842c-0a3dea013432 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:42:11.050537 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fcafc5-654b-4847-842c-0a3dea013432 service nova] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:42:11.074534 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 697/1388] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:42:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:42:13.292672 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e306f2af-d2ef-4fb4-b0ba-a23251fede2a None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:13.293256 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e306f2af-d2ef-4fb4-b0ba-a23251fede2a None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:13.293256 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e306f2af-d2ef-4fb4-b0ba-a23251fede2a None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:13.295017 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 692/1389] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:42:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:42:13.301911 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d838ec4-fb22-4796-95c0-2dca1740ce8f None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:13.302420 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d838ec4-fb22-4796-95c0-2dca1740ce8f None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:13.302538 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d838ec4-fb22-4796-95c0-2dca1740ce8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:13.344090 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a53d88-2dbb-4a32-9335-da6de14c1b2a None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:13.349153 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a53d88-2dbb-4a32-9335-da6de14c1b2a None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:13.349153 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a53d88-2dbb-4a32-9335-da6de14c1b2a None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:13.349153 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 693/1390] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:42:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:42:13.353578 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1668c22c-5cc8-4ed8-bf3f-a7f756fcb705 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:13.354061 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1668c22c-5cc8-4ed8-bf3f-a7f756fcb705 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:13.354540 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1668c22c-5cc8-4ed8-bf3f-a7f756fcb705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:13.381365 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-7d838ec4-fb22-4796-95c0-2dca1740ce8f None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:42:13.382605 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-7d838ec4-fb22-4796-95c0-2dca1740ce8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:13.391113 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:13.424520 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-1668c22c-5cc8-4ed8-bf3f-a7f756fcb705 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:42:13.426237 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-1668c22c-5cc8-4ed8-bf3f-a7f756fcb705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:13.490910 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 698/1391] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:42:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:42:13.533247 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 694/1392] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:42:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:42:13.537291 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d838ec4-fb22-4796-95c0-2dca1740ce8f None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:42:13.538516 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-7d838ec4-fb22-4796-95c0-2dca1740ce8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:13.552845 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:13.589659 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883515e-7b5a-4f83-82a2-7fdc43b496e1 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:13.589946 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883515e-7b5a-4f83-82a2-7fdc43b496e1 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:13.590226 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883515e-7b5a-4f83-82a2-7fdc43b496e1 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:13.591845 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 695/1393] 10.222.0.81 () {54 vars in 961 bytes} [Mon Jul 18 16:42:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:42:13.596572 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476cd071-f14c-4de8-8c2a-9dbad423bef4 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:13.596855 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476cd071-f14c-4de8-8c2a-9dbad423bef4 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:13.597130 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476cd071-f14c-4de8-8c2a-9dbad423bef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:13.656557 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d838ec4-fb22-4796-95c0-2dca1740ce8f None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:42:13.678805 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-476cd071-f14c-4de8-8c2a-9dbad423bef4 None None] MFA Rules not processed for user `e638fbc5f1f3447c8e189c228bbae530`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:42:13.680135 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-476cd071-f14c-4de8-8c2a-9dbad423bef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:13.729372 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:13.757869 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 696/1394] 10.222.0.81 () {58 vars in 1058 bytes} [Mon Jul 18 16:42:13 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:42:13.765580 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476cd071-f14c-4de8-8c2a-9dbad423bef4 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:42:13.773062 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476cd071-f14c-4de8-8c2a-9dbad423bef4 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:42:13.774733 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3109c957-9186-4e56-8854-7c805a908940 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07f0c5bf1bee48a0bafdf7a9e4537c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:42:13.775384 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109c957-9186-4e56-8854-7c805a908940 service nova] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:13.775681 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109c957-9186-4e56-8854-7c805a908940 service nova] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:13.776034 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109c957-9186-4e56-8854-7c805a908940 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:13.777675 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-3109c957-9186-4e56-8854-7c805a908940 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:13.786941 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:13.848043 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0898f34-6997-428a-887b-92219e056159 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e638fbc5f1f3447c8e189c228bbae530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:42:13.848606 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0898f34-6997-428a-887b-92219e056159 service glance] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:13.848884 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0898f34-6997-428a-887b-92219e056159 service glance] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:13.849181 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0898f34-6997-428a-887b-92219e056159 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:13.850849 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-d0898f34-6997-428a-887b-92219e056159 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:13.874697 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3109c957-9186-4e56-8854-7c805a908940 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:42:13.876325 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3109c957-9186-4e56-8854-7c805a908940 service nova] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:42:13.894904 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 699/1395] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:42:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:42:13.961817 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0898f34-6997-428a-887b-92219e056159 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:42:13.963255 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0898f34-6997-428a-887b-92219e056159 service glance] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:42:13.982304 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 697/1396] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:42:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 16:42:13.992269 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:14.908735 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659688b5-0c1b-45c0-afa4-afa49d77c54f None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:14.909295 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659688b5-0c1b-45c0-afa4-afa49d77c54f None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:14.909398 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659688b5-0c1b-45c0-afa4-afa49d77c54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:14.980490 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-659688b5-0c1b-45c0-afa4-afa49d77c54f None None] MFA Rules not processed for user `ea2a096c4b964f03aed533d1e5e96db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:42:14.981733 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-659688b5-0c1b-45c0-afa4-afa49d77c54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:15.074257 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:15.078374 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 700/1397] 10.222.0.81 () {58 vars in 1009 bytes} [Mon Jul 18 16:42:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:42:15.128628 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2521e7-a7b4-4c60-a84d-97352faba805 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:15.129194 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2521e7-a7b4-4c60-a84d-97352faba805 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:15.129194 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2521e7-a7b4-4c60-a84d-97352faba805 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:15.130840 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 698/1398] 10.222.0.81 () {54 vars in 943 bytes} [Mon Jul 18 16:42:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:42:15.137729 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822c290-65ed-47af-b2bd-ec31db2af5ed None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:15.138025 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822c290-65ed-47af-b2bd-ec31db2af5ed None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:15.138307 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822c290-65ed-47af-b2bd-ec31db2af5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:15.223901 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-4822c290-65ed-47af-b2bd-ec31db2af5ed None None] MFA Rules not processed for user `251475c53ac64cd48ae84567d8c2ee87`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:42:15.225123 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-4822c290-65ed-47af-b2bd-ec31db2af5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:15.340375 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 701/1399] 10.222.0.81 () {58 vars in 1040 bytes} [Mon Jul 18 16:42:15 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:42:15.350427 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2521e7-a7b4-4c60-a84d-97352faba805 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:42:15.352071 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-fc2521e7-a7b4-4c60-a84d-97352faba805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:15.515813 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2521e7-a7b4-4c60-a84d-97352faba805 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:42:15.604713 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:15.624559 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8363e4c3-2040-4006-9b67-df60e9e3a28e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251475c53ac64cd48ae84567d8c2ee87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:42:15.625206 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363e4c3-2040-4006-9b67-df60e9e3a28e service swift] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:15.625482 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363e4c3-2040-4006-9b67-df60e9e3a28e service swift] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:15.625751 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363e4c3-2040-4006-9b67-df60e9e3a28e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:15.627466 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-8363e4c3-2040-4006-9b67-df60e9e3a28e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:15.710244 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8363e4c3-2040-4006-9b67-df60e9e3a28e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:42:15.711844 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8363e4c3-2040-4006-9b67-df60e9e3a28e service swift] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:42:15.720437 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 699/1400] 10.222.0.81 () {60 vars in 1384 bytes} [Mon Jul 18 16:42:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 16:42:16.371325 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c7945-cc6a-4352-b3da-26034a1f0cd8 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:16.371917 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c7945-cc6a-4352-b3da-26034a1f0cd8 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:16.372287 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c7945-cc6a-4352-b3da-26034a1f0cd8 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:16.374351 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 702/1401] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:42:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:42:16.379419 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a47d4c-396d-40c1-b329-d767834a53d4 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:16.380153 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a47d4c-396d-40c1-b329-d767834a53d4 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:16.380245 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a47d4c-396d-40c1-b329-d767834a53d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:16.455998 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-a4a47d4c-396d-40c1-b329-d767834a53d4 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:42:16.457162 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-a4a47d4c-396d-40c1-b329-d767834a53d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:16.539577 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:16.570949 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 700/1402] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:42:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:42:16.616452 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c7945-cc6a-4352-b3da-26034a1f0cd8 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:42:16.618233 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-530c7945-cc6a-4352-b3da-26034a1f0cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:16.686620 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:16.778971 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c7945-cc6a-4352-b3da-26034a1f0cd8 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:42:16.910834 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a7d9f-a613-4853-a540-111634f4f61c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07f0c5bf1bee48a0bafdf7a9e4537c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:42:16.911487 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a7d9f-a613-4853-a540-111634f4f61c service nova] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:16.911929 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a7d9f-a613-4853-a540-111634f4f61c service nova] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:16.912063 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a7d9f-a613-4853-a540-111634f4f61c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:16.913693 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-e42a7d9f-a613-4853-a540-111634f4f61c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:16.937571 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:17.020904 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42a7d9f-a613-4853-a540-111634f4f61c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:42:17.022502 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42a7d9f-a613-4853-a540-111634f4f61c service nova] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:42:17.044887 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 703/1403] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:42:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:42:19.342116 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381ef67-f575-4d34-b8c5-d326ed1de81b None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:19.342730 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381ef67-f575-4d34-b8c5-d326ed1de81b None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:19.342832 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381ef67-f575-4d34-b8c5-d326ed1de81b None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:19.345240 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 701/1404] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:42:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:42:19.349821 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa1fbf-9553-4fa8-8cc4-08713629f7ba None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:19.350358 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa1fbf-9553-4fa8-8cc4-08713629f7ba None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:19.350465 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa1fbf-9553-4fa8-8cc4-08713629f7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:19.428288 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-11fa1fbf-9553-4fa8-8cc4-08713629f7ba None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:42:19.429455 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-11fa1fbf-9553-4fa8-8cc4-08713629f7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:19.546823 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:19.559891 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 704/1405] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:42:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:42:19.603025 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e381ef67-f575-4d34-b8c5-d326ed1de81b None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:42:19.604692 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-e381ef67-f575-4d34-b8c5-d326ed1de81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:19.784047 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e381ef67-f575-4d34-b8c5-d326ed1de81b None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:42:19.849455 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:19.919587 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d673a-f240-4454-8e13-4987b1e2838f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07f0c5bf1bee48a0bafdf7a9e4537c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:42:19.920326 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d673a-f240-4454-8e13-4987b1e2838f service nova] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:19.920700 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d673a-f240-4454-8e13-4987b1e2838f service nova] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:19.920979 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d673a-f240-4454-8e13-4987b1e2838f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:19.922679 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-9b5d673a-f240-4454-8e13-4987b1e2838f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:20.033833 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5d673a-f240-4454-8e13-4987b1e2838f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:42:20.035681 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5d673a-f240-4454-8e13-4987b1e2838f service nova] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:42:20.055605 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 702/1406] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:42:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:42:22.396610 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3caf5a-f9bb-4896-ae15-a39d5926c0fa None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:22.397193 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3caf5a-f9bb-4896-ae15-a39d5926c0fa None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:22.397292 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3caf5a-f9bb-4896-ae15-a39d5926c0fa None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:22.399093 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 705/1407] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:42:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:42:22.405121 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f6713-4d3e-4fed-9138-a953918d3268 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:22.405949 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f6713-4d3e-4fed-9138-a953918d3268 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:22.406250 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f6713-4d3e-4fed-9138-a953918d3268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:22.490452 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-b26f6713-4d3e-4fed-9138-a953918d3268 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:42:22.491658 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-b26f6713-4d3e-4fed-9138-a953918d3268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:22.510815 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:22.605036 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 703/1408] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:42:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:42:22.653224 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3caf5a-f9bb-4896-ae15-a39d5926c0fa None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:42:22.655350 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-1e3caf5a-f9bb-4896-ae15-a39d5926c0fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:22.819734 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3caf5a-f9bb-4896-ae15-a39d5926c0fa None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:42:22.901713 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:22.955107 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9411eded-c03a-4f68-8aa8-a6bf71972264 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07f0c5bf1bee48a0bafdf7a9e4537c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:42:22.955789 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411eded-c03a-4f68-8aa8-a6bf71972264 service nova] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:22.956062 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411eded-c03a-4f68-8aa8-a6bf71972264 service nova] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:22.956341 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411eded-c03a-4f68-8aa8-a6bf71972264 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:22.958047 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-9411eded-c03a-4f68-8aa8-a6bf71972264 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:23.053053 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9411eded-c03a-4f68-8aa8-a6bf71972264 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:42:23.054662 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9411eded-c03a-4f68-8aa8-a6bf71972264 service nova] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:42:23.081366 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 706/1409] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:42:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:42:32.602778 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=38 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:33.074773 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=64 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:40.115794 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486e463-cb41-4e0d-8dd3-3e7c95549f22 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:40.116371 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486e463-cb41-4e0d-8dd3-3e7c95549f22 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:40.116371 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486e463-cb41-4e0d-8dd3-3e7c95549f22 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:40.117825 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 704/1410] 10.222.0.81 () {54 vars in 918 bytes} [Mon Jul 18 16:42:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:42:40.123430 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2abe23-3e12-4b53-8c86-ec19c4cd710e None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:40.123984 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2abe23-3e12-4b53-8c86-ec19c4cd710e None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:40.123984 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2abe23-3e12-4b53-8c86-ec19c4cd710e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:40.202191 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-8c2abe23-3e12-4b53-8c86-ec19c4cd710e None None] MFA Rules not processed for user `5700ad7df774415b89737c7dddcc5b2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:42:40.203402 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-8c2abe23-3e12-4b53-8c86-ec19c4cd710e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:40.311399 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 707/1411] 10.222.0.81 () {58 vars in 1015 bytes} [Mon Jul 18 16:42:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:42:40.326152 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a95fd-7224-40b7-9606-eae01374b783 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:40.326433 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a95fd-7224-40b7-9606-eae01374b783 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:40.326749 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a95fd-7224-40b7-9606-eae01374b783 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:40.328144 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 705/1412] 10.222.0.81 () {54 vars in 918 bytes} [Mon Jul 18 16:42:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:42:40.334246 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e32c9-8e90-4d08-ac06-482b57597af9 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:40.334544 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e32c9-8e90-4d08-ac06-482b57597af9 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:40.335059 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e32c9-8e90-4d08-ac06-482b57597af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:40.407545 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:40.410127 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-2d6e32c9-8e90-4d08-ac06-482b57597af9 None None] MFA Rules not processed for user `07f0c5bf1bee48a0bafdf7a9e4537c70`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:42:40.411372 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-2d6e32c9-8e90-4d08-ac06-482b57597af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:40.529382 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 708/1413] 10.222.0.81 () {58 vars in 1015 bytes} [Mon Jul 18 16:42:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:42:43.025071 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c29993-0103-4fbd-a7c4-1dcef39406af None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:43.025650 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c29993-0103-4fbd-a7c4-1dcef39406af None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:43.025650 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c29993-0103-4fbd-a7c4-1dcef39406af None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:43.027043 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 706/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 16:42:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:42:43.032498 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d747ec-5119-4c3c-8d66-ac941ecdec99 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:43.032923 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d747ec-5119-4c3c-8d66-ac941ecdec99 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:43.033060 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d747ec-5119-4c3c-8d66-ac941ecdec99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:43.097087 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-16d747ec-5119-4c3c-8d66-ac941ecdec99 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:42:43.098308 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-16d747ec-5119-4c3c-8d66-ac941ecdec99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:43.155279 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:43.197884 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 709/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 16:42:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:42:43.241393 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c29993-0103-4fbd-a7c4-1dcef39406af None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:42:43.242917 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-c6c29993-0103-4fbd-a7c4-1dcef39406af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:43.391284 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c29993-0103-4fbd-a7c4-1dcef39406af None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:42:43.462909 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:43.505554 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3205a74-f9cc-494d-80b9-e93555ddce00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07f0c5bf1bee48a0bafdf7a9e4537c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:42:43.506199 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3205a74-f9cc-494d-80b9-e93555ddce00 service nova] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:43.506491 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3205a74-f9cc-494d-80b9-e93555ddce00 service nova] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:43.506763 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3205a74-f9cc-494d-80b9-e93555ddce00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:43.508477 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-e3205a74-f9cc-494d-80b9-e93555ddce00 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:43.597119 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3205a74-f9cc-494d-80b9-e93555ddce00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:42:43.598699 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3205a74-f9cc-494d-80b9-e93555ddce00 service nova] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:42:43.616849 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 707/1416] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:42:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:42:44.551064 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6350849-553a-423c-bbd0-62da30561b22 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:44.551638 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6350849-553a-423c-bbd0-62da30561b22 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:44.551638 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6350849-553a-423c-bbd0-62da30561b22 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:44.553039 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 710/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 16:42:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:42:44.557997 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8884114-e618-4adb-af44-6423a6aa895a None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:44.558418 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8884114-e618-4adb-af44-6423a6aa895a None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:44.558557 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8884114-e618-4adb-af44-6423a6aa895a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:44.633909 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-d8884114-e618-4adb-af44-6423a6aa895a None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:42:44.635107 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-d8884114-e618-4adb-af44-6423a6aa895a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:44.661765 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:44.730956 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 708/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 16:42:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:42:44.881578 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6350849-553a-423c-bbd0-62da30561b22 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:42:44.883123 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-e6350849-553a-423c-bbd0-62da30561b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:45.033578 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6350849-553a-423c-bbd0-62da30561b22 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:42:45.073396 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:45.147676 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f01d726-2561-412e-b80b-476c35cac9bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07f0c5bf1bee48a0bafdf7a9e4537c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:42:45.148353 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01d726-2561-412e-b80b-476c35cac9bc service nova] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:45.148636 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01d726-2561-412e-b80b-476c35cac9bc service nova] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:45.148911 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01d726-2561-412e-b80b-476c35cac9bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:45.150563 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-1f01d726-2561-412e-b80b-476c35cac9bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:45.244328 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f01d726-2561-412e-b80b-476c35cac9bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:42:45.245940 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f01d726-2561-412e-b80b-476c35cac9bc service nova] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:42:45.264632 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 711/1419] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:42:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:42:46.149418 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c63eb-0449-4b2a-956f-dc268a3b64a8 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:46.150044 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c63eb-0449-4b2a-956f-dc268a3b64a8 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:46.150044 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c63eb-0449-4b2a-956f-dc268a3b64a8 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:46.151421 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 709/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 16:42:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:42:46.157090 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5359b-dae2-47fa-a22b-45309bd7b675 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:46.157499 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5359b-dae2-47fa-a22b-45309bd7b675 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:46.157650 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5359b-dae2-47fa-a22b-45309bd7b675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:46.211013 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:46.237528 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-10f5359b-dae2-47fa-a22b-45309bd7b675 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:42:46.238866 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-10f5359b-dae2-47fa-a22b-45309bd7b675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:46.335141 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 712/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 16:42:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:42:46.485317 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c63eb-0449-4b2a-956f-dc268a3b64a8 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:42:46.486818 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-379c63eb-0449-4b2a-956f-dc268a3b64a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:46.630019 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c63eb-0449-4b2a-956f-dc268a3b64a8 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:42:46.642491 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:46.741836 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9570196-fee7-4294-8a87-d97ead81ba36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07f0c5bf1bee48a0bafdf7a9e4537c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:42:46.742479 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9570196-fee7-4294-8a87-d97ead81ba36 service nova] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:46.742756 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9570196-fee7-4294-8a87-d97ead81ba36 service nova] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:46.743019 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9570196-fee7-4294-8a87-d97ead81ba36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:46.744655 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-e9570196-fee7-4294-8a87-d97ead81ba36 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:46.831899 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9570196-fee7-4294-8a87-d97ead81ba36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:42:46.833470 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9570196-fee7-4294-8a87-d97ead81ba36 service nova] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:42:46.851121 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 710/1422] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:42:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:42:47.715124 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db773519-73a7-44fb-960a-de5e465cd694 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:47.715576 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db773519-73a7-44fb-960a-de5e465cd694 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:47.715674 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db773519-73a7-44fb-960a-de5e465cd694 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:47.717525 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 713/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 16:42:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:42:47.722696 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9943ddb-995e-4b54-bede-8abb2841b0a3 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:47.723169 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9943ddb-995e-4b54-bede-8abb2841b0a3 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:47.725803 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9943ddb-995e-4b54-bede-8abb2841b0a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:47.742115 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:47.797451 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-c9943ddb-995e-4b54-bede-8abb2841b0a3 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:42:47.798660 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-c9943ddb-995e-4b54-bede-8abb2841b0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:47.895223 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 711/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 16:42:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:42:48.044170 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db773519-73a7-44fb-960a-de5e465cd694 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:42:48.045707 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-db773519-73a7-44fb-960a-de5e465cd694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:48.155601 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:48.191327 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db773519-73a7-44fb-960a-de5e465cd694 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:42:48.311437 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440b96c2-dcf3-43f6-aebb-5151afb6f7e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07f0c5bf1bee48a0bafdf7a9e4537c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:42:48.311437 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b96c2-dcf3-43f6-aebb-5151afb6f7e8 service nova] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:48.311437 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b96c2-dcf3-43f6-aebb-5151afb6f7e8 service nova] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:48.311437 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b96c2-dcf3-43f6-aebb-5151afb6f7e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:48.311954 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-440b96c2-dcf3-43f6-aebb-5151afb6f7e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:48.385641 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:48.398941 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440b96c2-dcf3-43f6-aebb-5151afb6f7e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:42:48.400601 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440b96c2-dcf3-43f6-aebb-5151afb6f7e8 service nova] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:42:48.419764 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 714/1425] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:42:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:42:49.306560 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a9dbf-daec-4fd0-91db-79a872f04d16 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:49.307173 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a9dbf-daec-4fd0-91db-79a872f04d16 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:49.307173 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a9dbf-daec-4fd0-91db-79a872f04d16 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:49.308525 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 712/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 16:42:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:42:49.313552 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d131c084-aca7-4f58-bd67-3b39f42f55c9 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:49.313983 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d131c084-aca7-4f58-bd67-3b39f42f55c9 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:49.314104 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d131c084-aca7-4f58-bd67-3b39f42f55c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:49.391706 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-d131c084-aca7-4f58-bd67-3b39f42f55c9 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:42:49.393025 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-d131c084-aca7-4f58-bd67-3b39f42f55c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:49.489538 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 715/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 16:42:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:42:49.640898 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8a9dbf-daec-4fd0-91db-79a872f04d16 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:42:49.642416 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-8b8a9dbf-daec-4fd0-91db-79a872f04d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:49.737846 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:49.789910 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8a9dbf-daec-4fd0-91db-79a872f04d16 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:42:49.904064 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0e16d-2ffa-458b-9886-766248146d0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07f0c5bf1bee48a0bafdf7a9e4537c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:42:49.904713 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0e16d-2ffa-458b-9886-766248146d0d service nova] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:49.905150 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0e16d-2ffa-458b-9886-766248146d0d service nova] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:49.905457 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0e16d-2ffa-458b-9886-766248146d0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:49.907099 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-afa0e16d-2ffa-458b-9886-766248146d0d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:49.956749 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:49.997835 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa0e16d-2ffa-458b-9886-766248146d0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:42:49.999333 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa0e16d-2ffa-458b-9886-766248146d0d service nova] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:42:50.017705 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 713/1428] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:42:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:42:50.905779 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6330c9-2372-4799-a514-205a55199acb None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:50.906373 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6330c9-2372-4799-a514-205a55199acb None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:50.906373 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6330c9-2372-4799-a514-205a55199acb None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:50.907762 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 716/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 16:42:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:42:50.912807 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d817f8-398b-4138-97fb-234fc946d3e3 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:50.918350 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d817f8-398b-4138-97fb-234fc946d3e3 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:50.918350 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d817f8-398b-4138-97fb-234fc946d3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:50.988162 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-b1d817f8-398b-4138-97fb-234fc946d3e3 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:42:50.989372 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-b1d817f8-398b-4138-97fb-234fc946d3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:51.084773 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 714/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 16:42:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:42:51.237189 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6330c9-2372-4799-a514-205a55199acb None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:42:51.238736 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-2b6330c9-2372-4799-a514-205a55199acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:51.288194 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:51.385126 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6330c9-2372-4799-a514-205a55199acb None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:42:51.500080 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8276c36e-5ad3-4793-80a7-c062cd37b0a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07f0c5bf1bee48a0bafdf7a9e4537c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:42:51.500648 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276c36e-5ad3-4793-80a7-c062cd37b0a2 service nova] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:51.500928 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276c36e-5ad3-4793-80a7-c062cd37b0a2 service nova] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:51.501208 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276c36e-5ad3-4793-80a7-c062cd37b0a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:51.502852 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-8276c36e-5ad3-4793-80a7-c062cd37b0a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:51.510192 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:51.598259 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8276c36e-5ad3-4793-80a7-c062cd37b0a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:42:51.599885 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8276c36e-5ad3-4793-80a7-c062cd37b0a2 service nova] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:42:51.618294 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 717/1431] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:42:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:42:52.573643 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fee855-c335-4884-a508-f3cb9ec73279 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:52.574219 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fee855-c335-4884-a508-f3cb9ec73279 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:52.574219 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fee855-c335-4884-a508-f3cb9ec73279 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:52.576172 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 715/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 16:42:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:42:52.581481 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69092a63-5a8f-413d-a460-d1210c6133ed None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:52.581953 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69092a63-5a8f-413d-a460-d1210c6133ed None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:52.582068 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69092a63-5a8f-413d-a460-d1210c6133ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:52.665812 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-69092a63-5a8f-413d-a460-d1210c6133ed None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:42:52.667027 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-69092a63-5a8f-413d-a460-d1210c6133ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:52.735587 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:52.766535 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 718/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 16:42:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:42:52.919623 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fee855-c335-4884-a508-f3cb9ec73279 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:42:52.921303 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-a2fee855-c335-4884-a508-f3cb9ec73279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:52.939890 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:53.084718 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fee855-c335-4884-a508-f3cb9ec73279 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:42:53.183523 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:53.209529 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9631b2af-0511-4f3d-907e-8cf26e70884b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07f0c5bf1bee48a0bafdf7a9e4537c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:42:53.210165 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9631b2af-0511-4f3d-907e-8cf26e70884b service nova] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:53.210444 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9631b2af-0511-4f3d-907e-8cf26e70884b service nova] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:53.210715 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9631b2af-0511-4f3d-907e-8cf26e70884b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:53.212422 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-9631b2af-0511-4f3d-907e-8cf26e70884b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:53.302702 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9631b2af-0511-4f3d-907e-8cf26e70884b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:42:53.304325 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9631b2af-0511-4f3d-907e-8cf26e70884b service nova] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:42:53.322400 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 716/1434] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:42:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:42:54.265040 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fbadfd-c3e8-457c-86be-34da5068019d None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:54.265604 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fbadfd-c3e8-457c-86be-34da5068019d None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:54.265727 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fbadfd-c3e8-457c-86be-34da5068019d None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:54.267044 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 719/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 16:42:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:42:54.272270 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2787735-e96e-4015-9ed4-3a5878737715 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:54.272717 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2787735-e96e-4015-9ed4-3a5878737715 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:54.272846 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2787735-e96e-4015-9ed4-3a5878737715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:54.345278 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-b2787735-e96e-4015-9ed4-3a5878737715 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:42:54.346472 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-b2787735-e96e-4015-9ed4-3a5878737715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:54.388016 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:54.443167 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 717/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 16:42:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:42:54.596798 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fbadfd-c3e8-457c-86be-34da5068019d None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:42:54.598294 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-69fbadfd-c3e8-457c-86be-34da5068019d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:54.743458 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fbadfd-c3e8-457c-86be-34da5068019d None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:42:54.798699 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:54.860325 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1056da0-33e3-4c3f-8def-59318237542f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07f0c5bf1bee48a0bafdf7a9e4537c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:42:54.861002 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1056da0-33e3-4c3f-8def-59318237542f service nova] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:54.861287 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1056da0-33e3-4c3f-8def-59318237542f service nova] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:54.861563 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1056da0-33e3-4c3f-8def-59318237542f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:54.863219 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-f1056da0-33e3-4c3f-8def-59318237542f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:54.960137 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1056da0-33e3-4c3f-8def-59318237542f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:42:54.961786 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1056da0-33e3-4c3f-8def-59318237542f service nova] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:42:54.984571 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 720/1437] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:42:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 16:42:55.960514 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1892743-609f-4a21-b7cc-8829f704dada None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:55.961102 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1892743-609f-4a21-b7cc-8829f704dada None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:55.961102 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1892743-609f-4a21-b7cc-8829f704dada None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:55.962424 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 718/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 16:42:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:42:55.967896 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b4c8f-13e2-48f0-b87c-43b466048c48 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:55.968336 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b4c8f-13e2-48f0-b87c-43b466048c48 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:55.968485 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b4c8f-13e2-48f0-b87c-43b466048c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:56.051281 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-895b4c8f-13e2-48f0-b87c-43b466048c48 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:42:56.052548 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-895b4c8f-13e2-48f0-b87c-43b466048c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:56.054577 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:56.165732 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 721/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 16:42:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:42:56.317969 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1892743-609f-4a21-b7cc-8829f704dada None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:42:56.319506 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-e1892743-609f-4a21-b7cc-8829f704dada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:56.473911 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1892743-609f-4a21-b7cc-8829f704dada None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:42:56.502978 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:56.604165 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ede57-53ec-450f-9828-c1c59768416e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07f0c5bf1bee48a0bafdf7a9e4537c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:42:56.605028 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ede57-53ec-450f-9828-c1c59768416e service nova] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:56.605444 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ede57-53ec-450f-9828-c1c59768416e service nova] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:56.605853 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ede57-53ec-450f-9828-c1c59768416e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:56.609066 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-649ede57-53ec-450f-9828-c1c59768416e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:56.710830 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649ede57-53ec-450f-9828-c1c59768416e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:42:56.712469 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649ede57-53ec-450f-9828-c1c59768416e service nova] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:42:56.734376 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 719/1440] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:42:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:42:58.772021 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa746298-7c00-48be-876b-7fffa952415c None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:58.772595 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa746298-7c00-48be-876b-7fffa952415c None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:58.772595 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa746298-7c00-48be-876b-7fffa952415c None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:58.774028 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 722/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 16:42:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:42:58.779498 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1b184-9386-479d-9bf1-6c5fc1bf1b7d None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:58.780022 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1b184-9386-479d-9bf1-6c5fc1bf1b7d None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:58.780204 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1b184-9386-479d-9bf1-6c5fc1bf1b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:58.821803 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:58.850907 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-7cf1b184-9386-479d-9bf1-6c5fc1bf1b7d None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:42:58.852234 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-7cf1b184-9386-479d-9bf1-6c5fc1bf1b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:58.955648 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 720/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 16:42:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:42:58.996496 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa746298-7c00-48be-876b-7fffa952415c None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:42:58.998033 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-fa746298-7c00-48be-876b-7fffa952415c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:59.112806 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa746298-7c00-48be-876b-7fffa952415c None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:42:59.148142 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:59.192465 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2426299-1cd8-4961-abc8-aab5502c1e95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:42:59.193116 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2426299-1cd8-4961-abc8-aab5502c1e95 service neutron] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:59.193401 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2426299-1cd8-4961-abc8-aab5502c1e95 service neutron] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:59.193675 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2426299-1cd8-4961-abc8-aab5502c1e95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:59.195372 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-a2426299-1cd8-4961-abc8-aab5502c1e95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:59.310881 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2426299-1cd8-4961-abc8-aab5502c1e95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:42:59.312344 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2426299-1cd8-4961-abc8-aab5502c1e95 service neutron] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:42:59.331108 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 723/1443] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:42:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:43:01.615459 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ac0a1-b974-43e8-abfb-0499c92d4963 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:01.615459 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ac0a1-b974-43e8-abfb-0499c92d4963 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:01.615459 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ac0a1-b974-43e8-abfb-0499c92d4963 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:01.617345 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 721/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 16:43:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:43:01.623952 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c387f8-9dae-429e-88f8-78a45cbcf202 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:01.624412 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c387f8-9dae-429e-88f8-78a45cbcf202 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:01.624524 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c387f8-9dae-429e-88f8-78a45cbcf202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:01.689750 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-78c387f8-9dae-429e-88f8-78a45cbcf202 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:43:01.690970 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-78c387f8-9dae-429e-88f8-78a45cbcf202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:01.703443 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:01.787694 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 724/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 16:43:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:43:01.827862 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2ac0a1-b974-43e8-abfb-0499c92d4963 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:43:01.829409 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-ee2ac0a1-b974-43e8-abfb-0499c92d4963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:01.943862 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2ac0a1-b974-43e8-abfb-0499c92d4963 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:43:01.956032 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:02.017789 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5948f2-b048-41c9-b7b6-a7986cd3db4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:43:02.018435 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5948f2-b048-41c9-b7b6-a7986cd3db4e service neutron] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:02.018721 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5948f2-b048-41c9-b7b6-a7986cd3db4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:02.018999 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5948f2-b048-41c9-b7b6-a7986cd3db4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:02.020684 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-5c5948f2-b048-41c9-b7b6-a7986cd3db4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:02.133360 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5948f2-b048-41c9-b7b6-a7986cd3db4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:43:02.134720 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5948f2-b048-41c9-b7b6-a7986cd3db4e service neutron] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:43:02.154551 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 722/1446] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:43:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:43:04.573166 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead75130-e071-4d03-a907-45403fc61908 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:04.573724 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead75130-e071-4d03-a907-45403fc61908 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:04.573724 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead75130-e071-4d03-a907-45403fc61908 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:04.575135 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 725/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 16:43:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:43:04.580446 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2df1dd-5c89-44e9-b6e8-ede54740a2c1 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:04.580844 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2df1dd-5c89-44e9-b6e8-ede54740a2c1 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:04.580994 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2df1dd-5c89-44e9-b6e8-ede54740a2c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:04.628101 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:04.648157 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-3c2df1dd-5c89-44e9-b6e8-ede54740a2c1 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:43:04.649412 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-3c2df1dd-5c89-44e9-b6e8-ede54740a2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:04.751986 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 723/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 16:43:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:43:04.791790 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead75130-e071-4d03-a907-45403fc61908 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:43:04.793405 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-ead75130-e071-4d03-a907-45403fc61908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:04.900320 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead75130-e071-4d03-a907-45403fc61908 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:43:04.940659 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:04.974614 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd22f92b-8b01-4822-b064-43a0bb933fd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:43:04.975262 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22f92b-8b01-4822-b064-43a0bb933fd3 service neutron] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:04.975543 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22f92b-8b01-4822-b064-43a0bb933fd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:04.975848 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22f92b-8b01-4822-b064-43a0bb933fd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:04.977494 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-fd22f92b-8b01-4822-b064-43a0bb933fd3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:05.088204 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd22f92b-8b01-4822-b064-43a0bb933fd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:43:05.089562 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd22f92b-8b01-4822-b064-43a0bb933fd3 service neutron] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:43:05.108739 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 726/1449] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:43:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:43:07.331539 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a0bf7b-b250-4231-918a-745c04caea5f None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:07.332140 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a0bf7b-b250-4231-918a-745c04caea5f None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:07.332140 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a0bf7b-b250-4231-918a-745c04caea5f None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:07.333534 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 724/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 16:43:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:43:07.338929 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5edd65-c127-42af-a2b4-0eda152f5466 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:07.339475 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5edd65-c127-42af-a2b4-0eda152f5466 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:07.339475 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5edd65-c127-42af-a2b4-0eda152f5466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:07.407185 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-5a5edd65-c127-42af-a2b4-0eda152f5466 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:43:07.408439 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-5a5edd65-c127-42af-a2b4-0eda152f5466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:07.429375 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:07.509424 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 727/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 16:43:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:43:07.547898 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a0bf7b-b250-4231-918a-745c04caea5f None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:43:07.549472 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-c4a0bf7b-b250-4231-918a-745c04caea5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:07.652214 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a0bf7b-b250-4231-918a-745c04caea5f None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:43:07.672382 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:07.726816 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7033c1-2f30-4287-bca1-e6f65e393f40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:43:07.727481 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7033c1-2f30-4287-bca1-e6f65e393f40 service neutron] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:07.727786 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7033c1-2f30-4287-bca1-e6f65e393f40 service neutron] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:07.728117 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7033c1-2f30-4287-bca1-e6f65e393f40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:07.729812 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-eb7033c1-2f30-4287-bca1-e6f65e393f40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:07.838480 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7033c1-2f30-4287-bca1-e6f65e393f40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:43:07.840467 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7033c1-2f30-4287-bca1-e6f65e393f40 service neutron] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:43:07.859137 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 725/1452] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:43:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:43:09.958616 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea8136-8bc9-4ae3-b9e7-500a085b03b7 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:09.959189 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea8136-8bc9-4ae3-b9e7-500a085b03b7 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:09.959189 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea8136-8bc9-4ae3-b9e7-500a085b03b7 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:09.960588 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 728/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 16:43:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:43:09.966384 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb68f26b-1a55-4164-b0bc-203663d28b4a None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:09.966854 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb68f26b-1a55-4164-b0bc-203663d28b4a None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:09.966964 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb68f26b-1a55-4164-b0bc-203663d28b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:10.028569 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:10.031500 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-bb68f26b-1a55-4164-b0bc-203663d28b4a None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:43:10.032729 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-bb68f26b-1a55-4164-b0bc-203663d28b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:10.127826 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 726/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 16:43:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:43:10.167011 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea8136-8bc9-4ae3-b9e7-500a085b03b7 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:43:10.168578 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-4dea8136-8bc9-4ae3-b9e7-500a085b03b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:10.275141 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea8136-8bc9-4ae3-b9e7-500a085b03b7 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:43:10.327732 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:10.357203 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9849debf-e45e-4707-a570-68e47b2d3cde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:43:10.357842 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9849debf-e45e-4707-a570-68e47b2d3cde service neutron] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:10.358118 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9849debf-e45e-4707-a570-68e47b2d3cde service neutron] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:10.358387 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9849debf-e45e-4707-a570-68e47b2d3cde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:10.360074 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-9849debf-e45e-4707-a570-68e47b2d3cde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:10.469536 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9849debf-e45e-4707-a570-68e47b2d3cde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:43:10.470996 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9849debf-e45e-4707-a570-68e47b2d3cde service neutron] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:43:10.490578 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 729/1455] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:43:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:43:12.605136 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffbaa7d-7a3b-4a8f-b20c-2788e4ee5778 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:12.605704 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffbaa7d-7a3b-4a8f-b20c-2788e4ee5778 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:12.605704 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffbaa7d-7a3b-4a8f-b20c-2788e4ee5778 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:12.607097 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 727/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 16:43:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:43:12.612693 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3edc3-4419-4958-bbe4-cafec0d58209 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:12.613132 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3edc3-4419-4958-bbe4-cafec0d58209 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:12.613256 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3edc3-4419-4958-bbe4-cafec0d58209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:12.677282 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-54d3edc3-4419-4958-bbe4-cafec0d58209 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:43:12.678481 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-54d3edc3-4419-4958-bbe4-cafec0d58209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:12.707035 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:12.776875 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 730/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 16:43:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:43:12.815584 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffbaa7d-7a3b-4a8f-b20c-2788e4ee5778 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:43:12.817146 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-fffbaa7d-7a3b-4a8f-b20c-2788e4ee5778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:12.922035 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffbaa7d-7a3b-4a8f-b20c-2788e4ee5778 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:43:12.951661 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:12.998090 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa86bc7-fae1-4008-a3a4-3459b2f58bb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:43:12.998743 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa86bc7-fae1-4008-a3a4-3459b2f58bb9 service neutron] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:12.999049 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa86bc7-fae1-4008-a3a4-3459b2f58bb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:12.999325 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa86bc7-fae1-4008-a3a4-3459b2f58bb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:13.001040 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-efa86bc7-fae1-4008-a3a4-3459b2f58bb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:13.118886 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa86bc7-fae1-4008-a3a4-3459b2f58bb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:43:13.118886 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa86bc7-fae1-4008-a3a4-3459b2f58bb9 service neutron] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:43:13.133415 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 728/1458] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:43:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:43:15.256541 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5adcd1-d435-40dc-a22d-7f8dd7791baf None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:15.257154 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5adcd1-d435-40dc-a22d-7f8dd7791baf None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:15.257154 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5adcd1-d435-40dc-a22d-7f8dd7791baf None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:15.258573 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 731/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 16:43:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:43:15.264985 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cce6f8-b2a0-4a0e-8452-51618f41bbae None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:15.265491 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cce6f8-b2a0-4a0e-8452-51618f41bbae None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:15.265781 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cce6f8-b2a0-4a0e-8452-51618f41bbae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:15.332850 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-81cce6f8-b2a0-4a0e-8452-51618f41bbae None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:43:15.334077 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-81cce6f8-b2a0-4a0e-8452-51618f41bbae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:15.342637 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:15.439309 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 729/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 16:43:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:43:15.479730 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5adcd1-d435-40dc-a22d-7f8dd7791baf None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:43:15.481284 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-fd5adcd1-d435-40dc-a22d-7f8dd7791baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:15.586249 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5adcd1-d435-40dc-a22d-7f8dd7791baf None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:43:15.641082 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:15.660464 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d0923f-c611-4697-ae8c-d65650522da7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:43:15.661118 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d0923f-c611-4697-ae8c-d65650522da7 service neutron] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:15.661401 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d0923f-c611-4697-ae8c-d65650522da7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:15.661677 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d0923f-c611-4697-ae8c-d65650522da7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:15.663330 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-79d0923f-c611-4697-ae8c-d65650522da7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:15.772770 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d0923f-c611-4697-ae8c-d65650522da7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:43:15.774215 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d0923f-c611-4697-ae8c-d65650522da7 service neutron] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:43:15.793435 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 732/1461] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:43:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:43:17.870800 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a7817-207e-4d2a-b4a4-9676354d4c61 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:17.871361 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a7817-207e-4d2a-b4a4-9676354d4c61 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:17.871361 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a7817-207e-4d2a-b4a4-9676354d4c61 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:17.872796 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 730/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 16:43:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:43:17.878398 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34418b-8e1b-4746-9062-e7088ed1a414 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:17.878821 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34418b-8e1b-4746-9062-e7088ed1a414 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:17.879343 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34418b-8e1b-4746-9062-e7088ed1a414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:17.945141 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-4b34418b-8e1b-4746-9062-e7088ed1a414 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:43:17.946382 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-4b34418b-8e1b-4746-9062-e7088ed1a414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:17.987132 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:18.050262 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 733/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 16:43:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:43:18.088416 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a7817-207e-4d2a-b4a4-9676354d4c61 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:43:18.089965 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-670a7817-207e-4d2a-b4a4-9676354d4c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:18.203429 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a7817-207e-4d2a-b4a4-9676354d4c61 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:43:18.244159 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:18.281190 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8ebab-c69c-4ce5-91ed-2cfe900e5853 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:43:18.281842 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8ebab-c69c-4ce5-91ed-2cfe900e5853 service neutron] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:18.282126 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8ebab-c69c-4ce5-91ed-2cfe900e5853 service neutron] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:18.282404 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8ebab-c69c-4ce5-91ed-2cfe900e5853 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:18.284099 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-b6b8ebab-c69c-4ce5-91ed-2cfe900e5853 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:18.395145 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b8ebab-c69c-4ce5-91ed-2cfe900e5853 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:43:18.396625 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b8ebab-c69c-4ce5-91ed-2cfe900e5853 service neutron] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:43:18.416663 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 731/1464] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:43:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:43:20.572812 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04572e34-e63a-459b-940f-a0acde8c989d None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:20.573556 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04572e34-e63a-459b-940f-a0acde8c989d None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:20.573556 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04572e34-e63a-459b-940f-a0acde8c989d None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:20.574765 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 734/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 16:43:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:43:20.580287 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795815f-222b-4ecb-981b-40bb55ac28e2 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:20.580753 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795815f-222b-4ecb-981b-40bb55ac28e2 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:20.580858 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795815f-222b-4ecb-981b-40bb55ac28e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:20.647641 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-0795815f-222b-4ecb-981b-40bb55ac28e2 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:43:20.649076 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-0795815f-222b-4ecb-981b-40bb55ac28e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:20.668749 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:20.748860 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 732/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 16:43:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:43:20.786361 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04572e34-e63a-459b-940f-a0acde8c989d None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:43:20.787910 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-04572e34-e63a-459b-940f-a0acde8c989d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:20.895846 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04572e34-e63a-459b-940f-a0acde8c989d None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:43:20.964815 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:20.971688 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7ee580-50d7-42f3-8312-812c525c427f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:43:20.972398 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ee580-50d7-42f3-8312-812c525c427f service neutron] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:20.972678 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ee580-50d7-42f3-8312-812c525c427f service neutron] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:20.972956 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ee580-50d7-42f3-8312-812c525c427f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:20.974609 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-bd7ee580-50d7-42f3-8312-812c525c427f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:21.087287 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7ee580-50d7-42f3-8312-812c525c427f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:43:21.088670 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7ee580-50d7-42f3-8312-812c525c427f service neutron] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:43:21.107586 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 735/1467] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:43:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:43:23.148325 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d600c09-b888-4b0b-b48e-0f254e8030b7 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:23.148865 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d600c09-b888-4b0b-b48e-0f254e8030b7 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:23.148990 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d600c09-b888-4b0b-b48e-0f254e8030b7 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:23.150378 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 733/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 16:43:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:43:23.156035 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40144e6d-9096-48e8-aa98-58ba8c26ef2f None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:23.156542 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40144e6d-9096-48e8-aa98-58ba8c26ef2f None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:23.156652 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40144e6d-9096-48e8-aa98-58ba8c26ef2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:23.223897 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-40144e6d-9096-48e8-aa98-58ba8c26ef2f None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:43:23.228724 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-40144e6d-9096-48e8-aa98-58ba8c26ef2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:23.274794 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:23.324686 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 736/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 16:43:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:43:23.362641 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d600c09-b888-4b0b-b48e-0f254e8030b7 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:43:23.364229 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-6d600c09-b888-4b0b-b48e-0f254e8030b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:23.471250 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d600c09-b888-4b0b-b48e-0f254e8030b7 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:43:23.520321 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:23.546595 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf7c55-320c-4191-bf3a-8b00d72fd916 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:43:23.547236 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf7c55-320c-4191-bf3a-8b00d72fd916 service neutron] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:23.547510 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf7c55-320c-4191-bf3a-8b00d72fd916 service neutron] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:23.547807 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf7c55-320c-4191-bf3a-8b00d72fd916 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:23.549526 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-3daf7c55-320c-4191-bf3a-8b00d72fd916 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:23.660104 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daf7c55-320c-4191-bf3a-8b00d72fd916 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:43:23.661531 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daf7c55-320c-4191-bf3a-8b00d72fd916 service neutron] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:43:23.680818 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 734/1470] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:43:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:43:33.379832 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=22 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:33.678544 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=66 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:43.568759 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c138e58-d45c-4a65-ac15-35d6a7c3e601 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:43.569319 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c138e58-d45c-4a65-ac15-35d6a7c3e601 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:43.569319 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c138e58-d45c-4a65-ac15-35d6a7c3e601 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:43.570691 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 737/1471] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:43:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:43:43.576015 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29742412-0254-4448-ac77-67abc2e60504 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:43.576448 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29742412-0254-4448-ac77-67abc2e60504 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:43.576548 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29742412-0254-4448-ac77-67abc2e60504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:43.640750 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-29742412-0254-4448-ac77-67abc2e60504 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:43:43.641953 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-29742412-0254-4448-ac77-67abc2e60504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:43.736600 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 735/1472] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:43:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:43:43.785612 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92dd4d4-31a1-430e-b46f-62ab273d5f76 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:43.785881 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92dd4d4-31a1-430e-b46f-62ab273d5f76 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:43.786161 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92dd4d4-31a1-430e-b46f-62ab273d5f76 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:43.787537 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 738/1473] 10.222.0.81 () {54 vars in 961 bytes} [Mon Jul 18 16:43:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:43:43.793277 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f19f7e-1695-468a-90bd-c2eac15b3bcc None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:43.793558 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f19f7e-1695-468a-90bd-c2eac15b3bcc None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:43.793851 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f19f7e-1695-468a-90bd-c2eac15b3bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:43.871220 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-22f19f7e-1695-468a-90bd-c2eac15b3bcc None None] MFA Rules not processed for user `e638fbc5f1f3447c8e189c228bbae530`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:43:43.872477 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-22f19f7e-1695-468a-90bd-c2eac15b3bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:43.893469 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:43.950092 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 736/1474] 10.222.0.81 () {58 vars in 1058 bytes} [Mon Jul 18 16:43:43 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:43:43.957836 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92dd4d4-31a1-430e-b46f-62ab273d5f76 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:43:43.959364 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-a92dd4d4-31a1-430e-b46f-62ab273d5f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:44.067268 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92dd4d4-31a1-430e-b46f-62ab273d5f76 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:43:44.140917 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb20234d-cd1b-4f39-9cca-d47907e2daa3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e638fbc5f1f3447c8e189c228bbae530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:43:44.141567 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20234d-cd1b-4f39-9cca-d47907e2daa3 service glance] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:44.141851 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20234d-cd1b-4f39-9cca-d47907e2daa3 service glance] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:44.142126 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20234d-cd1b-4f39-9cca-d47907e2daa3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:44.143808 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-fb20234d-cd1b-4f39-9cca-d47907e2daa3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:44.197922 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:44.258336 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb20234d-cd1b-4f39-9cca-d47907e2daa3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:43:44.260291 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb20234d-cd1b-4f39-9cca-d47907e2daa3 service glance] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:43:44.279256 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 739/1475] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:43:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:43:46.409941 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ef107-0a7a-4f07-8f1b-e3b815e77aa0 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:46.410522 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ef107-0a7a-4f07-8f1b-e3b815e77aa0 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:46.410522 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ef107-0a7a-4f07-8f1b-e3b815e77aa0 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:46.411924 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 737/1476] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:43:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:43:46.417711 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc29a32a-ba0d-461e-8d85-014744cc421d None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:46.418146 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc29a32a-ba0d-461e-8d85-014744cc421d None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:46.418256 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc29a32a-ba0d-461e-8d85-014744cc421d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:46.484691 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-dc29a32a-ba0d-461e-8d85-014744cc421d None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:43:46.485722 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-dc29a32a-ba0d-461e-8d85-014744cc421d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:46.593959 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 740/1477] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:43:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:43:46.616630 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958ef107-0a7a-4f07-8f1b-e3b815e77aa0 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:43:46.618180 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-958ef107-0a7a-4f07-8f1b-e3b815e77aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:46.741308 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958ef107-0a7a-4f07-8f1b-e3b815e77aa0 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:43:46.789710 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:46.834338 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085bec75-1551-49ad-8dee-f69192a9e629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:43:46.834999 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085bec75-1551-49ad-8dee-f69192a9e629 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:46.835278 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085bec75-1551-49ad-8dee-f69192a9e629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:46.835550 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085bec75-1551-49ad-8dee-f69192a9e629 admin admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:46.836302 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085bec75-1551-49ad-8dee-f69192a9e629 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:43:46.838027 dv-cinder-846173-3-smb devstack@keystone.service[80545]: WARNING py.warnings [None req-085bec75-1551-49ad-8dee-f69192a9e629 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 16:43:46.838027 dv-cinder-846173-3-smb devstack@keystone.service[80545]: warnings.warn(msg) Jul 18 16:43:46.838027 dv-cinder-846173-3-smb devstack@keystone.service[80545]: Jul 18 16:43:46.839165 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085bec75-1551-49ad-8dee-f69192a9e629 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:43:46.858785 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 738/1478] 10.222.0.81 () {56 vars in 1108 bytes} [Mon Jul 18 16:43:46 2022] GET /identity/v3/projects => generated 2553 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:43:48.910905 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a2683-b787-4fe5-9ea3-9dc85c53393e None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:48.911477 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a2683-b787-4fe5-9ea3-9dc85c53393e None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:48.911477 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a2683-b787-4fe5-9ea3-9dc85c53393e None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:48.912897 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 741/1479] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:43:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:43:48.918977 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c6333-c566-445f-9abe-8ea0d4824128 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:48.922173 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c6333-c566-445f-9abe-8ea0d4824128 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:48.922173 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c6333-c566-445f-9abe-8ea0d4824128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:48.985535 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-084c6333-c566-445f-9abe-8ea0d4824128 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:43:48.986757 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-084c6333-c566-445f-9abe-8ea0d4824128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:49.086684 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 739/1480] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:43:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:43:49.131419 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a2683-b787-4fe5-9ea3-9dc85c53393e None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:43:49.133013 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-b61a2683-b787-4fe5-9ea3-9dc85c53393e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:49.143061 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:49.286174 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a2683-b787-4fe5-9ea3-9dc85c53393e None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:43:49.368903 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:49.402743 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dba9a8-2c6d-4572-a6e8-1f0cdff1cc09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07f0c5bf1bee48a0bafdf7a9e4537c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:43:49.403387 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dba9a8-2c6d-4572-a6e8-1f0cdff1cc09 service nova] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:49.403663 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dba9a8-2c6d-4572-a6e8-1f0cdff1cc09 service nova] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:49.403967 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dba9a8-2c6d-4572-a6e8-1f0cdff1cc09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:49.405621 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-48dba9a8-2c6d-4572-a6e8-1f0cdff1cc09 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:49.493279 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dba9a8-2c6d-4572-a6e8-1f0cdff1cc09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:43:49.495396 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dba9a8-2c6d-4572-a6e8-1f0cdff1cc09 service nova] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:43:49.514026 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 742/1481] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:43:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:43:51.774094 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b21be-3f31-4cf2-92ac-e2a72ffd9974 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:51.774745 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b21be-3f31-4cf2-92ac-e2a72ffd9974 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:51.774745 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b21be-3f31-4cf2-92ac-e2a72ffd9974 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:51.776045 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 740/1482] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:43:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:43:51.781272 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e58b9-29d5-4704-a7e9-43c71e9c1e7f None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:51.781743 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e58b9-29d5-4704-a7e9-43c71e9c1e7f None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:51.781855 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e58b9-29d5-4704-a7e9-43c71e9c1e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:51.847902 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-6c3e58b9-29d5-4704-a7e9-43c71e9c1e7f None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:43:51.849112 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-6c3e58b9-29d5-4704-a7e9-43c71e9c1e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:51.898428 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:51.949370 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 743/1483] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:43:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:43:51.985515 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777b21be-3f31-4cf2-92ac-e2a72ffd9974 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:43:51.987039 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-777b21be-3f31-4cf2-92ac-e2a72ffd9974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:52.012018 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:52.092046 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777b21be-3f31-4cf2-92ac-e2a72ffd9974 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:43:52.165137 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fe33b6-b21e-416b-acfd-a763ce9b339e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:43:52.166339 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe33b6-b21e-416b-acfd-a763ce9b339e service neutron] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:52.166619 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe33b6-b21e-416b-acfd-a763ce9b339e service neutron] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:52.166893 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe33b6-b21e-416b-acfd-a763ce9b339e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:52.168619 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-a0fe33b6-b21e-416b-acfd-a763ce9b339e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:52.241959 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:52.277239 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fe33b6-b21e-416b-acfd-a763ce9b339e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:43:52.278678 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fe33b6-b21e-416b-acfd-a763ce9b339e service neutron] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:43:52.297356 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 741/1484] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:43:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:43:54.366898 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d5104-91bf-42f0-b07b-371c6070db83 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:54.367462 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d5104-91bf-42f0-b07b-371c6070db83 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:54.367462 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d5104-91bf-42f0-b07b-371c6070db83 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:54.369399 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 744/1485] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:43:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:43:54.374603 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701b3b6-221b-40e8-a067-eaa54975f41d None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:54.375020 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701b3b6-221b-40e8-a067-eaa54975f41d None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:54.375162 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701b3b6-221b-40e8-a067-eaa54975f41d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:54.440554 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-a701b3b6-221b-40e8-a067-eaa54975f41d None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:43:54.441755 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-a701b3b6-221b-40e8-a067-eaa54975f41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:54.538395 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 742/1486] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:43:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:43:54.577268 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d5104-91bf-42f0-b07b-371c6070db83 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:43:54.578795 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-9b5d5104-91bf-42f0-b07b-371c6070db83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:54.682502 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d5104-91bf-42f0-b07b-371c6070db83 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:43:54.756960 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:54.758816 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5f9416-daf2-4a38-81c0-c17eceb420ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:43:54.759465 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f9416-daf2-4a38-81c0-c17eceb420ab service neutron] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:54.759774 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f9416-daf2-4a38-81c0-c17eceb420ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:54.760053 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f9416-daf2-4a38-81c0-c17eceb420ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:54.761704 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-7e5f9416-daf2-4a38-81c0-c17eceb420ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:54.871142 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5f9416-daf2-4a38-81c0-c17eceb420ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:43:54.872611 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5f9416-daf2-4a38-81c0-c17eceb420ab service neutron] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:43:54.892843 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 745/1487] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:43:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:43:57.057633 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c2ca0-1144-431f-b692-440688b6f81c None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:57.058189 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c2ca0-1144-431f-b692-440688b6f81c None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:57.058189 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c2ca0-1144-431f-b692-440688b6f81c None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:57.059788 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 743/1488] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:43:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:43:57.065412 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d71b46-f6c3-4c01-8de1-a8f435765552 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:57.065891 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d71b46-f6c3-4c01-8de1-a8f435765552 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:57.065991 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d71b46-f6c3-4c01-8de1-a8f435765552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:57.132080 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-57d71b46-f6c3-4c01-8de1-a8f435765552 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:43:57.133304 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-57d71b46-f6c3-4c01-8de1-a8f435765552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:57.190782 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:57.234690 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 746/1489] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:43:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:43:57.276489 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7c2ca0-1144-431f-b692-440688b6f81c None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:43:57.278019 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-2f7c2ca0-1144-431f-b692-440688b6f81c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:57.314401 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:57.380844 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7c2ca0-1144-431f-b692-440688b6f81c None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:43:57.452897 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e2a1b4-eabb-4078-94e8-bd2c091a488f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:43:57.453557 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e2a1b4-eabb-4078-94e8-bd2c091a488f service neutron] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:57.453842 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e2a1b4-eabb-4078-94e8-bd2c091a488f service neutron] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:57.454127 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e2a1b4-eabb-4078-94e8-bd2c091a488f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:57.455811 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-a7e2a1b4-eabb-4078-94e8-bd2c091a488f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:57.542082 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:57.570911 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e2a1b4-eabb-4078-94e8-bd2c091a488f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:43:57.572858 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e2a1b4-eabb-4078-94e8-bd2c091a488f service neutron] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:43:57.591919 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 744/1490] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:43:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:44:00.151980 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75f227-3915-4e38-be22-9f575bc69996 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:44:00.152521 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75f227-3915-4e38-be22-9f575bc69996 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:44:00.152521 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75f227-3915-4e38-be22-9f575bc69996 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:44:00.153858 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 747/1491] 10.222.0.81 () {54 vars in 926 bytes} [Mon Jul 18 16:44:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:44:00.159300 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c54b1c4-3ca8-447c-9c61-6ffb2a4f7bf2 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:44:00.159740 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c54b1c4-3ca8-447c-9c61-6ffb2a4f7bf2 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:44:00.159740 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c54b1c4-3ca8-447c-9c61-6ffb2a4f7bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:44:00.225759 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-6c54b1c4-3ca8-447c-9c61-6ffb2a4f7bf2 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:44:00.226969 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-6c54b1c4-3ca8-447c-9c61-6ffb2a4f7bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:44:00.322724 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 745/1492] 10.222.0.81 () {58 vars in 1023 bytes} [Mon Jul 18 16:44:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:44:00.366228 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a75f227-3915-4e38-be22-9f575bc69996 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:44:00.367793 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-8a75f227-3915-4e38-be22-9f575bc69996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:44:00.471095 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a75f227-3915-4e38-be22-9f575bc69996 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:44:00.543879 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccce870-1ce0-4367-9549-22327cbe1a53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:44:00.544516 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccce870-1ce0-4367-9549-22327cbe1a53 service neutron] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:44:00.544791 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccce870-1ce0-4367-9549-22327cbe1a53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:44:00.545059 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccce870-1ce0-4367-9549-22327cbe1a53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:44:00.546673 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-eccce870-1ce0-4367-9549-22327cbe1a53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:44:00.555671 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:44:00.656454 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccce870-1ce0-4367-9549-22327cbe1a53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:44:00.657916 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccce870-1ce0-4367-9549-22327cbe1a53 service neutron] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:44:00.675834 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 748/1493] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:44:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:44:10.320821 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=82 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:44:10.673636 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=50 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:45:37.890558 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360f8035-9b2c-43c9-8329-124e328b84ce None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:45:37.891165 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360f8035-9b2c-43c9-8329-124e328b84ce None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:45:37.891165 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360f8035-9b2c-43c9-8329-124e328b84ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:45:37.964991 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-360f8035-9b2c-43c9-8329-124e328b84ce None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:45:37.966211 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-360f8035-9b2c-43c9-8329-124e328b84ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:45:38.062140 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 746/1494] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:45:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:45:38.071652 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe3997-dd64-41b1-b70f-6088b69c85ff None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:45:38.072271 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe3997-dd64-41b1-b70f-6088b69c85ff None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:45:38.072271 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe3997-dd64-41b1-b70f-6088b69c85ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:45:38.161428 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-48fe3997-dd64-41b1-b70f-6088b69c85ff None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:45:38.163263 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-48fe3997-dd64-41b1-b70f-6088b69c85ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:45:38.260881 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 749/1495] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:45:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:45:38.265648 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360f8035-9b2c-43c9-8329-124e328b84ce None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:45:38.266858 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-360f8035-9b2c-43c9-8329-124e328b84ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:45:38.278545 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360f8035-9b2c-43c9-8329-124e328b84ce None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:45:38.340851 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:45:38.374726 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a52769-3937-42cd-a650-beef92d47c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:45:38.375394 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a52769-3937-42cd-a650-beef92d47c10 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:45:38.375676 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a52769-3937-42cd-a650-beef92d47c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:45:38.375980 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a52769-3937-42cd-a650-beef92d47c10 admin admin] PATH_INFO: `/v3/domains` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:45:38.376702 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a52769-3937-42cd-a650-beef92d47c10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:45:38.377265 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a52769-3937-42cd-a650-beef92d47c10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:45:38.378285 dv-cinder-846173-3-smb devstack@keystone.service[80545]: WARNING py.warnings [None req-74a52769-3937-42cd-a650-beef92d47c10 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 16:45:38.378285 dv-cinder-846173-3-smb devstack@keystone.service[80545]: warnings.warn(msg) Jul 18 16:45:38.378285 dv-cinder-846173-3-smb devstack@keystone.service[80545]: Jul 18 16:45:38.379228 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a52769-3937-42cd-a650-beef92d47c10 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:45:38.391027 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 747/1496] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Jul 18 16:45:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:45:38.399895 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe3997-dd64-41b1-b70f-6088b69c85ff None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:45:38.409486 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe3997-dd64-41b1-b70f-6088b69c85ff None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:45:38.474169 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:45:38.517039 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc3504-ac7d-4678-a2f7-d3f468a2abba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:45:38.517727 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc3504-ac7d-4678-a2f7-d3f468a2abba admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:45:38.518014 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc3504-ac7d-4678-a2f7-d3f468a2abba admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:45:38.518290 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc3504-ac7d-4678-a2f7-d3f468a2abba admin admin] PATH_INFO: `/v3/projects` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:45:38.518998 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dc3504-ac7d-4678-a2f7-d3f468a2abba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:45:38.521368 dv-cinder-846173-3-smb devstack@keystone.service[80544]: WARNING py.warnings [None req-43dc3504-ac7d-4678-a2f7-d3f468a2abba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 16:45:38.521368 dv-cinder-846173-3-smb devstack@keystone.service[80544]: warnings.warn(msg) Jul 18 16:45:38.521368 dv-cinder-846173-3-smb devstack@keystone.service[80544]: Jul 18 16:45:38.522567 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dc3504-ac7d-4678-a2f7-d3f468a2abba admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:45:38.640505 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 750/1497] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:45:38 2022] POST /identity/v3/projects => generated 377 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:45:38.645313 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a52769-3937-42cd-a650-beef92d47c10 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:45:38.646842 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-74a52769-3937-42cd-a650-beef92d47c10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:45:38.680313 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a52769-3937-42cd-a650-beef92d47c10 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:45:38.778565 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf13fc9b-4004-4fbd-a6b9-f81977a54b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:45:38.779317 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf13fc9b-4004-4fbd-a6b9-f81977a54b3c admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:45:38.779645 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf13fc9b-4004-4fbd-a6b9-f81977a54b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:45:38.779971 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf13fc9b-4004-4fbd-a6b9-f81977a54b3c admin admin] PATH_INFO: `/v3/users` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:45:38.780735 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf13fc9b-4004-4fbd-a6b9-f81977a54b3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:45:38.781757 dv-cinder-846173-3-smb devstack@keystone.service[80545]: WARNING py.warnings [None req-bf13fc9b-4004-4fbd-a6b9-f81977a54b3c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 16:45:38.781757 dv-cinder-846173-3-smb devstack@keystone.service[80545]: warnings.warn(msg) Jul 18 16:45:38.781757 dv-cinder-846173-3-smb devstack@keystone.service[80545]: Jul 18 16:45:38.782969 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf13fc9b-4004-4fbd-a6b9-f81977a54b3c admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:45:39.021104 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 748/1498] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 16:45:38 2022] POST /identity/v3/users => generated 289 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:45:39.025323 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc3504-ac7d-4678-a2f7-d3f468a2abba admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:45:39.026842 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-43dc3504-ac7d-4678-a2f7-d3f468a2abba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:45:39.089104 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc3504-ac7d-4678-a2f7-d3f468a2abba admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:45:39.176822 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:45:39.187843 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616c791d-4d71-44ea-9daa-d1454ab5bb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:45:39.191931 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c791d-4d71-44ea-9daa-d1454ab5bb5d admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:45:39.191931 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c791d-4d71-44ea-9daa-d1454ab5bb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:45:39.191931 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c791d-4d71-44ea-9daa-d1454ab5bb5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:45:39.191931 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616c791d-4d71-44ea-9daa-d1454ab5bb5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:45:39.191931 dv-cinder-846173-3-smb devstack@keystone.service[80544]: WARNING py.warnings [None req-616c791d-4d71-44ea-9daa-d1454ab5bb5d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 16:45:39.191931 dv-cinder-846173-3-smb devstack@keystone.service[80544]: warnings.warn(msg) Jul 18 16:45:39.191931 dv-cinder-846173-3-smb devstack@keystone.service[80544]: Jul 18 16:45:39.192595 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616c791d-4d71-44ea-9daa-d1454ab5bb5d admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:45:39.204135 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 751/1499] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:45:39 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:45:39.208719 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf13fc9b-4004-4fbd-a6b9-f81977a54b3c admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:45:39.210253 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-bf13fc9b-4004-4fbd-a6b9-f81977a54b3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:45:39.221681 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf13fc9b-4004-4fbd-a6b9-f81977a54b3c admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:45:39.247465 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:45:39.318423 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde399ff-3b0e-42ef-b277-dc0d46459dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:45:39.319049 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde399ff-3b0e-42ef-b277-dc0d46459dca admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:45:39.319294 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde399ff-3b0e-42ef-b277-dc0d46459dca admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:45:39.319571 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde399ff-3b0e-42ef-b277-dc0d46459dca admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:45:39.320325 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde399ff-3b0e-42ef-b277-dc0d46459dca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:45:39.321357 dv-cinder-846173-3-smb devstack@keystone.service[80545]: WARNING py.warnings [None req-fde399ff-3b0e-42ef-b277-dc0d46459dca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 16:45:39.321357 dv-cinder-846173-3-smb devstack@keystone.service[80545]: warnings.warn(msg) Jul 18 16:45:39.321357 dv-cinder-846173-3-smb devstack@keystone.service[80545]: Jul 18 16:45:39.322268 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde399ff-3b0e-42ef-b277-dc0d46459dca admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:45:39.335167 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 749/1500] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:45:39 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:45:39.339549 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616c791d-4d71-44ea-9daa-d1454ab5bb5d admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:45:39.341105 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-616c791d-4d71-44ea-9daa-d1454ab5bb5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:45:39.374920 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616c791d-4d71-44ea-9daa-d1454ab5bb5d admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:45:39.469676 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f085bb0-ac99-473d-b2b0-9014f5cb7cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:45:39.470569 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f085bb0-ac99-473d-b2b0-9014f5cb7cdb admin admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:45:39.470854 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f085bb0-ac99-473d-b2b0-9014f5cb7cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:45:39.471131 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f085bb0-ac99-473d-b2b0-9014f5cb7cdb admin admin] PATH_INFO: `/v3/projects/2bd5a7f38e034360894814b52871bd17/users/345571c87acc4245851a092ae41000b2/roles/ad3a2bc7b2094a4da1a95a143c8d9436` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:45:39.494615 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f085bb0-ac99-473d-b2b0-9014f5cb7cdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bd5a7f38e034360894814b52871bd17, user_id=345571c87acc4245851a092ae41000b2, role_id=ad3a2bc7b2094a4da1a95a143c8d9436)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:45:39.495647 dv-cinder-846173-3-smb devstack@keystone.service[80544]: WARNING py.warnings [None req-8f085bb0-ac99-473d-b2b0-9014f5cb7cdb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 16:45:39.495647 dv-cinder-846173-3-smb devstack@keystone.service[80544]: warnings.warn(msg) Jul 18 16:45:39.495647 dv-cinder-846173-3-smb devstack@keystone.service[80544]: Jul 18 16:45:39.497633 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f085bb0-ac99-473d-b2b0-9014f5cb7cdb admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:45:39.585830 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 752/1501] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:45:39 2022] PUT /identity/v3/projects/2bd5a7f38e034360894814b52871bd17/users/345571c87acc4245851a092ae41000b2/roles/ad3a2bc7b2094a4da1a95a143c8d9436 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:45:39.598820 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d1e9b-5ecd-4d95-a721-16d0990b9326 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:45:39.599139 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d1e9b-5ecd-4d95-a721-16d0990b9326 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:45:39.599514 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d1e9b-5ecd-4d95-a721-16d0990b9326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:45:39.656137 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-556d1e9b-5ecd-4d95-a721-16d0990b9326 None None] MFA Rules not processed for user `345571c87acc4245851a092ae41000b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:45:39.657447 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-556d1e9b-5ecd-4d95-a721-16d0990b9326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:45:39.734915 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 750/1502] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:45:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:45:39.749213 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff548f-9448-4fd6-85d7-cc00155b839d None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:45:39.749506 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff548f-9448-4fd6-85d7-cc00155b839d None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:45:39.749791 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff548f-9448-4fd6-85d7-cc00155b839d None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:45:39.751297 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 753/1503] 10.222.0.81 () {54 vars in 964 bytes} [Mon Jul 18 16:45:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:45:39.757648 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086730f-aaba-4041-874b-c9b7359229b5 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:45:39.757813 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086730f-aaba-4041-874b-c9b7359229b5 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:45:39.758031 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086730f-aaba-4041-874b-c9b7359229b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:45:39.788469 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:45:39.831281 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-c086730f-aaba-4041-874b-c9b7359229b5 None None] MFA Rules not processed for user `baaee55accfa458a9832127c5ab77656`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:45:39.833051 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-c086730f-aaba-4041-874b-c9b7359229b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:45:39.908824 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 751/1504] 10.222.0.81 () {58 vars in 1061 bytes} [Mon Jul 18 16:45:39 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:45:39.917062 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff548f-9448-4fd6-85d7-cc00155b839d None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:45:39.918652 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-75ff548f-9448-4fd6-85d7-cc00155b839d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:45:39.969990 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:45:40.023944 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff548f-9448-4fd6-85d7-cc00155b839d None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:45:40.097966 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f613728-bc5b-4025-b33d-75041faf5cb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:45:40.098663 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f613728-bc5b-4025-b33d-75041faf5cb9 service cinder] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:45:40.098874 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f613728-bc5b-4025-b33d-75041faf5cb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:45:40.099148 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f613728-bc5b-4025-b33d-75041faf5cb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:45:40.100809 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-2f613728-bc5b-4025-b33d-75041faf5cb9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:45:40.203739 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f613728-bc5b-4025-b33d-75041faf5cb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:45:40.205094 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f613728-bc5b-4025-b33d-75041faf5cb9 service cinder] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:45:40.209204 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:45:40.223354 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 754/1505] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:45:39 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:45:40.271211 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd87602-606e-4c4c-ace3-983913bf6bff None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:45:40.271672 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd87602-606e-4c4c-ace3-983913bf6bff None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:45:40.271817 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd87602-606e-4c4c-ace3-983913bf6bff None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:45:40.273119 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 752/1506] 10.222.0.81 () {52 vars in 829 bytes} [Mon Jul 18 16:45:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:45:40.276640 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f613728-bc5b-4025-b33d-75041faf5cb9 service cinder] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:45:40.277900 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-2f613728-bc5b-4025-b33d-75041faf5cb9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:45:40.378709 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f613728-bc5b-4025-b33d-75041faf5cb9 service cinder] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:45:40.472713 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea656222-1fcf-4c0e-86a1-cddf6dc9e961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:45:40.473591 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea656222-1fcf-4c0e-86a1-cddf6dc9e961 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:45:40.473869 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea656222-1fcf-4c0e-86a1-cddf6dc9e961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:45:40.474142 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea656222-1fcf-4c0e-86a1-cddf6dc9e961 admin admin] PATH_INFO: `/v3/users/345571c87acc4245851a092ae41000b2` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:45:40.486674 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea656222-1fcf-4c0e-86a1-cddf6dc9e961 admin admin] RBAC: Authorizing `identity:delete_user(user_id=345571c87acc4245851a092ae41000b2)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:45:40.487739 dv-cinder-846173-3-smb devstack@keystone.service[80544]: WARNING py.warnings [None req-ea656222-1fcf-4c0e-86a1-cddf6dc9e961 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 16:45:40.487739 dv-cinder-846173-3-smb devstack@keystone.service[80544]: warnings.warn(msg) Jul 18 16:45:40.487739 dv-cinder-846173-3-smb devstack@keystone.service[80544]: Jul 18 16:45:40.489685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea656222-1fcf-4c0e-86a1-cddf6dc9e961 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:45:40.499597 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:45:40.713104 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-ea656222-1fcf-4c0e-86a1-cddf6dc9e961 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '345571c87acc4245851a092ae41000b2'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:45:40.733591 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-ea656222-1fcf-4c0e-86a1-cddf6dc9e961 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '345571c87acc4245851a092ae41000b2'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:45:40.734156 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-ea656222-1fcf-4c0e-86a1-cddf6dc9e961 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '345571c87acc4245851a092ae41000b2'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:45:40.749742 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-ea656222-1fcf-4c0e-86a1-cddf6dc9e961 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '345571c87acc4245851a092ae41000b2'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:45:40.849063 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-ea656222-1fcf-4c0e-86a1-cddf6dc9e961 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '345571c87acc4245851a092ae41000b2'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:45:40.855226 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 755/1507] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 16:45:40 2022] DELETE /identity/v3/users/345571c87acc4245851a092ae41000b2 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:45:40.859679 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf39e32-42ba-4a5d-bba7-fd25c128d7f4 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:45:40.864858 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf39e32-42ba-4a5d-bba7-fd25c128d7f4 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:45:40.864858 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf39e32-42ba-4a5d-bba7-fd25c128d7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:45:40.916178 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-baf39e32-42ba-4a5d-bba7-fd25c128d7f4 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:45:40.917377 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-baf39e32-42ba-4a5d-bba7-fd25c128d7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:45:40.992338 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:45:41.005661 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 753/1508] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:45:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:45:41.015198 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea656222-1fcf-4c0e-86a1-cddf6dc9e961 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:45:41.016455 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-ea656222-1fcf-4c0e-86a1-cddf6dc9e961 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:45:41.118109 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea656222-1fcf-4c0e-86a1-cddf6dc9e961 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:45:41.176558 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:45:41.195674 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db39dba-df65-4ee4-9a5a-466718d97061 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:45:41.196443 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db39dba-df65-4ee4-9a5a-466718d97061 service neutron] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:45:41.196673 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db39dba-df65-4ee4-9a5a-466718d97061 service neutron] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:45:41.196954 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db39dba-df65-4ee4-9a5a-466718d97061 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:45:41.198604 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-2db39dba-df65-4ee4-9a5a-466718d97061 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:45:41.310696 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db39dba-df65-4ee4-9a5a-466718d97061 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:45:41.312090 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db39dba-df65-4ee4-9a5a-466718d97061 service neutron] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:45:41.331239 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 756/1509] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:45:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:45:41.811223 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf39e32-42ba-4a5d-bba7-fd25c128d7f4 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:45:41.812468 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-baf39e32-42ba-4a5d-bba7-fd25c128d7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:45:41.831538 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf39e32-42ba-4a5d-bba7-fd25c128d7f4 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:45:41.925220 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb2f8cf-1a3d-4758-a9e7-2c70989c61da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:45:41.926088 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2f8cf-1a3d-4758-a9e7-2c70989c61da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:45:41.926367 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2f8cf-1a3d-4758-a9e7-2c70989c61da admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:45:41.926642 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2f8cf-1a3d-4758-a9e7-2c70989c61da admin admin] PATH_INFO: `/v3/projects/2bd5a7f38e034360894814b52871bd17` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:45:41.936800 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb2f8cf-1a3d-4758-a9e7-2c70989c61da admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bd5a7f38e034360894814b52871bd17)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:45:41.937833 dv-cinder-846173-3-smb devstack@keystone.service[80545]: WARNING py.warnings [None req-9cb2f8cf-1a3d-4758-a9e7-2c70989c61da admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 16:45:41.937833 dv-cinder-846173-3-smb devstack@keystone.service[80545]: warnings.warn(msg) Jul 18 16:45:41.937833 dv-cinder-846173-3-smb devstack@keystone.service[80545]: Jul 18 16:45:41.939091 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb2f8cf-1a3d-4758-a9e7-2c70989c61da admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:45:42.110343 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-9cb2f8cf-1a3d-4758-a9e7-2c70989c61da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bd5a7f38e034360894814b52871bd17', 'request_id': 'req-9cb2f8cf-1a3d-4758-a9e7-2c70989c61da'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:45:42.226128 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-9cb2f8cf-1a3d-4758-a9e7-2c70989c61da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bd5a7f38e034360894814b52871bd17', 'request_id': 'req-9cb2f8cf-1a3d-4758-a9e7-2c70989c61da'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:45:42.232989 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-9cb2f8cf-1a3d-4758-a9e7-2c70989c61da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bd5a7f38e034360894814b52871bd17', 'request_id': 'req-9cb2f8cf-1a3d-4758-a9e7-2c70989c61da'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:45:42.264761 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-9cb2f8cf-1a3d-4758-a9e7-2c70989c61da admin admin] The token cache is being invalidate because project 2bd5a7f38e034360894814b52871bd17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:45:42.265070 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-9cb2f8cf-1a3d-4758-a9e7-2c70989c61da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:45:42.266124 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-9cb2f8cf-1a3d-4758-a9e7-2c70989c61da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:45:42.267541 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 754/1510] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 16:45:41 2022] DELETE /identity/v3/projects/2bd5a7f38e034360894814b52871bd17 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:45:51.328941 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=62 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:45:52.262588 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:47:43.648257 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78537d4-420c-418c-9d82-2193a4256d7e None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:47:43.648872 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78537d4-420c-418c-9d82-2193a4256d7e None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:47:43.648872 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78537d4-420c-418c-9d82-2193a4256d7e None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:47:43.654041 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 757/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 16:47:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:47:43.656214 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff9e60-db23-4e22-8d13-dcfd3e968e9a None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:47:43.656691 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff9e60-db23-4e22-8d13-dcfd3e968e9a None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:47:43.656807 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff9e60-db23-4e22-8d13-dcfd3e968e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:47:43.752054 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-00ff9e60-db23-4e22-8d13-dcfd3e968e9a None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:47:43.753687 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-00ff9e60-db23-4e22-8d13-dcfd3e968e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:47:43.881053 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 755/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 16:47:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:47:44.041155 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78537d4-420c-418c-9d82-2193a4256d7e None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:47:44.043511 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-c78537d4-420c-418c-9d82-2193a4256d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:47:44.191737 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78537d4-420c-418c-9d82-2193a4256d7e None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:47:44.198019 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96625dd6-add8-4591-8dfe-d9976027508c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07f0c5bf1bee48a0bafdf7a9e4537c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:47:44.198697 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96625dd6-add8-4591-8dfe-d9976027508c service nova] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:47:44.198980 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96625dd6-add8-4591-8dfe-d9976027508c service nova] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:47:44.199255 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96625dd6-add8-4591-8dfe-d9976027508c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:47:44.208988 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96625dd6-add8-4591-8dfe-d9976027508c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:47:44.210640 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96625dd6-add8-4591-8dfe-d9976027508c service nova] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:47:44.222119 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 758/1513] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:47:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:47:45.092667 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b2187-83e8-4eab-8758-06db7c6cfb27 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:47:45.093252 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b2187-83e8-4eab-8758-06db7c6cfb27 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:47:45.093252 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b2187-83e8-4eab-8758-06db7c6cfb27 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:47:45.094620 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 756/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 16:47:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:47:45.099899 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce470655-6ccd-4f4e-961b-320c333ce698 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:47:45.100387 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce470655-6ccd-4f4e-961b-320c333ce698 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:47:45.100494 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce470655-6ccd-4f4e-961b-320c333ce698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:47:45.119128 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-ce470655-6ccd-4f4e-961b-320c333ce698 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:47:45.120384 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-ce470655-6ccd-4f4e-961b-320c333ce698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:47:45.129531 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 759/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 16:47:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:47:45.288663 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b2187-83e8-4eab-8758-06db7c6cfb27 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:47:45.304173 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b2187-83e8-4eab-8758-06db7c6cfb27 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:47:45.310203 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8171cfbe-0508-4747-b2be-c0959931cf9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07f0c5bf1bee48a0bafdf7a9e4537c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:47:45.310866 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171cfbe-0508-4747-b2be-c0959931cf9c service nova] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:47:45.311142 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171cfbe-0508-4747-b2be-c0959931cf9c service nova] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:47:45.311406 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171cfbe-0508-4747-b2be-c0959931cf9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:47:45.320416 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8171cfbe-0508-4747-b2be-c0959931cf9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:47:45.322001 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8171cfbe-0508-4747-b2be-c0959931cf9c service nova] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:47:45.332782 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 757/1516] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:47:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:47:45.581398 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c3505-55ca-4675-bc00-8aafbbebc4b4 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:47:45.581685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c3505-55ca-4675-bc00-8aafbbebc4b4 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:47:45.581966 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c3505-55ca-4675-bc00-8aafbbebc4b4 None None] PATH_INFO: `/v3` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:47:45.583285 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 760/1517] 10.222.0.89 () {54 vars in 925 bytes} [Mon Jul 18 16:47:45 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:47:45.589837 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce35ca-e8eb-492d-bd22-6223240b6d07 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:47:45.590130 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce35ca-e8eb-492d-bd22-6223240b6d07 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:47:45.590415 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce35ca-e8eb-492d-bd22-6223240b6d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:47:45.648527 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-23ce35ca-e8eb-492d-bd22-6223240b6d07 None None] MFA Rules not processed for user `5700ad7df774415b89737c7dddcc5b2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:47:45.649636 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-23ce35ca-e8eb-492d-bd22-6223240b6d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:47:45.666723 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:47:45.720863 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 758/1518] 10.222.0.89 () {58 vars in 1015 bytes} [Mon Jul 18 16:47:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:47:55.113799 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=56 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:47:55.483704 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a356ed93-6d31-4092-8721-571ed83f2990 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:47:55.484014 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a356ed93-6d31-4092-8721-571ed83f2990 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:47:55.484293 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a356ed93-6d31-4092-8721-571ed83f2990 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:47:55.485662 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 761/1519] 10.222.0.81 () {54 vars in 961 bytes} [Mon Jul 18 16:47:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:47:55.490626 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd733798-561a-4f1f-93bf-60b6aa90e61d None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:47:55.491090 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd733798-561a-4f1f-93bf-60b6aa90e61d None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:47:55.491206 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd733798-561a-4f1f-93bf-60b6aa90e61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:47:55.511148 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-bd733798-561a-4f1f-93bf-60b6aa90e61d None None] MFA Rules not processed for user `5700ad7df774415b89737c7dddcc5b2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:47:55.512985 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-bd733798-561a-4f1f-93bf-60b6aa90e61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:47:55.521716 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 759/1520] 10.222.0.81 () {58 vars in 1058 bytes} [Mon Jul 18 16:47:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:47:55.530388 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a356ed93-6d31-4092-8721-571ed83f2990 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:47:55.544786 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a356ed93-6d31-4092-8721-571ed83f2990 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:47:55.549793 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe0f317-3c92-4722-8efa-ef7ba4563aad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700ad7df774415b89737c7dddcc5b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:47:55.550435 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0f317-3c92-4722-8efa-ef7ba4563aad service placement] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:47:55.550715 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0f317-3c92-4722-8efa-ef7ba4563aad service placement] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:47:55.551015 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0f317-3c92-4722-8efa-ef7ba4563aad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:47:55.561399 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe0f317-3c92-4722-8efa-ef7ba4563aad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:47:55.563007 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe0f317-3c92-4722-8efa-ef7ba4563aad service placement] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:47:55.573276 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 762/1521] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:47:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:47:56.584358 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c8d7a2-9639-4450-96cd-ff99fc9af868 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:47:56.584873 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c8d7a2-9639-4450-96cd-ff99fc9af868 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:47:56.584873 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c8d7a2-9639-4450-96cd-ff99fc9af868 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:47:56.586488 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 760/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 16:47:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:47:56.592111 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9997bf7-b72c-4b27-a9db-a9da3a1bdcfb None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:47:56.592947 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9997bf7-b72c-4b27-a9db-a9da3a1bdcfb None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:47:56.593332 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9997bf7-b72c-4b27-a9db-a9da3a1bdcfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:47:56.613095 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-b9997bf7-b72c-4b27-a9db-a9da3a1bdcfb None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:47:56.614312 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-b9997bf7-b72c-4b27-a9db-a9da3a1bdcfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:47:56.622247 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 763/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 16:47:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:47:56.776202 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c8d7a2-9639-4450-96cd-ff99fc9af868 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:47:56.791624 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c8d7a2-9639-4450-96cd-ff99fc9af868 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:47:56.797349 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931f7e90-3a31-4656-ac33-fbb35ee16e4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07f0c5bf1bee48a0bafdf7a9e4537c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:47:56.797988 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f7e90-3a31-4656-ac33-fbb35ee16e4e service nova] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:47:56.798304 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f7e90-3a31-4656-ac33-fbb35ee16e4e service nova] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:47:56.798585 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f7e90-3a31-4656-ac33-fbb35ee16e4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:47:56.807606 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931f7e90-3a31-4656-ac33-fbb35ee16e4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:47:56.809281 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931f7e90-3a31-4656-ac33-fbb35ee16e4e service nova] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:47:56.819251 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 761/1524] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:47:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:47:57.639394 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a3750-0253-4ab0-a930-3fd89c66373a None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:47:57.639981 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a3750-0253-4ab0-a930-3fd89c66373a None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:47:57.640082 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a3750-0253-4ab0-a930-3fd89c66373a None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:47:57.641504 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 764/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 16:47:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:47:57.646511 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849dbdf0-5aa0-4d3e-8cb7-dba50234cb29 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:47:57.646926 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849dbdf0-5aa0-4d3e-8cb7-dba50234cb29 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:47:57.647072 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849dbdf0-5aa0-4d3e-8cb7-dba50234cb29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:47:57.666135 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-849dbdf0-5aa0-4d3e-8cb7-dba50234cb29 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:47:57.667358 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-849dbdf0-5aa0-4d3e-8cb7-dba50234cb29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:47:57.676015 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 762/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 16:47:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:47:57.827577 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7a3750-0253-4ab0-a930-3fd89c66373a None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:47:57.842614 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7a3750-0253-4ab0-a930-3fd89c66373a None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:47:57.848064 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a148eedc-a152-415c-8a1a-482ea36b833e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07f0c5bf1bee48a0bafdf7a9e4537c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:47:57.848700 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148eedc-a152-415c-8a1a-482ea36b833e service nova] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:47:57.848974 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148eedc-a152-415c-8a1a-482ea36b833e service nova] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:47:57.849243 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148eedc-a152-415c-8a1a-482ea36b833e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:47:57.857856 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a148eedc-a152-415c-8a1a-482ea36b833e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:47:57.859415 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a148eedc-a152-415c-8a1a-482ea36b833e service nova] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:47:57.868636 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 765/1527] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:47:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:48:02.100838 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ac5c8-477a-460c-ad1e-b66d0ab8ef21 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:48:02.101552 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ac5c8-477a-460c-ad1e-b66d0ab8ef21 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:48:02.101552 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ac5c8-477a-460c-ad1e-b66d0ab8ef21 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:48:02.102825 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 763/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 16:48:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:48:02.108798 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd183546-8d56-4cdb-a25e-3e7c2ad0359e None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:48:02.109239 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd183546-8d56-4cdb-a25e-3e7c2ad0359e None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:48:02.109350 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd183546-8d56-4cdb-a25e-3e7c2ad0359e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:48:02.130248 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-dd183546-8d56-4cdb-a25e-3e7c2ad0359e None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:48:02.131439 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-dd183546-8d56-4cdb-a25e-3e7c2ad0359e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:48:02.139368 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 766/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 16:48:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:48:02.177907 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ac5c8-477a-460c-ad1e-b66d0ab8ef21 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:48:02.179747 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-201ac5c8-477a-460c-ad1e-b66d0ab8ef21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:48:02.259103 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ac5c8-477a-460c-ad1e-b66d0ab8ef21 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:48:02.262731 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c178b4cc-53b6-4323-b4a3-aa29e295bec3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:48:02.263373 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c178b4cc-53b6-4323-b4a3-aa29e295bec3 service neutron] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:48:02.263654 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c178b4cc-53b6-4323-b4a3-aa29e295bec3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:48:02.263956 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c178b4cc-53b6-4323-b4a3-aa29e295bec3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:48:02.272847 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c178b4cc-53b6-4323-b4a3-aa29e295bec3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:48:02.274259 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c178b4cc-53b6-4323-b4a3-aa29e295bec3 service neutron] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:48:02.284542 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 764/1530] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:48:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:48:04.287628 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3aa0bc-f9a3-4b4c-a175-29d2c777e6fd None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:48:04.288244 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3aa0bc-f9a3-4b4c-a175-29d2c777e6fd None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:48:04.288244 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3aa0bc-f9a3-4b4c-a175-29d2c777e6fd None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:48:04.289630 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 767/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 16:48:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:48:04.295356 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27cf67-0cf7-4583-b6a0-bdb4161b8455 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:48:04.295791 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27cf67-0cf7-4583-b6a0-bdb4161b8455 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:48:04.295932 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27cf67-0cf7-4583-b6a0-bdb4161b8455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:48:04.314029 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-ce27cf67-0cf7-4583-b6a0-bdb4161b8455 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:48:04.315211 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-ce27cf67-0cf7-4583-b6a0-bdb4161b8455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:48:04.323020 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 765/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 16:48:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:48:04.358470 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3aa0bc-f9a3-4b4c-a175-29d2c777e6fd None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:48:04.369323 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3aa0bc-f9a3-4b4c-a175-29d2c777e6fd None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:48:04.373478 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43462b0-3483-4c96-9e25-2a83e4eac3dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:48:04.374121 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43462b0-3483-4c96-9e25-2a83e4eac3dc service neutron] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:48:04.374403 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43462b0-3483-4c96-9e25-2a83e4eac3dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:48:04.374930 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43462b0-3483-4c96-9e25-2a83e4eac3dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:48:04.384779 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43462b0-3483-4c96-9e25-2a83e4eac3dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:48:04.386206 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43462b0-3483-4c96-9e25-2a83e4eac3dc service neutron] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:48:04.395873 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 768/1533] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:48:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:48:08.062499 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92663e-a64c-4a1a-a2cd-b8e07819d4c8 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:48:08.063050 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92663e-a64c-4a1a-a2cd-b8e07819d4c8 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:48:08.063168 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92663e-a64c-4a1a-a2cd-b8e07819d4c8 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:48:08.064503 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 766/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 16:48:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:48:08.069768 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b06c4-a342-42a4-95ed-79f0eeb1c71d None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:48:08.070175 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b06c4-a342-42a4-95ed-79f0eeb1c71d None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:48:08.070310 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b06c4-a342-42a4-95ed-79f0eeb1c71d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:48:08.093216 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-255b06c4-a342-42a4-95ed-79f0eeb1c71d None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:48:08.094586 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-255b06c4-a342-42a4-95ed-79f0eeb1c71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:48:08.102510 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 769/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 16:48:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:48:08.411897 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f92663e-a64c-4a1a-a2cd-b8e07819d4c8 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:48:08.413645 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-1f92663e-a64c-4a1a-a2cd-b8e07819d4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:48:08.487264 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:48:08.501771 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f92663e-a64c-4a1a-a2cd-b8e07819d4c8 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:48:08.505476 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e235ee2e-c04d-4d47-83cc-3feb87a24ae8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:48:08.506121 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235ee2e-c04d-4d47-83cc-3feb87a24ae8 service cinder] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:48:08.506402 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235ee2e-c04d-4d47-83cc-3feb87a24ae8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:48:08.506680 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235ee2e-c04d-4d47-83cc-3feb87a24ae8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:48:08.517624 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e235ee2e-c04d-4d47-83cc-3feb87a24ae8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:48:08.519052 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e235ee2e-c04d-4d47-83cc-3feb87a24ae8 service cinder] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:48:08.529675 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 767/1536] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:48:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:48:10.624087 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce53d4c-b3b1-492b-90cb-e041c9fd55c3 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:48:10.624897 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce53d4c-b3b1-492b-90cb-e041c9fd55c3 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:48:10.624897 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce53d4c-b3b1-492b-90cb-e041c9fd55c3 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:48:10.626321 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 770/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 16:48:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:48:10.631607 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209208f1-e4de-49b8-addb-e4217fc18e4b None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:48:10.632122 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209208f1-e4de-49b8-addb-e4217fc18e4b None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:48:10.632279 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209208f1-e4de-49b8-addb-e4217fc18e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:48:10.650919 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-209208f1-e4de-49b8-addb-e4217fc18e4b None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:48:10.652709 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-209208f1-e4de-49b8-addb-e4217fc18e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:48:10.660698 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 768/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 16:48:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:48:10.986348 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce53d4c-b3b1-492b-90cb-e041c9fd55c3 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:48:10.988094 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-0ce53d4c-b3b1-492b-90cb-e041c9fd55c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:48:11.003878 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce53d4c-b3b1-492b-90cb-e041c9fd55c3 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:48:11.008076 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14673895-2d89-460e-b6d4-e0340511781b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:48:11.008772 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14673895-2d89-460e-b6d4-e0340511781b service cinder] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:48:11.009057 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14673895-2d89-460e-b6d4-e0340511781b service cinder] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:48:11.009333 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14673895-2d89-460e-b6d4-e0340511781b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:48:11.020634 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14673895-2d89-460e-b6d4-e0340511781b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:48:11.022078 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14673895-2d89-460e-b6d4-e0340511781b service cinder] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:48:11.033041 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 771/1539] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:48:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:48:20.645734 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=11 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:48:21.027329 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=33 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:49:58.431841 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c1072-afdd-48dc-ae85-9863c278e488 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:49:58.432513 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c1072-afdd-48dc-ae85-9863c278e488 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:49:58.432513 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c1072-afdd-48dc-ae85-9863c278e488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:49:58.455289 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-632c1072-afdd-48dc-ae85-9863c278e488 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:49:58.473939 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-632c1072-afdd-48dc-ae85-9863c278e488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:49:58.489355 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 769/1540] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:49:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:49:58.498594 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033ad2a-2f60-4f7f-9887-5f36512d8377 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:49:58.499233 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033ad2a-2f60-4f7f-9887-5f36512d8377 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:49:58.499233 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033ad2a-2f60-4f7f-9887-5f36512d8377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:49:58.528831 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-f033ad2a-2f60-4f7f-9887-5f36512d8377 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:49:58.530134 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-f033ad2a-2f60-4f7f-9887-5f36512d8377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:49:58.538973 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 772/1541] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:49:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:49:58.544680 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632c1072-afdd-48dc-ae85-9863c278e488 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:49:58.558583 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632c1072-afdd-48dc-ae85-9863c278e488 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:49:58.568470 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff28621a-84e4-474e-8000-707ce87ed653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:49:58.569161 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28621a-84e4-474e-8000-707ce87ed653 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:49:58.569446 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28621a-84e4-474e-8000-707ce87ed653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:49:58.569725 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28621a-84e4-474e-8000-707ce87ed653 admin admin] PATH_INFO: `/v3/domains` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:49:58.570462 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff28621a-84e4-474e-8000-707ce87ed653 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:49:58.570800 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff28621a-84e4-474e-8000-707ce87ed653 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:49:58.572481 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff28621a-84e4-474e-8000-707ce87ed653 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:49:58.578031 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4e1f6-a45f-4c44-ab55-a9c2151e28e3 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:49:58.578356 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4e1f6-a45f-4c44-ab55-a9c2151e28e3 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:49:58.578603 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4e1f6-a45f-4c44-ab55-a9c2151e28e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:49:58.617772 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-99c4e1f6-a45f-4c44-ab55-a9c2151e28e3 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:49:58.619003 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-99c4e1f6-a45f-4c44-ab55-a9c2151e28e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:49:58.622119 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 770/1542] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Jul 18 16:49:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:49:58.630343 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d0b2c-be4c-44a6-9424-ca82b989a65b None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:49:58.630727 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d0b2c-be4c-44a6-9424-ca82b989a65b None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:49:58.630974 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d0b2c-be4c-44a6-9424-ca82b989a65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:49:58.646580 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 773/1543] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:49:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:49:58.651875 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c4e1f6-a45f-4c44-ab55-a9c2151e28e3 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:49:58.661902 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-a67d0b2c-be4c-44a6-9424-ca82b989a65b None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:49:58.662526 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c4e1f6-a45f-4c44-ab55-a9c2151e28e3 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:49:58.663879 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-a67d0b2c-be4c-44a6-9424-ca82b989a65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:49:58.675467 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2261e33f-193d-4d72-b975-0608c4de6499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:49:58.676512 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261e33f-193d-4d72-b975-0608c4de6499 admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:49:58.676800 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261e33f-193d-4d72-b975-0608c4de6499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:49:58.677080 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261e33f-193d-4d72-b975-0608c4de6499 admin admin] PATH_INFO: `/v3/projects` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:49:58.677963 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2261e33f-193d-4d72-b975-0608c4de6499 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:49:58.680020 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2261e33f-193d-4d72-b975-0608c4de6499 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:49:58.684116 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 771/1544] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:49:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:49:58.685710 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c5c734-acdb-4991-8178-7c894aec6aa2 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:49:58.686234 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c5c734-acdb-4991-8178-7c894aec6aa2 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:49:58.686751 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c5c734-acdb-4991-8178-7c894aec6aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:49:58.718434 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-43c5c734-acdb-4991-8178-7c894aec6aa2 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:49:58.720121 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-43c5c734-acdb-4991-8178-7c894aec6aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:49:58.733994 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 772/1545] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:49:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:49:58.740305 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faacb876-0800-4ef6-9dc5-0c5512710ccf None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:49:58.743051 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faacb876-0800-4ef6-9dc5-0c5512710ccf None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:49:58.743365 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faacb876-0800-4ef6-9dc5-0c5512710ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:49:58.763834 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-faacb876-0800-4ef6-9dc5-0c5512710ccf None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:49:58.765430 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-faacb876-0800-4ef6-9dc5-0c5512710ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:49:58.774497 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 773/1546] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:49:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:49:58.775600 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603edfba-ce1c-4c84-ac36-25f98182382f None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:49:58.776677 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603edfba-ce1c-4c84-ac36-25f98182382f None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:49:58.776800 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603edfba-ce1c-4c84-ac36-25f98182382f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:49:58.803962 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-603edfba-ce1c-4c84-ac36-25f98182382f None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:49:58.805236 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-603edfba-ce1c-4c84-ac36-25f98182382f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:49:58.814127 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 774/1547] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:49:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:49:58.815431 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530ccaa-5901-4d4b-9633-57874e665b2f None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:49:58.815862 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530ccaa-5901-4d4b-9633-57874e665b2f None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:49:58.816145 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530ccaa-5901-4d4b-9633-57874e665b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:49:58.835948 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-8530ccaa-5901-4d4b-9633-57874e665b2f None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:49:58.837147 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-8530ccaa-5901-4d4b-9633-57874e665b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:49:58.842953 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 774/1548] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:49:58 2022] POST /identity/v3/projects => generated 391 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:49:58.844312 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f4158e-5da1-43b8-93dd-d54caa8bb882 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:49:58.844624 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f4158e-5da1-43b8-93dd-d54caa8bb882 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:49:58.844876 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f4158e-5da1-43b8-93dd-d54caa8bb882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:49:58.847961 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 775/1549] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:49:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:49:58.853639 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530ccaa-5901-4d4b-9633-57874e665b2f None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:49:58.863309 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530ccaa-5901-4d4b-9633-57874e665b2f None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:49:58.864276 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-58f4158e-5da1-43b8-93dd-d54caa8bb882 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:49:58.865485 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-58f4158e-5da1-43b8-93dd-d54caa8bb882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:49:58.931324 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 775/1550] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:49:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:49:58.932757 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2453eb-44ee-433a-be7e-40fd2d5d5c38 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:49:58.933036 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2453eb-44ee-433a-be7e-40fd2d5d5c38 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:49:58.933317 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2453eb-44ee-433a-be7e-40fd2d5d5c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:49:58.953691 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-3f2453eb-44ee-433a-be7e-40fd2d5d5c38 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:49:58.955778 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-3f2453eb-44ee-433a-be7e-40fd2d5d5c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:49:58.956395 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72554c8f-1e6a-4c22-be47-68fc5336eb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:49:58.957292 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72554c8f-1e6a-4c22-be47-68fc5336eb40 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:49:58.957447 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72554c8f-1e6a-4c22-be47-68fc5336eb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:49:58.957701 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72554c8f-1e6a-4c22-be47-68fc5336eb40 admin admin] PATH_INFO: `/v3/domains` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:49:58.958364 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72554c8f-1e6a-4c22-be47-68fc5336eb40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:49:58.958737 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72554c8f-1e6a-4c22-be47-68fc5336eb40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:49:58.960469 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72554c8f-1e6a-4c22-be47-68fc5336eb40 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:49:58.964170 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 776/1551] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:49:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:49:58.965569 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba97c7-ef6a-4903-a391-6da7209b131b None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:49:58.965861 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba97c7-ef6a-4903-a391-6da7209b131b None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:49:58.966141 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba97c7-ef6a-4903-a391-6da7209b131b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:49:58.976222 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 776/1552] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Jul 18 16:49:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:49:58.977499 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321680f4-33dc-42fe-beff-fa96a52a838e None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:49:58.977786 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321680f4-33dc-42fe-beff-fa96a52a838e None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:49:58.978063 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321680f4-33dc-42fe-beff-fa96a52a838e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:49:58.986208 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-efba97c7-ef6a-4903-a391-6da7209b131b None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:49:58.987461 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-efba97c7-ef6a-4903-a391-6da7209b131b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:49:58.995929 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 777/1553] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:49:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:49:58.996543 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-321680f4-33dc-42fe-beff-fa96a52a838e None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:49:58.996752 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efba97c7-ef6a-4903-a391-6da7209b131b None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:49:58.997720 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-321680f4-33dc-42fe-beff-fa96a52a838e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:49:59.006401 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efba97c7-ef6a-4903-a391-6da7209b131b None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:49:59.009646 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 777/1554] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:49:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:49:59.010900 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321680f4-33dc-42fe-beff-fa96a52a838e None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:49:59.018068 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f61c0-ad1c-4103-a973-b647ebd1736d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:49:59.018731 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f61c0-ad1c-4103-a973-b647ebd1736d admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:49:59.019008 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f61c0-ad1c-4103-a973-b647ebd1736d admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:49:59.019278 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f61c0-ad1c-4103-a973-b647ebd1736d admin admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:49:59.020033 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490f61c0-ad1c-4103-a973-b647ebd1736d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:49:59.020333 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490f61c0-ad1c-4103-a973-b647ebd1736d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:49:59.020941 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321680f4-33dc-42fe-beff-fa96a52a838e None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:49:59.021340 dv-cinder-846173-3-smb devstack@keystone.service[80544]: WARNING py.warnings [None req-490f61c0-ad1c-4103-a973-b647ebd1736d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 16:49:59.021340 dv-cinder-846173-3-smb devstack@keystone.service[80544]: warnings.warn(msg) Jul 18 16:49:59.021340 dv-cinder-846173-3-smb devstack@keystone.service[80544]: Jul 18 16:49:59.022252 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490f61c0-ad1c-4103-a973-b647ebd1736d admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:49:59.026321 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b3ba77-8e78-48ed-9a00-4e2a055780b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:49:59.027004 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b3ba77-8e78-48ed-9a00-4e2a055780b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:49:59.027289 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b3ba77-8e78-48ed-9a00-4e2a055780b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:49:59.027562 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b3ba77-8e78-48ed-9a00-4e2a055780b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:49:59.028276 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b3ba77-8e78-48ed-9a00-4e2a055780b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:49:59.030176 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b3ba77-8e78-48ed-9a00-4e2a055780b7 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:49:59.034835 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 778/1555] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Jul 18 16:49:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:49:59.036120 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b558e-3b03-4baf-a1f6-fb70d75ba338 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:49:59.036407 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b558e-3b03-4baf-a1f6-fb70d75ba338 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:49:59.036683 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b558e-3b03-4baf-a1f6-fb70d75ba338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:49:59.059255 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-c00b558e-3b03-4baf-a1f6-fb70d75ba338 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:49:59.060390 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-c00b558e-3b03-4baf-a1f6-fb70d75ba338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:49:59.068602 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 779/1556] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:49:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:49:59.069357 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b558e-3b03-4baf-a1f6-fb70d75ba338 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:49:59.079470 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b558e-3b03-4baf-a1f6-fb70d75ba338 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:49:59.084112 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1301fe9e-a27e-4c3c-bf2d-da591a8543aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:49:59.084784 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301fe9e-a27e-4c3c-bf2d-da591a8543aa admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:49:59.085113 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301fe9e-a27e-4c3c-bf2d-da591a8543aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:49:59.085386 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301fe9e-a27e-4c3c-bf2d-da591a8543aa admin admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:49:59.086103 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1301fe9e-a27e-4c3c-bf2d-da591a8543aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:49:59.086402 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1301fe9e-a27e-4c3c-bf2d-da591a8543aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:49:59.088394 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1301fe9e-a27e-4c3c-bf2d-da591a8543aa admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:49:59.100733 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 780/1557] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Jul 18 16:49:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:49:59.103642 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b0463-abf7-4c68-98ae-4ed6f5ff1d9f None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:49:59.103642 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b0463-abf7-4c68-98ae-4ed6f5ff1d9f None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:49:59.103642 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b0463-abf7-4c68-98ae-4ed6f5ff1d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:49:59.121162 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-855b0463-abf7-4c68-98ae-4ed6f5ff1d9f None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:49:59.122392 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-855b0463-abf7-4c68-98ae-4ed6f5ff1d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:49:59.130964 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 781/1558] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:49:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:49:59.131819 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855b0463-abf7-4c68-98ae-4ed6f5ff1d9f None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:49:59.141957 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855b0463-abf7-4c68-98ae-4ed6f5ff1d9f None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:49:59.146595 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 778/1559] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 16:49:59 2022] POST /identity/v3/users => generated 296 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:49:59.146595 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74bac9-86f1-40c3-9fd5-69ad01d73384 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:49:59.146595 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74bac9-86f1-40c3-9fd5-69ad01d73384 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:49:59.146595 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74bac9-86f1-40c3-9fd5-69ad01d73384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:49:59.150375 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151e98ee-fb6d-4aa7-b656-aaaf7abc1b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:49:59.151027 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e98ee-fb6d-4aa7-b656-aaaf7abc1b9b admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:49:59.151310 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e98ee-fb6d-4aa7-b656-aaaf7abc1b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:49:59.151584 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e98ee-fb6d-4aa7-b656-aaaf7abc1b9b admin admin] PATH_INFO: `/v3/projects` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:49:59.152330 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151e98ee-fb6d-4aa7-b656-aaaf7abc1b9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:49:59.154265 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151e98ee-fb6d-4aa7-b656-aaaf7abc1b9b admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:49:59.165063 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-6a74bac9-86f1-40c3-9fd5-69ad01d73384 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:49:59.166344 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-6a74bac9-86f1-40c3-9fd5-69ad01d73384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:49:59.174677 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 779/1560] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:49:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:49:59.176164 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f5b55-2b73-4dd7-9e64-16a93b844c37 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:49:59.176466 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f5b55-2b73-4dd7-9e64-16a93b844c37 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:49:59.176713 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f5b55-2b73-4dd7-9e64-16a93b844c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:49:59.196102 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-506f5b55-2b73-4dd7-9e64-16a93b844c37 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:49:59.197295 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-506f5b55-2b73-4dd7-9e64-16a93b844c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:49:59.206014 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 780/1561] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:49:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:49:59.206830 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f5b55-2b73-4dd7-9e64-16a93b844c37 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:49:59.217210 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f5b55-2b73-4dd7-9e64-16a93b844c37 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:49:59.221886 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c5d4ae-1931-4a22-a88a-6c7fa0f1c99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:49:59.222574 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5d4ae-1931-4a22-a88a-6c7fa0f1c99a admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:49:59.222858 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5d4ae-1931-4a22-a88a-6c7fa0f1c99a admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:49:59.223142 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5d4ae-1931-4a22-a88a-6c7fa0f1c99a admin admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:49:59.223862 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c5d4ae-1931-4a22-a88a-6c7fa0f1c99a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:49:59.224874 dv-cinder-846173-3-smb devstack@keystone.service[80545]: WARNING py.warnings [None req-b2c5d4ae-1931-4a22-a88a-6c7fa0f1c99a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 16:49:59.224874 dv-cinder-846173-3-smb devstack@keystone.service[80545]: warnings.warn(msg) Jul 18 16:49:59.224874 dv-cinder-846173-3-smb devstack@keystone.service[80545]: Jul 18 16:49:59.226047 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c5d4ae-1931-4a22-a88a-6c7fa0f1c99a admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:49:59.273754 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 782/1562] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:49:59 2022] POST /identity/v3/projects => generated 387 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:49:59.274674 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151e98ee-fb6d-4aa7-b656-aaaf7abc1b9b admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:49:59.327007 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:49:59.336790 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151e98ee-fb6d-4aa7-b656-aaaf7abc1b9b admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:49:59.341563 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5af452f-b2e0-4227-b5a2-fce07803b539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:49:59.342220 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af452f-b2e0-4227-b5a2-fce07803b539 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:49:59.342505 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af452f-b2e0-4227-b5a2-fce07803b539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:49:59.342781 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af452f-b2e0-4227-b5a2-fce07803b539 admin admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:49:59.343501 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5af452f-b2e0-4227-b5a2-fce07803b539 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:49:59.343842 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5af452f-b2e0-4227-b5a2-fce07803b539 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:49:59.345513 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5af452f-b2e0-4227-b5a2-fce07803b539 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:49:59.357356 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 783/1563] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Jul 18 16:49:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:49:59.358126 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5af452f-b2e0-4227-b5a2-fce07803b539 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:49:59.367605 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5af452f-b2e0-4227-b5a2-fce07803b539 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:49:59.372902 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 781/1564] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:49:59 2022] POST /identity/v3/projects => generated 377 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:49:59.372902 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c5d4ae-1931-4a22-a88a-6c7fa0f1c99a admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:49:59.373128 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e066110-dff7-432d-8084-996399e44398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:49:59.373491 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e066110-dff7-432d-8084-996399e44398 admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:49:59.373790 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e066110-dff7-432d-8084-996399e44398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:49:59.374056 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e066110-dff7-432d-8084-996399e44398 admin admin] PATH_INFO: `/v3/projects` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:49:59.374749 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e066110-dff7-432d-8084-996399e44398 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:49:59.377024 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e066110-dff7-432d-8084-996399e44398 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:49:59.418621 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:49:59.436082 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c5d4ae-1931-4a22-a88a-6c7fa0f1c99a admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:49:59.440806 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abedecbc-f7d5-43c6-b9fa-1a89bfae100c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:49:59.441516 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abedecbc-f7d5-43c6-b9fa-1a89bfae100c admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:49:59.441769 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abedecbc-f7d5-43c6-b9fa-1a89bfae100c admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:49:59.442037 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abedecbc-f7d5-43c6-b9fa-1a89bfae100c admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:49:59.442794 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abedecbc-f7d5-43c6-b9fa-1a89bfae100c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:49:59.444437 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abedecbc-f7d5-43c6-b9fa-1a89bfae100c admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:49:59.451280 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 784/1565] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:49:59 2022] POST /identity/v3/projects => generated 365 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:49:59.451280 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e066110-dff7-432d-8084-996399e44398 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:49:59.455752 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 782/1566] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:49:59 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:49:59.456706 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abedecbc-f7d5-43c6-b9fa-1a89bfae100c admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:49:59.467238 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abedecbc-f7d5-43c6-b9fa-1a89bfae100c admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:49:59.515087 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e066110-dff7-432d-8084-996399e44398 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:49:59.520234 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5e17ed-6702-4741-b4c4-0f0d5982d47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:49:59.520938 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e17ed-6702-4741-b4c4-0f0d5982d47b admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:49:59.521217 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e17ed-6702-4741-b4c4-0f0d5982d47b admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:49:59.521488 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e17ed-6702-4741-b4c4-0f0d5982d47b admin admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:49:59.522387 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5e17ed-6702-4741-b4c4-0f0d5982d47b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:49:59.522530 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5e17ed-6702-4741-b4c4-0f0d5982d47b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:49:59.524153 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5e17ed-6702-4741-b4c4-0f0d5982d47b admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:49:59.524335 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9bf96f-2dd4-4483-ad6f-dd6eadfe322a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:49:59.525000 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9bf96f-2dd4-4483-ad6f-dd6eadfe322a admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:49:59.525285 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9bf96f-2dd4-4483-ad6f-dd6eadfe322a admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:49:59.525564 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9bf96f-2dd4-4483-ad6f-dd6eadfe322a admin admin] PATH_INFO: `/v3/domains` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:49:59.526283 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9bf96f-2dd4-4483-ad6f-dd6eadfe322a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:49:59.526597 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9bf96f-2dd4-4483-ad6f-dd6eadfe322a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:49:59.528213 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9bf96f-2dd4-4483-ad6f-dd6eadfe322a admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:49:59.535855 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 785/1567] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Jul 18 16:49:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:49:59.536669 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5e17ed-6702-4741-b4c4-0f0d5982d47b admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:49:59.547231 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 783/1568] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Jul 18 16:49:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:49:59.548104 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9bf96f-2dd4-4483-ad6f-dd6eadfe322a admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:49:59.549114 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5e17ed-6702-4741-b4c4-0f0d5982d47b admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:49:59.554306 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c57724-ca0e-4f20-827d-d0a785b317d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:49:59.555049 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c57724-ca0e-4f20-827d-d0a785b317d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:49:59.555341 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c57724-ca0e-4f20-827d-d0a785b317d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:49:59.555620 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c57724-ca0e-4f20-827d-d0a785b317d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:49:59.556381 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c57724-ca0e-4f20-827d-d0a785b317d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:49:59.556710 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c57724-ca0e-4f20-827d-d0a785b317d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:49:59.559023 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c57724-ca0e-4f20-827d-d0a785b317d9 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:49:59.559917 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9bf96f-2dd4-4483-ad6f-dd6eadfe322a admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:49:59.564567 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e0e275-9e9e-49cb-8419-abb7b4a9ced3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:49:59.565222 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0e275-9e9e-49cb-8419-abb7b4a9ced3 admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:49:59.568725 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0e275-9e9e-49cb-8419-abb7b4a9ced3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:49:59.568725 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0e275-9e9e-49cb-8419-abb7b4a9ced3 admin admin] PATH_INFO: `/v3/users` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:49:59.568725 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e0e275-9e9e-49cb-8419-abb7b4a9ced3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:49:59.568725 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e0e275-9e9e-49cb-8419-abb7b4a9ced3 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:49:59.572589 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 786/1569] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Jul 18 16:49:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:49:59.573439 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c57724-ca0e-4f20-827d-d0a785b317d9 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:49:59.583491 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c57724-ca0e-4f20-827d-d0a785b317d9 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:49:59.588098 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a996cd3a-15b8-4a59-b615-2fc26dc8f6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:49:59.588762 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a996cd3a-15b8-4a59-b615-2fc26dc8f6b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:49:59.589044 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a996cd3a-15b8-4a59-b615-2fc26dc8f6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:49:59.589321 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a996cd3a-15b8-4a59-b615-2fc26dc8f6b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:49:59.590000 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a996cd3a-15b8-4a59-b615-2fc26dc8f6b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:49:59.591998 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a996cd3a-15b8-4a59-b615-2fc26dc8f6b4 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:49:59.646665 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 784/1570] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 16:49:59 2022] POST /identity/v3/users => generated 294 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:49:59.647585 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e0e275-9e9e-49cb-8419-abb7b4a9ced3 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:49:59.657095 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e0e275-9e9e-49cb-8419-abb7b4a9ced3 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:49:59.661808 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794dbf4a-5e7c-478e-b739-92954676acf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:49:59.662445 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794dbf4a-5e7c-478e-b739-92954676acf1 admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:49:59.662727 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794dbf4a-5e7c-478e-b739-92954676acf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:49:59.663004 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794dbf4a-5e7c-478e-b739-92954676acf1 admin admin] PATH_INFO: `/v3/users` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:49:59.663678 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794dbf4a-5e7c-478e-b739-92954676acf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:49:59.665606 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794dbf4a-5e7c-478e-b739-92954676acf1 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:49:59.707490 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 787/1571] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:49:59 2022] POST /identity/v3/projects => generated 379 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:49:59.708418 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a996cd3a-15b8-4a59-b615-2fc26dc8f6b4 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:49:59.768729 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a996cd3a-15b8-4a59-b615-2fc26dc8f6b4 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:49:59.773469 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05cc7bf-d827-42c5-8e78-0923eb8bbc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:49:59.774148 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05cc7bf-d827-42c5-8e78-0923eb8bbc93 admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:49:59.774434 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05cc7bf-d827-42c5-8e78-0923eb8bbc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:49:59.774715 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05cc7bf-d827-42c5-8e78-0923eb8bbc93 admin admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:49:59.775412 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05cc7bf-d827-42c5-8e78-0923eb8bbc93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:49:59.776475 dv-cinder-846173-3-smb devstack@keystone.service[80544]: WARNING py.warnings [None req-d05cc7bf-d827-42c5-8e78-0923eb8bbc93 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 16:49:59.776475 dv-cinder-846173-3-smb devstack@keystone.service[80544]: warnings.warn(msg) Jul 18 16:49:59.776475 dv-cinder-846173-3-smb devstack@keystone.service[80544]: Jul 18 16:49:59.777724 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05cc7bf-d827-42c5-8e78-0923eb8bbc93 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:49:59.789812 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 785/1572] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 16:49:59 2022] POST /identity/v3/users => generated 289 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:49:59.790649 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794dbf4a-5e7c-478e-b739-92954676acf1 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:49:59.801726 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794dbf4a-5e7c-478e-b739-92954676acf1 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:49:59.806375 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d086705c-ef82-4d35-a6a1-4d0ab53a26a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:49:59.807101 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086705c-ef82-4d35-a6a1-4d0ab53a26a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:49:59.807915 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086705c-ef82-4d35-a6a1-4d0ab53a26a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:49:59.808188 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086705c-ef82-4d35-a6a1-4d0ab53a26a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:49:59.808903 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d086705c-ef82-4d35-a6a1-4d0ab53a26a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:49:59.810519 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d086705c-ef82-4d35-a6a1-4d0ab53a26a9 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:49:59.820932 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 786/1573] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:49:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:49:59.821723 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d086705c-ef82-4d35-a6a1-4d0ab53a26a9 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:49:59.831512 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d086705c-ef82-4d35-a6a1-4d0ab53a26a9 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:49:59.840780 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aa760f-4c7b-4d88-b5ef-fb551c5a022c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:49:59.840780 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa760f-4c7b-4d88-b5ef-fb551c5a022c admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:49:59.840780 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa760f-4c7b-4d88-b5ef-fb551c5a022c admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:49:59.840780 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa760f-4c7b-4d88-b5ef-fb551c5a022c admin admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:49:59.841211 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aa760f-4c7b-4d88-b5ef-fb551c5a022c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:49:59.841211 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aa760f-4c7b-4d88-b5ef-fb551c5a022c admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:49:59.895163 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 788/1574] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 16:49:59 2022] POST /identity/v3/users => generated 283 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:49:59.896017 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05cc7bf-d827-42c5-8e78-0923eb8bbc93 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:49:59.901441 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:49:59.906529 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05cc7bf-d827-42c5-8e78-0923eb8bbc93 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:49:59.911196 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366766e1-ef72-48b1-8e0b-ecdaba472689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:49:59.911869 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366766e1-ef72-48b1-8e0b-ecdaba472689 admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:49:59.912155 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366766e1-ef72-48b1-8e0b-ecdaba472689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:49:59.912433 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366766e1-ef72-48b1-8e0b-ecdaba472689 admin admin] PATH_INFO: `/v3/projects` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:49:59.913112 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366766e1-ef72-48b1-8e0b-ecdaba472689 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:49:59.915056 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366766e1-ef72-48b1-8e0b-ecdaba472689 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:49:59.956965 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 787/1575] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:49:59 2022] POST /identity/v3/projects => generated 371 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:49:59.956965 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aa760f-4c7b-4d88-b5ef-fb551c5a022c admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:00.015397 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aa760f-4c7b-4d88-b5ef-fb551c5a022c admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:00.020174 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d9d46-a4c8-4f8b-b112-f7ca3862e9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:00.020866 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d9d46-a4c8-4f8b-b112-f7ca3862e9c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:00.021180 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d9d46-a4c8-4f8b-b112-f7ca3862e9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:00.021311 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 789/1576] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:49:59 2022] POST /identity/v3/projects => generated 365 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:50:00.021409 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d9d46-a4c8-4f8b-b112-f7ca3862e9c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:00.022098 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2d9d46-a4c8-4f8b-b112-f7ca3862e9c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:00.022222 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366766e1-ef72-48b1-8e0b-ecdaba472689 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:00.024082 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2d9d46-a4c8-4f8b-b112-f7ca3862e9c8 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:00.033337 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:00.084476 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366766e1-ef72-48b1-8e0b-ecdaba472689 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:00.090058 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f410565-49ba-487f-ba2f-55fa35e3b2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:00.092185 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f410565-49ba-487f-ba2f-55fa35e3b2df admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:00.092185 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f410565-49ba-487f-ba2f-55fa35e3b2df admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:00.092185 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f410565-49ba-487f-ba2f-55fa35e3b2df admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:00.092185 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f410565-49ba-487f-ba2f-55fa35e3b2df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:00.093679 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f410565-49ba-487f-ba2f-55fa35e3b2df admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:00.103577 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 790/1577] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:50:00.105001 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f410565-49ba-487f-ba2f-55fa35e3b2df admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:00.115523 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f410565-49ba-487f-ba2f-55fa35e3b2df admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:00.126811 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 788/1578] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:49:59 2022] POST /identity/v3/projects => generated 375 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:50:00.126994 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d694e9-26ce-4ec7-9142-cd183792466f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:00.127163 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d9d46-a4c8-4f8b-b112-f7ca3862e9c8 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:00.127261 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d694e9-26ce-4ec7-9142-cd183792466f admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:00.127261 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d694e9-26ce-4ec7-9142-cd183792466f admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:00.127261 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d694e9-26ce-4ec7-9142-cd183792466f admin admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:00.127261 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d694e9-26ce-4ec7-9142-cd183792466f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:00.127941 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d694e9-26ce-4ec7-9142-cd183792466f admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:00.186582 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d9d46-a4c8-4f8b-b112-f7ca3862e9c8 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:00.191233 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e67d98-0bdb-4845-9039-595c74e0985a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:00.191922 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e67d98-0bdb-4845-9039-595c74e0985a admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:00.192208 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e67d98-0bdb-4845-9039-595c74e0985a admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:00.192483 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e67d98-0bdb-4845-9039-595c74e0985a admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:00.193249 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e67d98-0bdb-4845-9039-595c74e0985a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:00.194838 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e67d98-0bdb-4845-9039-595c74e0985a admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:00.204310 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 791/1579] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 16:50:00 2022] POST /identity/v3/users => generated 290 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:50:00.205208 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d694e9-26ce-4ec7-9142-cd183792466f admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:00.206938 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 789/1580] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:50:00.206938 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e67d98-0bdb-4845-9039-595c74e0985a admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:00.217156 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d694e9-26ce-4ec7-9142-cd183792466f admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:00.217332 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e67d98-0bdb-4845-9039-595c74e0985a admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:00.221885 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c7c590-75d9-4256-b3ff-7e290f2d32fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:00.222057 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf14d34-8e0c-4d8c-815a-9105885338b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:00.222541 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7c590-75d9-4256-b3ff-7e290f2d32fb admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:00.222841 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7c590-75d9-4256-b3ff-7e290f2d32fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:00.222962 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf14d34-8e0c-4d8c-815a-9105885338b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:00.223089 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7c590-75d9-4256-b3ff-7e290f2d32fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:00.223181 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf14d34-8e0c-4d8c-815a-9105885338b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:00.223437 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf14d34-8e0c-4d8c-815a-9105885338b3 admin admin] PATH_INFO: `/v3/projects/5882975bac7244929b452349e972fa9d/users/0f292cde7f7142f08e961a3d20d76b31/roles/ad3a2bc7b2094a4da1a95a143c8d9436` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:00.223877 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c7c590-75d9-4256-b3ff-7e290f2d32fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:00.225468 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c7c590-75d9-4256-b3ff-7e290f2d32fb admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:00.235469 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 790/1581] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:50:00.236298 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c7c590-75d9-4256-b3ff-7e290f2d32fb admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:00.239043 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf14d34-8e0c-4d8c-815a-9105885338b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5882975bac7244929b452349e972fa9d, user_id=0f292cde7f7142f08e961a3d20d76b31, role_id=ad3a2bc7b2094a4da1a95a143c8d9436)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:00.242234 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf14d34-8e0c-4d8c-815a-9105885338b3 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:00.247094 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c7c590-75d9-4256-b3ff-7e290f2d32fb admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:00.251063 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604eda25-374b-41ec-84f0-8656c8ab58b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:00.251735 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604eda25-374b-41ec-84f0-8656c8ab58b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:00.252029 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604eda25-374b-41ec-84f0-8656c8ab58b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:00.252307 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604eda25-374b-41ec-84f0-8656c8ab58b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:00.253010 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604eda25-374b-41ec-84f0-8656c8ab58b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:00.254893 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604eda25-374b-41ec-84f0-8656c8ab58b8 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:00.355118 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 792/1582] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:50:00 2022] PUT /identity/v3/projects/5882975bac7244929b452349e972fa9d/users/0f292cde7f7142f08e961a3d20d76b31/roles/ad3a2bc7b2094a4da1a95a143c8d9436 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:50:00.355915 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf14d34-8e0c-4d8c-815a-9105885338b3 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:00.381340 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 791/1583] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 16:50:00 2022] POST /identity/v3/users => generated 286 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:50:00.381340 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604eda25-374b-41ec-84f0-8656c8ab58b8 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:00.389759 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604eda25-374b-41ec-84f0-8656c8ab58b8 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:00.421053 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf14d34-8e0c-4d8c-815a-9105885338b3 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:00.425905 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc87cb-e054-4dfe-9fbd-f9ea037a36f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:00.426578 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc87cb-e054-4dfe-9fbd-f9ea037a36f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:00.426862 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc87cb-e054-4dfe-9fbd-f9ea037a36f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:00.427137 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc87cb-e054-4dfe-9fbd-f9ea037a36f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:00.427866 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bc87cb-e054-4dfe-9fbd-f9ea037a36f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:00.429787 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bc87cb-e054-4dfe-9fbd-f9ea037a36f4 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:00.449213 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6e8302-33ed-4cc9-898d-dcded2794bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:00.451073 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e8302-33ed-4cc9-898d-dcded2794bc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:00.451073 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e8302-33ed-4cc9-898d-dcded2794bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:00.451073 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e8302-33ed-4cc9-898d-dcded2794bc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:00.451544 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6e8302-33ed-4cc9-898d-dcded2794bc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:00.452795 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6e8302-33ed-4cc9-898d-dcded2794bc7 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:00.462894 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 792/1584] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:50:00.464360 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6e8302-33ed-4cc9-898d-dcded2794bc7 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:00.474457 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6e8302-33ed-4cc9-898d-dcded2794bc7 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:00.479152 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0538bbb-5639-4d43-8183-9074abb1f419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:00.479842 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0538bbb-5639-4d43-8183-9074abb1f419 admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:00.480127 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0538bbb-5639-4d43-8183-9074abb1f419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:00.480413 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0538bbb-5639-4d43-8183-9074abb1f419 admin admin] PATH_INFO: `/v3/users` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:00.481093 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0538bbb-5639-4d43-8183-9074abb1f419 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:00.483019 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0538bbb-5639-4d43-8183-9074abb1f419 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:00.512758 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 793/1585] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 16:50:00 2022] POST /identity/v3/users => generated 283 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:50:00.513637 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc87cb-e054-4dfe-9fbd-f9ea037a36f4 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:00.523783 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc87cb-e054-4dfe-9fbd-f9ea037a36f4 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:00.529106 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33421aa7-9f8d-498b-928a-67b3c2a78e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:00.529781 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33421aa7-9f8d-498b-928a-67b3c2a78e42 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:00.530066 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33421aa7-9f8d-498b-928a-67b3c2a78e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:00.530345 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33421aa7-9f8d-498b-928a-67b3c2a78e42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:00.531072 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33421aa7-9f8d-498b-928a-67b3c2a78e42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:00.532702 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33421aa7-9f8d-498b-928a-67b3c2a78e42 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:00.543330 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 794/1586] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:50:00.544206 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33421aa7-9f8d-498b-928a-67b3c2a78e42 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:00.553825 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33421aa7-9f8d-498b-928a-67b3c2a78e42 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:00.559095 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4a4559-8e00-49af-a230-0e6908fa267c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:00.559765 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a4559-8e00-49af-a230-0e6908fa267c admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:00.560053 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a4559-8e00-49af-a230-0e6908fa267c admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:00.560331 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a4559-8e00-49af-a230-0e6908fa267c admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:00.561070 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4a4559-8e00-49af-a230-0e6908fa267c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:00.562660 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4a4559-8e00-49af-a230-0e6908fa267c admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:00.574246 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 795/1587] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:50:00.575048 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4a4559-8e00-49af-a230-0e6908fa267c admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:00.579985 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:00.585618 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4a4559-8e00-49af-a230-0e6908fa267c admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:00.589383 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 793/1588] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 16:50:00 2022] POST /identity/v3/users => generated 288 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:50:00.590846 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e053a-91cc-4388-9223-efc4d62264cc None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:00.591156 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e053a-91cc-4388-9223-efc4d62264cc None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:00.591435 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e053a-91cc-4388-9223-efc4d62264cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:00.593092 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e72515-c94f-4e1a-a4de-bd33061cba7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:00.593983 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e72515-c94f-4e1a-a4de-bd33061cba7c admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:00.594262 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e72515-c94f-4e1a-a4de-bd33061cba7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:00.594545 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e72515-c94f-4e1a-a4de-bd33061cba7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:00.595262 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e72515-c94f-4e1a-a4de-bd33061cba7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:00.596904 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e72515-c94f-4e1a-a4de-bd33061cba7c admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:00.610600 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 796/1589] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:50:00.610600 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e72515-c94f-4e1a-a4de-bd33061cba7c admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:00.611149 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-7d9e053a-91cc-4388-9223-efc4d62264cc None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:00.612404 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-7d9e053a-91cc-4388-9223-efc4d62264cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:00.618881 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e72515-c94f-4e1a-a4de-bd33061cba7c admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:00.620936 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 794/1590] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:50:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:50:00.621537 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9e053a-91cc-4388-9223-efc4d62264cc None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:00.628755 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b404cdef-67ce-48db-8dd5-e6249fb09c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:00.629673 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404cdef-67ce-48db-8dd5-e6249fb09c72 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:00.630023 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404cdef-67ce-48db-8dd5-e6249fb09c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:00.630404 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404cdef-67ce-48db-8dd5-e6249fb09c72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:00.631282 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b404cdef-67ce-48db-8dd5-e6249fb09c72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:00.632080 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9e053a-91cc-4388-9223-efc4d62264cc None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:00.632965 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b404cdef-67ce-48db-8dd5-e6249fb09c72 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:00.637595 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6233c2-0331-457c-a7ee-6d5b92bb04c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:00.638476 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6233c2-0331-457c-a7ee-6d5b92bb04c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:00.639338 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6233c2-0331-457c-a7ee-6d5b92bb04c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:00.639338 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6233c2-0331-457c-a7ee-6d5b92bb04c5 admin admin] PATH_INFO: `/v3/projects/2a79870b4c874b8796d8e2bcf163dfb6/users/27015a61b08249388e22187e1e56c057/roles/ad3a2bc7b2094a4da1a95a143c8d9436` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:00.644307 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 797/1591] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:50:00.645379 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b404cdef-67ce-48db-8dd5-e6249fb09c72 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:00.654454 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6233c2-0331-457c-a7ee-6d5b92bb04c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a79870b4c874b8796d8e2bcf163dfb6, user_id=27015a61b08249388e22187e1e56c057, role_id=ad3a2bc7b2094a4da1a95a143c8d9436)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:00.655569 dv-cinder-846173-3-smb devstack@keystone.service[80545]: WARNING py.warnings [None req-5a6233c2-0331-457c-a7ee-6d5b92bb04c5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 16:50:00.655569 dv-cinder-846173-3-smb devstack@keystone.service[80545]: warnings.warn(msg) Jul 18 16:50:00.655569 dv-cinder-846173-3-smb devstack@keystone.service[80545]: Jul 18 16:50:00.656474 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b404cdef-67ce-48db-8dd5-e6249fb09c72 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:00.657615 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6233c2-0331-457c-a7ee-6d5b92bb04c5 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:00.661139 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a4eb5-d1ae-430a-bf66-9864a06353f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:00.661955 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a4eb5-d1ae-430a-bf66-9864a06353f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:00.662245 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a4eb5-d1ae-430a-bf66-9864a06353f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:00.662524 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a4eb5-d1ae-430a-bf66-9864a06353f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:00.663250 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982a4eb5-d1ae-430a-bf66-9864a06353f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:00.664904 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982a4eb5-d1ae-430a-bf66-9864a06353f1 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:00.675589 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 798/1592] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:50:00.676433 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a4eb5-d1ae-430a-bf66-9864a06353f1 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:00.686294 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a4eb5-d1ae-430a-bf66-9864a06353f1 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:00.691090 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e461e-1bcc-4848-bc34-f53414eb22a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:00.691747 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e461e-1bcc-4848-bc34-f53414eb22a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:00.692024 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e461e-1bcc-4848-bc34-f53414eb22a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:00.692303 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e461e-1bcc-4848-bc34-f53414eb22a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:00.693058 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0e461e-1bcc-4848-bc34-f53414eb22a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:00.694624 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0e461e-1bcc-4848-bc34-f53414eb22a5 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:00.705223 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 799/1593] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:50:00.708190 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e461e-1bcc-4848-bc34-f53414eb22a5 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:00.715116 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e461e-1bcc-4848-bc34-f53414eb22a5 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:00.719846 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223aeb67-4a56-475a-b0b6-afb3b3993cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:00.720725 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223aeb67-4a56-475a-b0b6-afb3b3993cae admin admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:00.721005 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223aeb67-4a56-475a-b0b6-afb3b3993cae admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:00.721283 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223aeb67-4a56-475a-b0b6-afb3b3993cae admin admin] PATH_INFO: `/v3/projects/5c7a58bbcfcb40eeadc7620aa6a86f65/users/512342c273bb4299ad5fc29e69b5aeb8/roles/ad3a2bc7b2094a4da1a95a143c8d9436` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:00.736985 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223aeb67-4a56-475a-b0b6-afb3b3993cae admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c7a58bbcfcb40eeadc7620aa6a86f65, user_id=512342c273bb4299ad5fc29e69b5aeb8, role_id=ad3a2bc7b2094a4da1a95a143c8d9436)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:00.745154 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223aeb67-4a56-475a-b0b6-afb3b3993cae admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:00.745287 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 795/1594] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:50:00 2022] PUT /identity/v3/projects/2a79870b4c874b8796d8e2bcf163dfb6/users/27015a61b08249388e22187e1e56c057/roles/ad3a2bc7b2094a4da1a95a143c8d9436 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:50:00.745287 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6233c2-0331-457c-a7ee-6d5b92bb04c5 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:00.750856 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:00.805916 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6233c2-0331-457c-a7ee-6d5b92bb04c5 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:00.811131 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8400f5-3dea-4f6b-a99f-100e18a9ef69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:00.811820 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8400f5-3dea-4f6b-a99f-100e18a9ef69 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:00.812099 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8400f5-3dea-4f6b-a99f-100e18a9ef69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:00.812371 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8400f5-3dea-4f6b-a99f-100e18a9ef69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:00.813088 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8400f5-3dea-4f6b-a99f-100e18a9ef69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:00.814647 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8400f5-3dea-4f6b-a99f-100e18a9ef69 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:00.824767 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 796/1595] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:50:00.825533 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8400f5-3dea-4f6b-a99f-100e18a9ef69 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:00.835281 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8400f5-3dea-4f6b-a99f-100e18a9ef69 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:00.839982 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b095bbfd-ae69-46e1-8172-e2d88637364c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:00.840823 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095bbfd-ae69-46e1-8172-e2d88637364c admin admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:00.841096 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095bbfd-ae69-46e1-8172-e2d88637364c admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:00.841362 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095bbfd-ae69-46e1-8172-e2d88637364c admin admin] PATH_INFO: `/v3/projects/9ad0385007b248f99e23e7a98282a626/users/e10e5fd0d1734416b3e28f29a5ffc6ea/roles/ad3a2bc7b2094a4da1a95a143c8d9436` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:00.854782 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 800/1596] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:50:00 2022] PUT /identity/v3/projects/5c7a58bbcfcb40eeadc7620aa6a86f65/users/512342c273bb4299ad5fc29e69b5aeb8/roles/ad3a2bc7b2094a4da1a95a143c8d9436 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:50:00.855982 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b095bbfd-ae69-46e1-8172-e2d88637364c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ad0385007b248f99e23e7a98282a626, user_id=e10e5fd0d1734416b3e28f29a5ffc6ea, role_id=ad3a2bc7b2094a4da1a95a143c8d9436)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:00.858601 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b095bbfd-ae69-46e1-8172-e2d88637364c admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:00.859412 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223aeb67-4a56-475a-b0b6-afb3b3993cae admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:00.861135 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-223aeb67-4a56-475a-b0b6-afb3b3993cae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:00.917299 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223aeb67-4a56-475a-b0b6-afb3b3993cae admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:00.920912 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b9742-acea-4908-9e23-5fff91b53e68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:00.921553 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b9742-acea-4908-9e23-5fff91b53e68 service neutron] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:00.921836 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b9742-acea-4908-9e23-5fff91b53e68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:00.922109 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b9742-acea-4908-9e23-5fff91b53e68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:00.940963 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 797/1597] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:50:00 2022] PUT /identity/v3/projects/9ad0385007b248f99e23e7a98282a626/users/e10e5fd0d1734416b3e28f29a5ffc6ea/roles/ad3a2bc7b2094a4da1a95a143c8d9436 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:50:00.941583 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b095bbfd-ae69-46e1-8172-e2d88637364c admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:00.983997 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b9742-acea-4908-9e23-5fff91b53e68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:00.985460 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b9742-acea-4908-9e23-5fff91b53e68 service neutron] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:00.995830 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 801/1598] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:50:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:50:00.996667 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b9742-acea-4908-9e23-5fff91b53e68 service neutron] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:01.008400 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b9742-acea-4908-9e23-5fff91b53e68 service neutron] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:01.011388 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a1b4e-f22f-4a27-bc2f-b20e2ff1ecba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:01.012285 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a1b4e-f22f-4a27-bc2f-b20e2ff1ecba admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:01.012757 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a1b4e-f22f-4a27-bc2f-b20e2ff1ecba admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:01.013206 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a1b4e-f22f-4a27-bc2f-b20e2ff1ecba admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:01.014111 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053a1b4e-f22f-4a27-bc2f-b20e2ff1ecba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:01.014501 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b095bbfd-ae69-46e1-8172-e2d88637364c admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:01.016184 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053a1b4e-f22f-4a27-bc2f-b20e2ff1ecba admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:01.020203 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f211d57-8057-4d5f-8660-848019fa82b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:01.021010 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f211d57-8057-4d5f-8660-848019fa82b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:01.021291 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f211d57-8057-4d5f-8660-848019fa82b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:01.021562 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f211d57-8057-4d5f-8660-848019fa82b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:01.022378 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f211d57-8057-4d5f-8660-848019fa82b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:01.024031 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f211d57-8057-4d5f-8660-848019fa82b0 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:01.028553 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 802/1599] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:50:01.029159 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a1b4e-f22f-4a27-bc2f-b20e2ff1ecba admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:01.037070 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 798/1600] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:50:01.038396 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaad3be-5d2d-47bc-ae48-fefe1792fae7 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:01.038681 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaad3be-5d2d-47bc-ae48-fefe1792fae7 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:01.038787 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a1b4e-f22f-4a27-bc2f-b20e2ff1ecba admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:01.038976 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaad3be-5d2d-47bc-ae48-fefe1792fae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:01.044282 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e509efce-bf11-4093-9846-6a1207aa671d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:01.045170 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e509efce-bf11-4093-9846-6a1207aa671d admin admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:01.045456 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e509efce-bf11-4093-9846-6a1207aa671d admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:01.045734 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e509efce-bf11-4093-9846-6a1207aa671d admin admin] PATH_INFO: `/v3/projects/11f85668e030420ea9b51b724dcd950d/users/7c6f005f5340494dabfc000fe19fe60a/roles/ad3a2bc7b2094a4da1a95a143c8d9436` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:01.056740 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-fdaad3be-5d2d-47bc-ae48-fefe1792fae7 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:01.058581 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-fdaad3be-5d2d-47bc-ae48-fefe1792fae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:01.061569 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e509efce-bf11-4093-9846-6a1207aa671d admin admin] RBAC: Authorizing `identity:create_grant(project_id=11f85668e030420ea9b51b724dcd950d, user_id=7c6f005f5340494dabfc000fe19fe60a, role_id=ad3a2bc7b2094a4da1a95a143c8d9436)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:01.064357 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e509efce-bf11-4093-9846-6a1207aa671d admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:01.068143 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 799/1601] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:50:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:50:01.068143 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaad3be-5d2d-47bc-ae48-fefe1792fae7 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:01.077263 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaad3be-5d2d-47bc-ae48-fefe1792fae7 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:01.082339 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb11a5-22a2-40c6-896b-a26082160208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:01.085896 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb11a5-22a2-40c6-896b-a26082160208 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:01.085896 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb11a5-22a2-40c6-896b-a26082160208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:01.085896 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb11a5-22a2-40c6-896b-a26082160208 admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:01.085896 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefb11a5-22a2-40c6-896b-a26082160208 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:01.086494 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefb11a5-22a2-40c6-896b-a26082160208 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:01.096723 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 800/1602] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:50:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:50:01.098064 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a9541-b688-4653-9cb4-d0edccf04819 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:01.098348 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a9541-b688-4653-9cb4-d0edccf04819 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:01.098623 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a9541-b688-4653-9cb4-d0edccf04819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:01.118529 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-132a9541-b688-4653-9cb4-d0edccf04819 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:01.120268 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-132a9541-b688-4653-9cb4-d0edccf04819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:01.128677 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 801/1603] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:50:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:50:01.129990 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ecb0f5-5320-4a6d-8425-e9f90bc828ff None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:01.130465 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ecb0f5-5320-4a6d-8425-e9f90bc828ff None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:01.130577 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ecb0f5-5320-4a6d-8425-e9f90bc828ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:01.159645 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-f8ecb0f5-5320-4a6d-8425-e9f90bc828ff None None] MFA Rules not processed for user `e10e5fd0d1734416b3e28f29a5ffc6ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:01.160982 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-f8ecb0f5-5320-4a6d-8425-e9f90bc828ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:01.169864 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 803/1604] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:50:01 2022] PUT /identity/v3/projects/11f85668e030420ea9b51b724dcd950d/users/7c6f005f5340494dabfc000fe19fe60a/roles/ad3a2bc7b2094a4da1a95a143c8d9436 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:50:01.175178 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e509efce-bf11-4093-9846-6a1207aa671d admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:01.187948 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:01.206921 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:01.239025 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 802/1605] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:50:01 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:50:01.240580 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ecb0f5-5320-4a6d-8425-e9f90bc828ff None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:01.255336 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e509efce-bf11-4093-9846-6a1207aa671d admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:01.260285 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838c34df-ea89-402d-aae7-0f3156b080f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:01.261227 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c34df-ea89-402d-aae7-0f3156b080f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:01.261565 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c34df-ea89-402d-aae7-0f3156b080f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:01.261840 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c34df-ea89-402d-aae7-0f3156b080f1 admin admin] PATH_INFO: `/v3/projects/e6e3f8c343fd45629d9c389cd18c7e59/users/ee174b41048044878d4989322a226d49/roles/ad3a2bc7b2094a4da1a95a143c8d9436` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:01.278463 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838c34df-ea89-402d-aae7-0f3156b080f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6e3f8c343fd45629d9c389cd18c7e59, user_id=ee174b41048044878d4989322a226d49, role_id=ad3a2bc7b2094a4da1a95a143c8d9436)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:01.281223 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838c34df-ea89-402d-aae7-0f3156b080f1 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:01.308576 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ecb0f5-5320-4a6d-8425-e9f90bc828ff None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:01.313360 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f013b-52d8-46f5-bdfa-a46b1e4fcdf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:01.314089 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f013b-52d8-46f5-bdfa-a46b1e4fcdf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:01.314753 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f013b-52d8-46f5-bdfa-a46b1e4fcdf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:01.315246 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f013b-52d8-46f5-bdfa-a46b1e4fcdf8 admin admin] PATH_INFO: `/v3/projects/733bea5a64d24b53a95038a0d535f7bc/users/f8a784ca4d3048139ea6111118853e3e/roles/ad3a2bc7b2094a4da1a95a143c8d9436` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:01.331587 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419f013b-52d8-46f5-bdfa-a46b1e4fcdf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=733bea5a64d24b53a95038a0d535f7bc, user_id=f8a784ca4d3048139ea6111118853e3e, role_id=ad3a2bc7b2094a4da1a95a143c8d9436)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:01.335764 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419f013b-52d8-46f5-bdfa-a46b1e4fcdf8 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:01.378782 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 804/1606] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:50:01 2022] PUT /identity/v3/projects/e6e3f8c343fd45629d9c389cd18c7e59/users/ee174b41048044878d4989322a226d49/roles/ad3a2bc7b2094a4da1a95a143c8d9436 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:50:01.381944 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838c34df-ea89-402d-aae7-0f3156b080f1 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:01.436638 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 803/1607] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:50:01 2022] PUT /identity/v3/projects/733bea5a64d24b53a95038a0d535f7bc/users/f8a784ca4d3048139ea6111118853e3e/roles/ad3a2bc7b2094a4da1a95a143c8d9436 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:50:01.437443 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f013b-52d8-46f5-bdfa-a46b1e4fcdf8 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:01.449150 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838c34df-ea89-402d-aae7-0f3156b080f1 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:01.504575 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f013b-52d8-46f5-bdfa-a46b1e4fcdf8 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:01.508422 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c43ca6c-9d45-4f01-8fa4-8c099d820fda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:01.509082 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43ca6c-9d45-4f01-8fa4-8c099d820fda service neutron] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:01.509314 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9ce810-b6a6-4ee8-87fe-6957f820bf7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:01.509455 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43ca6c-9d45-4f01-8fa4-8c099d820fda service neutron] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:01.509629 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43ca6c-9d45-4f01-8fa4-8c099d820fda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:01.510285 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ce810-b6a6-4ee8-87fe-6957f820bf7c admin admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:01.510568 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ce810-b6a6-4ee8-87fe-6957f820bf7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:01.510846 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ce810-b6a6-4ee8-87fe-6957f820bf7c admin admin] PATH_INFO: `/v3/projects/5e08d023867c466f880d0d68e5cb3ea3/users/007fe8955e1149dea44d5a85b6b94299/roles/ad3a2bc7b2094a4da1a95a143c8d9436` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:01.519490 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c43ca6c-9d45-4f01-8fa4-8c099d820fda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:01.527059 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c43ca6c-9d45-4f01-8fa4-8c099d820fda service neutron] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:01.528787 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9ce810-b6a6-4ee8-87fe-6957f820bf7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e08d023867c466f880d0d68e5cb3ea3, user_id=007fe8955e1149dea44d5a85b6b94299, role_id=ad3a2bc7b2094a4da1a95a143c8d9436)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:01.531504 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9ce810-b6a6-4ee8-87fe-6957f820bf7c admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:01.532132 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 805/1608] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:50:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:50:01.540348 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c43ca6c-9d45-4f01-8fa4-8c099d820fda service neutron] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:01.549792 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c43ca6c-9d45-4f01-8fa4-8c099d820fda service neutron] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:01.553781 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09179c1c-7527-4154-a620-6d3954b32851 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:01.554467 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09179c1c-7527-4154-a620-6d3954b32851 service neutron] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:01.554769 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09179c1c-7527-4154-a620-6d3954b32851 service neutron] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:01.555028 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09179c1c-7527-4154-a620-6d3954b32851 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:01.565814 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09179c1c-7527-4154-a620-6d3954b32851 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:01.567274 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09179c1c-7527-4154-a620-6d3954b32851 service neutron] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:01.577893 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 806/1609] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:50:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:50:01.579237 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec43493-4cc7-4fbf-aba6-623f98860cb8 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:01.584523 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec43493-4cc7-4fbf-aba6-623f98860cb8 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:01.584523 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec43493-4cc7-4fbf-aba6-623f98860cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:01.599785 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-1ec43493-4cc7-4fbf-aba6-623f98860cb8 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:01.601034 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-1ec43493-4cc7-4fbf-aba6-623f98860cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:01.617763 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 807/1610] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:50:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:50:01.618611 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec43493-4cc7-4fbf-aba6-623f98860cb8 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:01.632246 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec43493-4cc7-4fbf-aba6-623f98860cb8 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:01.639877 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f5ac3-fb39-41ce-be88-9f9b27b5ba24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:01.640686 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f5ac3-fb39-41ce-be88-9f9b27b5ba24 admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:01.641257 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f5ac3-fb39-41ce-be88-9f9b27b5ba24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:01.641773 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f5ac3-fb39-41ce-be88-9f9b27b5ba24 admin admin] PATH_INFO: `/v3/projects` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:01.643155 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771f5ac3-fb39-41ce-be88-9f9b27b5ba24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:01.646460 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771f5ac3-fb39-41ce-be88-9f9b27b5ba24 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:01.654950 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 804/1611] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:50:01 2022] PUT /identity/v3/projects/5e08d023867c466f880d0d68e5cb3ea3/users/007fe8955e1149dea44d5a85b6b94299/roles/ad3a2bc7b2094a4da1a95a143c8d9436 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:50:01.656297 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6f9e1-3866-4a2c-a54b-7145d502c91d None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:01.656591 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6f9e1-3866-4a2c-a54b-7145d502c91d None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:01.656874 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6f9e1-3866-4a2c-a54b-7145d502c91d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:01.688030 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-02a6f9e1-3866-4a2c-a54b-7145d502c91d None None] MFA Rules not processed for user `ee174b41048044878d4989322a226d49`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:01.689286 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-02a6f9e1-3866-4a2c-a54b-7145d502c91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:01.734793 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:01.757080 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 808/1612] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:50:01 2022] POST /identity/v3/projects => generated 363 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:50:01.758897 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9b1a0-7d3f-46c5-a8a9-e50e9d7dc7ee None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:01.759419 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9b1a0-7d3f-46c5-a8a9-e50e9d7dc7ee None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:01.759963 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9b1a0-7d3f-46c5-a8a9-e50e9d7dc7ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:01.782676 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 805/1613] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:50:01 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:50:01.782676 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a6f9e1-3866-4a2c-a54b-7145d502c91d None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:01.784133 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:01.799236 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-62c9b1a0-7d3f-46c5-a8a9-e50e9d7dc7ee None None] MFA Rules not processed for user `f8a784ca4d3048139ea6111118853e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:01.800585 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-62c9b1a0-7d3f-46c5-a8a9-e50e9d7dc7ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:01.846611 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a6f9e1-3866-4a2c-a54b-7145d502c91d None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:01.907193 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 809/1614] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:50:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:50:01.907397 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c60e5b-d2b4-4477-9362-7502217dfa8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:01.908150 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c60e5b-d2b4-4477-9362-7502217dfa8b service neutron] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:01.908439 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c60e5b-d2b4-4477-9362-7502217dfa8b service neutron] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:01.908716 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c60e5b-d2b4-4477-9362-7502217dfa8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:01.909491 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff71773-918f-4591-86dc-e215f0c5c10d None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:01.910059 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff71773-918f-4591-86dc-e215f0c5c10d None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:01.910453 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff71773-918f-4591-86dc-e215f0c5c10d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:01.962264 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-5ff71773-918f-4591-86dc-e215f0c5c10d None None] MFA Rules not processed for user `007fe8955e1149dea44d5a85b6b94299`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:01.964742 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-5ff71773-918f-4591-86dc-e215f0c5c10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:02.015616 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c60e5b-d2b4-4477-9362-7502217dfa8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:02.017110 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c60e5b-d2b4-4477-9362-7502217dfa8b service neutron] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:02.030759 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 806/1615] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:50:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:50:02.031531 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c60e5b-d2b4-4477-9362-7502217dfa8b service neutron] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:02.041845 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c60e5b-d2b4-4477-9362-7502217dfa8b service neutron] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:02.047740 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61c1f0-3f8b-48fa-b393-ffcb430d2a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:02.048415 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61c1f0-3f8b-48fa-b393-ffcb430d2a66 admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:02.048698 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61c1f0-3f8b-48fa-b393-ffcb430d2a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:02.058358 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61c1f0-3f8b-48fa-b393-ffcb430d2a66 admin admin] PATH_INFO: `/v3/users` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:02.058358 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db61c1f0-3f8b-48fa-b393-ffcb430d2a66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:02.058566 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 810/1616] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:50:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:50:02.058566 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff71773-918f-4591-86dc-e215f0c5c10d None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:02.058720 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db61c1f0-3f8b-48fa-b393-ffcb430d2a66 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:02.063898 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff71773-918f-4591-86dc-e215f0c5c10d None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:02.069844 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dee91e8-3201-4ef0-a914-5ea6e9a8a725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:02.069844 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee91e8-3201-4ef0-a914-5ea6e9a8a725 admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:02.070124 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee91e8-3201-4ef0-a914-5ea6e9a8a725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:02.070214 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee91e8-3201-4ef0-a914-5ea6e9a8a725 admin admin] PATH_INFO: `/v3/projects` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:02.071011 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dee91e8-3201-4ef0-a914-5ea6e9a8a725 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:02.073537 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dee91e8-3201-4ef0-a914-5ea6e9a8a725 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:02.209797 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 807/1617] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 16:50:02 2022] POST /identity/v3/users => generated 288 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:50:02.210935 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61c1f0-3f8b-48fa-b393-ffcb430d2a66 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:02.222421 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61c1f0-3f8b-48fa-b393-ffcb430d2a66 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:02.227283 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8213083-8c82-45a1-a478-1ef37e30af80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:02.227976 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8213083-8c82-45a1-a478-1ef37e30af80 admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:02.228258 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8213083-8c82-45a1-a478-1ef37e30af80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:02.228532 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8213083-8c82-45a1-a478-1ef37e30af80 admin admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:02.229243 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8213083-8c82-45a1-a478-1ef37e30af80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:02.231137 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8213083-8c82-45a1-a478-1ef37e30af80 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:02.250652 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 811/1618] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:50:02 2022] POST /identity/v3/projects => generated 361 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:50:02.252197 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0bae5-e528-4697-bd76-f4e284a59e69 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:02.252673 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0bae5-e528-4697-bd76-f4e284a59e69 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:02.253229 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0bae5-e528-4697-bd76-f4e284a59e69 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:02.261252 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 812/1619] 10.222.0.81 () {54 vars in 962 bytes} [Mon Jul 18 16:50:02 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:50:02.262524 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf0bae5-e528-4697-bd76-f4e284a59e69 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:02.342657 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf0bae5-e528-4697-bd76-f4e284a59e69 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:02.346344 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a84f7-2ac4-4626-8dfd-8636bb2d2db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:02.347018 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a84f7-2ac4-4626-8dfd-8636bb2d2db4 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:02.347296 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a84f7-2ac4-4626-8dfd-8636bb2d2db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:02.347565 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a84f7-2ac4-4626-8dfd-8636bb2d2db4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:02.348316 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0a84f7-2ac4-4626-8dfd-8636bb2d2db4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:02.349916 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0a84f7-2ac4-4626-8dfd-8636bb2d2db4 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:02.361044 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 813/1620] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:50:02 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:50:02.362463 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a84f7-2ac4-4626-8dfd-8636bb2d2db4 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:02.367611 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:02.372575 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a84f7-2ac4-4626-8dfd-8636bb2d2db4 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:02.377588 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7efbf6-7511-411f-a43f-2d6652a72ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:02.378259 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7efbf6-7511-411f-a43f-2d6652a72ffa admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:02.378533 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7efbf6-7511-411f-a43f-2d6652a72ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:02.378806 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7efbf6-7511-411f-a43f-2d6652a72ffa admin admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:02.379522 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7efbf6-7511-411f-a43f-2d6652a72ffa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:02.381482 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7efbf6-7511-411f-a43f-2d6652a72ffa admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:02.405010 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:02.432458 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 808/1621] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:50:02 2022] POST /identity/v3/projects => generated 373 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:50:02.432458 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5403098-25c7-49b4-975f-fb17cd36d687 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:02.432458 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5403098-25c7-49b4-975f-fb17cd36d687 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:02.432458 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5403098-25c7-49b4-975f-fb17cd36d687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:02.456244 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-f5403098-25c7-49b4-975f-fb17cd36d687 None None] MFA Rules not processed for user `07f0c5bf1bee48a0bafdf7a9e4537c70`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:02.457544 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-f5403098-25c7-49b4-975f-fb17cd36d687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:02.527093 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 814/1622] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 16:50:02 2022] POST /identity/v3/users => generated 287 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:50:02.528035 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7efbf6-7511-411f-a43f-2d6652a72ffa admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:02.539134 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7efbf6-7511-411f-a43f-2d6652a72ffa admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:02.549775 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 809/1623] 10.222.0.81 () {58 vars in 1059 bytes} [Mon Jul 18 16:50:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:50:02.554200 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5403098-25c7-49b4-975f-fb17cd36d687 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:02.638642 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5403098-25c7-49b4-975f-fb17cd36d687 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:02.661657 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e04b65c-7be4-47f7-a9ed-ef7905be8548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:02.662794 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04b65c-7be4-47f7-a9ed-ef7905be8548 admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:02.663513 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04b65c-7be4-47f7-a9ed-ef7905be8548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:02.664730 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04b65c-7be4-47f7-a9ed-ef7905be8548 admin admin] PATH_INFO: `/v3/users` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:02.665955 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e04b65c-7be4-47f7-a9ed-ef7905be8548 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:02.669882 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e04b65c-7be4-47f7-a9ed-ef7905be8548 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:02.685152 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570dbd62-45c1-475e-9103-26b2afea2fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:02.685152 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570dbd62-45c1-475e-9103-26b2afea2fb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:02.685152 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570dbd62-45c1-475e-9103-26b2afea2fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:02.685152 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570dbd62-45c1-475e-9103-26b2afea2fb1 admin admin] PATH_INFO: `/v3/projects/783bc7905a5f428b9dd7bf41b3dc2b81/users/268ba628e84b40bf8927cc810909302b/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:02.702652 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570dbd62-45c1-475e-9103-26b2afea2fb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=783bc7905a5f428b9dd7bf41b3dc2b81, user_id=268ba628e84b40bf8927cc810909302b, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:02.706027 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570dbd62-45c1-475e-9103-26b2afea2fb1 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:02.791990 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 810/1624] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 16:50:02 2022] POST /identity/v3/users => generated 293 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:50:02.793037 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e04b65c-7be4-47f7-a9ed-ef7905be8548 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:02.826218 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e04b65c-7be4-47f7-a9ed-ef7905be8548 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:02.838943 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64e0c2-8572-414c-a043-9e0602838cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:02.840410 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64e0c2-8572-414c-a043-9e0602838cbc admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:02.840836 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64e0c2-8572-414c-a043-9e0602838cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:02.841220 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64e0c2-8572-414c-a043-9e0602838cbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:02.842259 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed64e0c2-8572-414c-a043-9e0602838cbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:02.844221 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed64e0c2-8572-414c-a043-9e0602838cbc admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:02.860942 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 815/1625] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:50:02 2022] PUT /identity/v3/projects/783bc7905a5f428b9dd7bf41b3dc2b81/users/268ba628e84b40bf8927cc810909302b/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:50:02.860942 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570dbd62-45c1-475e-9103-26b2afea2fb1 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:02.862535 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 811/1626] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:50:02 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:50:02.863447 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64e0c2-8572-414c-a043-9e0602838cbc admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:02.877664 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64e0c2-8572-414c-a043-9e0602838cbc admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:02.997697 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b76be45-cfcf-41b5-9190-9d53cd0b689d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:02.998667 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76be45-cfcf-41b5-9190-9d53cd0b689d admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:02.998968 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76be45-cfcf-41b5-9190-9d53cd0b689d admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:02.999254 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76be45-cfcf-41b5-9190-9d53cd0b689d admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:03.002531 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b76be45-cfcf-41b5-9190-9d53cd0b689d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:03.007209 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b76be45-cfcf-41b5-9190-9d53cd0b689d admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:03.022909 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 812/1627] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:50:02 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:50:03.024032 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b76be45-cfcf-41b5-9190-9d53cd0b689d admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:03.024335 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570dbd62-45c1-475e-9103-26b2afea2fb1 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:03.039388 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67468abd-f6ae-4a9d-afa4-f2d21c57dff1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07f0c5bf1bee48a0bafdf7a9e4537c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:03.040855 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67468abd-f6ae-4a9d-afa4-f2d21c57dff1 service nova] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:03.041153 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67468abd-f6ae-4a9d-afa4-f2d21c57dff1 service nova] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:03.041318 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b76be45-cfcf-41b5-9190-9d53cd0b689d admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:03.041682 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67468abd-f6ae-4a9d-afa4-f2d21c57dff1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:03.048026 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e1b848-4f92-4424-b32c-d7face8e173c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:03.048736 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1b848-4f92-4424-b32c-d7face8e173c admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:03.049026 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1b848-4f92-4424-b32c-d7face8e173c admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:03.049306 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1b848-4f92-4424-b32c-d7face8e173c admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:03.050172 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e1b848-4f92-4424-b32c-d7face8e173c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:03.052829 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e1b848-4f92-4424-b32c-d7face8e173c admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:03.068254 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 813/1628] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:50:03.069456 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e1b848-4f92-4424-b32c-d7face8e173c admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:03.090284 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e1b848-4f92-4424-b32c-d7face8e173c admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:03.099033 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b57b268-ab6d-47b3-86cd-7fb9859a5b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:03.101076 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57b268-ab6d-47b3-86cd-7fb9859a5b76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:03.101394 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57b268-ab6d-47b3-86cd-7fb9859a5b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:03.101726 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57b268-ab6d-47b3-86cd-7fb9859a5b76 admin admin] PATH_INFO: `/v3/projects/eff0d73c0605461dbe13cde546987c2d/users/4a8ee14fd4b84114b06b2c5208038a42/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:03.134884 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b57b268-ab6d-47b3-86cd-7fb9859a5b76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eff0d73c0605461dbe13cde546987c2d, user_id=4a8ee14fd4b84114b06b2c5208038a42, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:03.141489 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b57b268-ab6d-47b3-86cd-7fb9859a5b76 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:03.169084 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67468abd-f6ae-4a9d-afa4-f2d21c57dff1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:03.171486 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67468abd-f6ae-4a9d-afa4-f2d21c57dff1 service nova] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:03.206437 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 816/1629] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:50:02 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:50:03.207727 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67468abd-f6ae-4a9d-afa4-f2d21c57dff1 service nova] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:03.240946 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 814/1630] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:50:03 2022] PUT /identity/v3/projects/eff0d73c0605461dbe13cde546987c2d/users/4a8ee14fd4b84114b06b2c5208038a42/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:50:03.242699 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b57b268-ab6d-47b3-86cd-7fb9859a5b76 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:03.248724 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67468abd-f6ae-4a9d-afa4-f2d21c57dff1 service nova] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:03.374384 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b703494-83de-48cc-b0c0-e8fef2cbc116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:03.375573 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b703494-83de-48cc-b0c0-e8fef2cbc116 admin admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:03.375909 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b703494-83de-48cc-b0c0-e8fef2cbc116 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:03.376194 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b703494-83de-48cc-b0c0-e8fef2cbc116 admin admin] PATH_INFO: `/v3/projects/5ccf3d71a97b4d12a83cc966c210f7ff/users/36472eacb10144169ae235bf13d78f92/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:03.398415 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b703494-83de-48cc-b0c0-e8fef2cbc116 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ccf3d71a97b4d12a83cc966c210f7ff, user_id=36472eacb10144169ae235bf13d78f92, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:03.414849 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b57b268-ab6d-47b3-86cd-7fb9859a5b76 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:03.415584 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b703494-83de-48cc-b0c0-e8fef2cbc116 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:03.428023 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b99af76-8e26-4c19-93c3-1445ef408243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:03.430786 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99af76-8e26-4c19-93c3-1445ef408243 admin admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:03.432811 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99af76-8e26-4c19-93c3-1445ef408243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:03.433120 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99af76-8e26-4c19-93c3-1445ef408243 admin admin] PATH_INFO: `/v3/projects/783bc7905a5f428b9dd7bf41b3dc2b81/users/268ba628e84b40bf8927cc810909302b/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:04.011062 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b99af76-8e26-4c19-93c3-1445ef408243 admin admin] RBAC: Authorizing `identity:create_grant(project_id=783bc7905a5f428b9dd7bf41b3dc2b81, user_id=268ba628e84b40bf8927cc810909302b, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:04.011062 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b99af76-8e26-4c19-93c3-1445ef408243 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:04.011062 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 815/1631] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:50:03 2022] PUT /identity/v3/projects/783bc7905a5f428b9dd7bf41b3dc2b81/users/268ba628e84b40bf8927cc810909302b/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:50:04.011062 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b99af76-8e26-4c19-93c3-1445ef408243 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:04.011062 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b99af76-8e26-4c19-93c3-1445ef408243 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:04.021870 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880af8e0-f6d0-40ed-aa8b-faec66f70960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:04.021870 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880af8e0-f6d0-40ed-aa8b-faec66f70960 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:04.021870 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880af8e0-f6d0-40ed-aa8b-faec66f70960 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:04.021870 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880af8e0-f6d0-40ed-aa8b-faec66f70960 admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:04.033131 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880af8e0-f6d0-40ed-aa8b-faec66f70960 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:04.033131 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880af8e0-f6d0-40ed-aa8b-faec66f70960 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:04.033131 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 816/1632] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:50:04.033131 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673033e-f743-4ee0-8152-08ebddb0625a None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:04.033131 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673033e-f743-4ee0-8152-08ebddb0625a None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:04.033131 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673033e-f743-4ee0-8152-08ebddb0625a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:04.038318 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-0673033e-f743-4ee0-8152-08ebddb0625a None None] MFA Rules not processed for user `268ba628e84b40bf8927cc810909302b`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:04.038318 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-0673033e-f743-4ee0-8152-08ebddb0625a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:04.038318 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 817/1633] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:50:03 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:50:04.038318 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0673033e-f743-4ee0-8152-08ebddb0625a None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:04.038318 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0673033e-f743-4ee0-8152-08ebddb0625a None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:04.042735 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426b8b90-9230-44ec-8630-dfbe46575152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:04.042735 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b8b90-9230-44ec-8630-dfbe46575152 admin admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:04.042735 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b8b90-9230-44ec-8630-dfbe46575152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:04.042735 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b8b90-9230-44ec-8630-dfbe46575152 admin admin] PATH_INFO: `/v3/projects/eff0d73c0605461dbe13cde546987c2d/users/4a8ee14fd4b84114b06b2c5208038a42/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:04.045744 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426b8b90-9230-44ec-8630-dfbe46575152 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eff0d73c0605461dbe13cde546987c2d, user_id=4a8ee14fd4b84114b06b2c5208038a42, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:04.045744 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426b8b90-9230-44ec-8630-dfbe46575152 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:04.050944 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 817/1634] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:50:03 2022] PUT /identity/v3/projects/5ccf3d71a97b4d12a83cc966c210f7ff/users/36472eacb10144169ae235bf13d78f92/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:50:04.050944 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b703494-83de-48cc-b0c0-e8fef2cbc116 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:04.056634 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 818/1635] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:50:03 2022] PUT /identity/v3/projects/eff0d73c0605461dbe13cde546987c2d/users/4a8ee14fd4b84114b06b2c5208038a42/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:50:04.056634 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426b8b90-9230-44ec-8630-dfbe46575152 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:04.056634 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426b8b90-9230-44ec-8630-dfbe46575152 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:04.056634 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aec10f-ede9-4af0-9169-91d086ea329c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:04.060979 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aec10f-ede9-4af0-9169-91d086ea329c admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:04.060979 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aec10f-ede9-4af0-9169-91d086ea329c admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:04.060979 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aec10f-ede9-4af0-9169-91d086ea329c admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:04.060979 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aec10f-ede9-4af0-9169-91d086ea329c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:04.060979 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aec10f-ede9-4af0-9169-91d086ea329c admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:04.064906 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b703494-83de-48cc-b0c0-e8fef2cbc116 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:04.066070 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 819/1636] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:50:04.066070 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e3fbe9-cb2c-42d1-9c72-6282b44e7d02 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:04.066070 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e3fbe9-cb2c-42d1-9c72-6282b44e7d02 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:04.066070 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e3fbe9-cb2c-42d1-9c72-6282b44e7d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:04.066070 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-c2e3fbe9-cb2c-42d1-9c72-6282b44e7d02 None None] MFA Rules not processed for user `4a8ee14fd4b84114b06b2c5208038a42`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:04.066070 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-c2e3fbe9-cb2c-42d1-9c72-6282b44e7d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:04.091792 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db0a354-cd16-4053-bb87-093c10db0361 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:04.091792 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0a354-cd16-4053-bb87-093c10db0361 service cinder] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:04.091792 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0a354-cd16-4053-bb87-093c10db0361 service cinder] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:04.091792 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0a354-cd16-4053-bb87-093c10db0361 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:04.093357 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 820/1637] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:50:03 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:50:04.096589 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e3fbe9-cb2c-42d1-9c72-6282b44e7d02 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:04.112135 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e3fbe9-cb2c-42d1-9c72-6282b44e7d02 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:04.145900 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c77b5d-2af2-46fc-8d89-0baf24fd7525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:04.146819 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c77b5d-2af2-46fc-8d89-0baf24fd7525 admin admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:04.147100 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c77b5d-2af2-46fc-8d89-0baf24fd7525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:04.147374 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c77b5d-2af2-46fc-8d89-0baf24fd7525 admin admin] PATH_INFO: `/v3/projects/5ccf3d71a97b4d12a83cc966c210f7ff/users/36472eacb10144169ae235bf13d78f92/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:04.150306 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c77b5d-2af2-46fc-8d89-0baf24fd7525 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ccf3d71a97b4d12a83cc966c210f7ff, user_id=36472eacb10144169ae235bf13d78f92, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:04.153682 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c77b5d-2af2-46fc-8d89-0baf24fd7525 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:04.187455 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 821/1638] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:50:04 2022] PUT /identity/v3/projects/5ccf3d71a97b4d12a83cc966c210f7ff/users/36472eacb10144169ae235bf13d78f92/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:50:04.205426 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9051e770-8833-4317-87c0-e324be4bac9a None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:04.205426 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9051e770-8833-4317-87c0-e324be4bac9a None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:04.205426 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9051e770-8833-4317-87c0-e324be4bac9a None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:04.205426 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 822/1639] 10.222.0.81 () {54 vars in 962 bytes} [Mon Jul 18 16:50:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:50:04.205426 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9051e770-8833-4317-87c0-e324be4bac9a None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:04.216798 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db0a354-cd16-4053-bb87-093c10db0361 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:04.218748 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db0a354-cd16-4053-bb87-093c10db0361 service cinder] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:04.243598 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 818/1640] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:50:03 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:50:04.245079 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedac74c-0d13-49dd-827e-ce77e2b9f295 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:04.245367 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedac74c-0d13-49dd-827e-ce77e2b9f295 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:04.245639 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedac74c-0d13-49dd-827e-ce77e2b9f295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:04.259134 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:04.303875 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-dedac74c-0d13-49dd-827e-ce77e2b9f295 None None] MFA Rules not processed for user `07f0c5bf1bee48a0bafdf7a9e4537c70`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:04.305331 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-dedac74c-0d13-49dd-827e-ce77e2b9f295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:04.357749 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9051e770-8833-4317-87c0-e324be4bac9a None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:04.371153 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51a704f-4b62-4545-aeba-ce2b0458aa20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:04.372163 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51a704f-4b62-4545-aeba-ce2b0458aa20 service cinder] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:04.372677 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51a704f-4b62-4545-aeba-ce2b0458aa20 service cinder] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:04.373196 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51a704f-4b62-4545-aeba-ce2b0458aa20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:04.443073 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:04.516662 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51a704f-4b62-4545-aeba-ce2b0458aa20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:04.518217 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51a704f-4b62-4545-aeba-ce2b0458aa20 service cinder] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:04.538991 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 823/1641] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:50:04 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:50:04.538991 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67917152-636d-4a8f-8300-71ccac64d8fe None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:04.538991 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67917152-636d-4a8f-8300-71ccac64d8fe None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:04.538991 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67917152-636d-4a8f-8300-71ccac64d8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:04.584355 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 819/1642] 10.222.0.81 () {58 vars in 1059 bytes} [Mon Jul 18 16:50:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:50:04.589237 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e1ca0-49f3-4a64-a7b3-4803f050c53e None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:04.589544 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e1ca0-49f3-4a64-a7b3-4803f050c53e None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:04.589865 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e1ca0-49f3-4a64-a7b3-4803f050c53e None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:04.606635 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 820/1643] 10.222.0.81 () {54 vars in 912 bytes} [Mon Jul 18 16:50:04 2022] GET /identity => generated 270 bytes in 22 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:50:04.616361 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-67917152-636d-4a8f-8300-71ccac64d8fe None None] MFA Rules not processed for user `36472eacb10144169ae235bf13d78f92`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:04.618122 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-67917152-636d-4a8f-8300-71ccac64d8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:04.630043 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7308453-6e88-431f-88bd-c6faef9a8496 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:04.630403 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7308453-6e88-431f-88bd-c6faef9a8496 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:04.630663 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7308453-6e88-431f-88bd-c6faef9a8496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:04.666671 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-f7308453-6e88-431f-88bd-c6faef9a8496 None None] MFA Rules not processed for user `07f0c5bf1bee48a0bafdf7a9e4537c70`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:04.669272 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-f7308453-6e88-431f-88bd-c6faef9a8496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:04.689294 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 821/1644] 10.222.0.81 () {58 vars in 1009 bytes} [Mon Jul 18 16:50:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:50:04.755540 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7308453-6e88-431f-88bd-c6faef9a8496 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:04.777218 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7308453-6e88-431f-88bd-c6faef9a8496 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:04.782677 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 824/1645] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:50:04 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:50:04.789321 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fca0bd5-f572-4c83-974f-90b003f67727 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:04.790314 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca0bd5-f572-4c83-974f-90b003f67727 service cinder] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:04.792558 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca0bd5-f572-4c83-974f-90b003f67727 service cinder] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:04.792937 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca0bd5-f572-4c83-974f-90b003f67727 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:04.814532 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fca0bd5-f572-4c83-974f-90b003f67727 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:04.816061 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fca0bd5-f572-4c83-974f-90b003f67727 service cinder] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:04.843785 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 822/1646] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:50:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 16:50:04.952086 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67917152-636d-4a8f-8300-71ccac64d8fe None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:04.956403 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fca0bd5-f572-4c83-974f-90b003f67727 service cinder] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:04.968328 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fca0bd5-f572-4c83-974f-90b003f67727 service cinder] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:04.977142 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67917152-636d-4a8f-8300-71ccac64d8fe None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:04.984073 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b98058-2daf-43db-a44e-f7e443b52d1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:04.986419 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b98058-2daf-43db-a44e-f7e443b52d1a service cinder] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:04.987070 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b98058-2daf-43db-a44e-f7e443b52d1a service cinder] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:04.987557 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b98058-2daf-43db-a44e-f7e443b52d1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:04.988535 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0e83a6-1f1a-436a-b8d6-e4f1036c3c3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:04.989991 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e83a6-1f1a-436a-b8d6-e4f1036c3c3d service cinder] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:04.990283 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e83a6-1f1a-436a-b8d6-e4f1036c3c3d service cinder] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:04.990664 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e83a6-1f1a-436a-b8d6-e4f1036c3c3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:05.018148 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b98058-2daf-43db-a44e-f7e443b52d1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:05.021398 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b98058-2daf-43db-a44e-f7e443b52d1a service cinder] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:05.058377 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 823/1647] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:50:04 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:50:05.069615 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690b4bbb-8198-4032-81b4-eefb938e4766 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:05.069892 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690b4bbb-8198-4032-81b4-eefb938e4766 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:05.070194 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690b4bbb-8198-4032-81b4-eefb938e4766 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:05.072042 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 824/1648] 10.222.0.81 () {54 vars in 912 bytes} [Mon Jul 18 16:50:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:50:05.081969 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee7b52-acfd-4f0c-be73-d96dd6e61e60 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:05.082268 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee7b52-acfd-4f0c-be73-d96dd6e61e60 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:05.082525 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee7b52-acfd-4f0c-be73-d96dd6e61e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:05.102085 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0e83a6-1f1a-436a-b8d6-e4f1036c3c3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:05.103705 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0e83a6-1f1a-436a-b8d6-e4f1036c3c3d service cinder] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:05.117900 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 825/1649] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:50:04 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:50:05.150143 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-ffee7b52-acfd-4f0c-be73-d96dd6e61e60 None None] MFA Rules not processed for user `07f0c5bf1bee48a0bafdf7a9e4537c70`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:05.154031 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-ffee7b52-acfd-4f0c-be73-d96dd6e61e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:05.173560 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 825/1650] 10.222.0.81 () {58 vars in 1009 bytes} [Mon Jul 18 16:50:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:50:05.458659 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0e83a6-1f1a-436a-b8d6-e4f1036c3c3d service cinder] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:05.522575 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0e83a6-1f1a-436a-b8d6-e4f1036c3c3d service cinder] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:05.537613 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1779fe7-cc54-4866-821a-2ca1834ecc04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:05.540224 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1779fe7-cc54-4866-821a-2ca1834ecc04 service cinder] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:05.540515 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1779fe7-cc54-4866-821a-2ca1834ecc04 service cinder] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:05.540799 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1779fe7-cc54-4866-821a-2ca1834ecc04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:05.569765 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1779fe7-cc54-4866-821a-2ca1834ecc04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:05.571269 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1779fe7-cc54-4866-821a-2ca1834ecc04 service cinder] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:05.601561 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 826/1651] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:50:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:50:06.161537 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee7b52-acfd-4f0c-be73-d96dd6e61e60 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:06.300737 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee7b52-acfd-4f0c-be73-d96dd6e61e60 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:06.321529 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd3e358-ab28-4dff-8850-fe5035303a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:06.324995 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd3e358-ab28-4dff-8850-fe5035303a50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:06.324995 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd3e358-ab28-4dff-8850-fe5035303a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:06.324995 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd3e358-ab28-4dff-8850-fe5035303a50 admin admin] PATH_INFO: `/v3/users/007fe8955e1149dea44d5a85b6b94299` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:06.332534 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd3e358-ab28-4dff-8850-fe5035303a50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=007fe8955e1149dea44d5a85b6b94299)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:06.337431 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd3e358-ab28-4dff-8850-fe5035303a50 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:06.347261 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:06.619420 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:06.646986 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-ccd3e358-ab28-4dff-8850-fe5035303a50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '007fe8955e1149dea44d5a85b6b94299'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:06.687090 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-ccd3e358-ab28-4dff-8850-fe5035303a50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '007fe8955e1149dea44d5a85b6b94299'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:06.688844 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-ccd3e358-ab28-4dff-8850-fe5035303a50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '007fe8955e1149dea44d5a85b6b94299'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:06.712737 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-ccd3e358-ab28-4dff-8850-fe5035303a50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '007fe8955e1149dea44d5a85b6b94299'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:06.800643 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-ccd3e358-ab28-4dff-8850-fe5035303a50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '007fe8955e1149dea44d5a85b6b94299'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:06.813561 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 826/1652] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 16:50:06 2022] DELETE /identity/v3/users/007fe8955e1149dea44d5a85b6b94299 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:50:06.815655 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f616196e-21b4-44e7-b06e-789642091568 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:06.816071 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f616196e-21b4-44e7-b06e-789642091568 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:06.816361 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f616196e-21b4-44e7-b06e-789642091568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:06.881914 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-f616196e-21b4-44e7-b06e-789642091568 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:06.883604 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-f616196e-21b4-44e7-b06e-789642091568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:07.072387 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 827/1653] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:50:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:50:07.113763 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd3e358-ab28-4dff-8850-fe5035303a50 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:07.115275 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-ccd3e358-ab28-4dff-8850-fe5035303a50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:07.273997 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd3e358-ab28-4dff-8850-fe5035303a50 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:07.286729 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd819344-fe59-43e9-8431-8eacec3abfd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:07.287430 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd819344-fe59-43e9-8431-8eacec3abfd7 service neutron] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:07.287739 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd819344-fe59-43e9-8431-8eacec3abfd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:07.288043 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd819344-fe59-43e9-8431-8eacec3abfd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:07.306915 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:07.314547 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f616196e-21b4-44e7-b06e-789642091568 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:07.316274 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-f616196e-21b4-44e7-b06e-789642091568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:07.332042 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd819344-fe59-43e9-8431-8eacec3abfd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:07.336592 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd819344-fe59-43e9-8431-8eacec3abfd7 service neutron] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:07.340530 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f616196e-21b4-44e7-b06e-789642091568 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:07.358386 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5653af-6507-4333-85a9-04fb665f1e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:07.362506 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5653af-6507-4333-85a9-04fb665f1e1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:07.362813 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5653af-6507-4333-85a9-04fb665f1e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:07.363113 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5653af-6507-4333-85a9-04fb665f1e1a admin admin] PATH_INFO: `/v3/users/f8a784ca4d3048139ea6111118853e3e` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:07.370177 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5653af-6507-4333-85a9-04fb665f1e1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8a784ca4d3048139ea6111118853e3e)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:07.372827 dv-cinder-846173-3-smb devstack@keystone.service[80545]: WARNING py.warnings [None req-9a5653af-6507-4333-85a9-04fb665f1e1a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 16:50:07.372827 dv-cinder-846173-3-smb devstack@keystone.service[80545]: warnings.warn(msg) Jul 18 16:50:07.372827 dv-cinder-846173-3-smb devstack@keystone.service[80545]: Jul 18 16:50:07.374851 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5653af-6507-4333-85a9-04fb665f1e1a admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:07.375798 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 827/1654] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:50:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:50:07.629835 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:07.703328 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd819344-fe59-43e9-8431-8eacec3abfd7 service neutron] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:07.705070 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-fd819344-fe59-43e9-8431-8eacec3abfd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:07.720287 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd819344-fe59-43e9-8431-8eacec3abfd7 service neutron] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:07.728003 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a981f-4db4-4bc8-a049-aa62153e33fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:07.730827 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a981f-4db4-4bc8-a049-aa62153e33fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:07.731324 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a981f-4db4-4bc8-a049-aa62153e33fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:07.732514 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a981f-4db4-4bc8-a049-aa62153e33fa admin admin] PATH_INFO: `/v3/users/e10e5fd0d1734416b3e28f29a5ffc6ea` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:07.733905 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23a981f-4db4-4bc8-a049-aa62153e33fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=e10e5fd0d1734416b3e28f29a5ffc6ea)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:07.736190 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23a981f-4db4-4bc8-a049-aa62153e33fa admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:07.901304 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-9a5653af-6507-4333-85a9-04fb665f1e1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8a784ca4d3048139ea6111118853e3e'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:07.904478 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-9a5653af-6507-4333-85a9-04fb665f1e1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8a784ca4d3048139ea6111118853e3e'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:07.934702 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-9a5653af-6507-4333-85a9-04fb665f1e1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8a784ca4d3048139ea6111118853e3e'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:08.000881 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-f23a981f-4db4-4bc8-a049-aa62153e33fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e10e5fd0d1734416b3e28f29a5ffc6ea'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:08.019991 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-f23a981f-4db4-4bc8-a049-aa62153e33fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e10e5fd0d1734416b3e28f29a5ffc6ea'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:08.020812 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-f23a981f-4db4-4bc8-a049-aa62153e33fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e10e5fd0d1734416b3e28f29a5ffc6ea'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:08.020961 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-9a5653af-6507-4333-85a9-04fb665f1e1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8a784ca4d3048139ea6111118853e3e'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:08.031295 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-f23a981f-4db4-4bc8-a049-aa62153e33fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e10e5fd0d1734416b3e28f29a5ffc6ea'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:08.038147 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-9a5653af-6507-4333-85a9-04fb665f1e1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8a784ca4d3048139ea6111118853e3e'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:08.053461 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 828/1655] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 16:50:07 2022] DELETE /identity/v3/users/f8a784ca4d3048139ea6111118853e3e => generated 0 bytes in 737 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:50:08.055989 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f74fd-fe07-4323-b798-40352161454e None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:08.056497 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f74fd-fe07-4323-b798-40352161454e None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:08.057599 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f74fd-fe07-4323-b798-40352161454e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:08.118620 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-f23a981f-4db4-4bc8-a049-aa62153e33fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e10e5fd0d1734416b3e28f29a5ffc6ea'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:08.122292 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-6b2f74fd-fe07-4323-b798-40352161454e None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:08.123611 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-6b2f74fd-fe07-4323-b798-40352161454e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:08.144754 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 828/1656] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 16:50:07 2022] DELETE /identity/v3/users/e10e5fd0d1734416b3e28f29a5ffc6ea => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:50:08.153412 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d789ca15-cbaf-4837-97a2-e0144bca861a None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:08.153756 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d789ca15-cbaf-4837-97a2-e0144bca861a None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:08.154044 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d789ca15-cbaf-4837-97a2-e0144bca861a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:08.187635 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-d789ca15-cbaf-4837-97a2-e0144bca861a None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:08.190505 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-d789ca15-cbaf-4837-97a2-e0144bca861a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:08.287184 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 829/1657] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:50:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:50:08.323018 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f74fd-fe07-4323-b798-40352161454e None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:08.324613 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-6b2f74fd-fe07-4323-b798-40352161454e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:08.403458 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 829/1658] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:50:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:50:08.424109 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d789ca15-cbaf-4837-97a2-e0144bca861a None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:08.429086 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-d789ca15-cbaf-4837-97a2-e0144bca861a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:08.529374 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f74fd-fe07-4323-b798-40352161454e None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:08.645021 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d789ca15-cbaf-4837-97a2-e0144bca861a None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:08.663918 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27243d-3be2-4bd8-a443-3f7888e3175f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:08.663918 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27243d-3be2-4bd8-a443-3f7888e3175f service neutron] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:08.663918 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27243d-3be2-4bd8-a443-3f7888e3175f service neutron] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:08.663918 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27243d-3be2-4bd8-a443-3f7888e3175f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:08.673430 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c60ac-a83b-4ef2-a197-93c9814463c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:08.674803 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c60ac-a83b-4ef2-a197-93c9814463c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:08.675281 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c60ac-a83b-4ef2-a197-93c9814463c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:08.675772 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c60ac-a83b-4ef2-a197-93c9814463c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:08.692510 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4c60ac-a83b-4ef2-a197-93c9814463c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:08.694336 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4c60ac-a83b-4ef2-a197-93c9814463c0 service neutron] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:08.711614 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca27243d-3be2-4bd8-a443-3f7888e3175f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:08.713178 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca27243d-3be2-4bd8-a443-3f7888e3175f service neutron] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:08.717302 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 830/1659] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:50:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:50:08.764952 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 830/1660] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:50:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 16:50:08.854905 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:08.904089 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c60ac-a83b-4ef2-a197-93c9814463c0 service neutron] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:08.906885 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-5b4c60ac-a83b-4ef2-a197-93c9814463c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:08.937664 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c60ac-a83b-4ef2-a197-93c9814463c0 service neutron] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:08.941607 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:08.974337 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ef0e1f-6d3a-49a6-b5fe-5c6c853417fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:08.975465 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef0e1f-6d3a-49a6-b5fe-5c6c853417fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:08.975989 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef0e1f-6d3a-49a6-b5fe-5c6c853417fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:08.976401 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef0e1f-6d3a-49a6-b5fe-5c6c853417fc admin admin] PATH_INFO: `/v3/projects/5e08d023867c466f880d0d68e5cb3ea3` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:08.978043 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ef0e1f-6d3a-49a6-b5fe-5c6c853417fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e08d023867c466f880d0d68e5cb3ea3)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:08.980247 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ef0e1f-6d3a-49a6-b5fe-5c6c853417fc admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:09.336012 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-72ef0e1f-6d3a-49a6-b5fe-5c6c853417fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e08d023867c466f880d0d68e5cb3ea3', 'request_id': 'req-72ef0e1f-6d3a-49a6-b5fe-5c6c853417fc'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:09.409071 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-72ef0e1f-6d3a-49a6-b5fe-5c6c853417fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e08d023867c466f880d0d68e5cb3ea3', 'request_id': 'req-72ef0e1f-6d3a-49a6-b5fe-5c6c853417fc'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:09.417414 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-72ef0e1f-6d3a-49a6-b5fe-5c6c853417fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e08d023867c466f880d0d68e5cb3ea3', 'request_id': 'req-72ef0e1f-6d3a-49a6-b5fe-5c6c853417fc'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:09.453144 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-72ef0e1f-6d3a-49a6-b5fe-5c6c853417fc admin admin] The token cache is being invalidate because project 5e08d023867c466f880d0d68e5cb3ea3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:50:09.453144 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-72ef0e1f-6d3a-49a6-b5fe-5c6c853417fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:09.453144 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-72ef0e1f-6d3a-49a6-b5fe-5c6c853417fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:09.453450 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 831/1661] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 16:50:08 2022] DELETE /identity/v3/projects/5e08d023867c466f880d0d68e5cb3ea3 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:50:09.461531 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79128715-b4c6-4428-acb0-4f1e0acaa985 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:09.463465 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79128715-b4c6-4428-acb0-4f1e0acaa985 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:09.463930 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79128715-b4c6-4428-acb0-4f1e0acaa985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:09.524174 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-79128715-b4c6-4428-acb0-4f1e0acaa985 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:09.526499 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-79128715-b4c6-4428-acb0-4f1e0acaa985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:09.788529 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:09.839926 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 831/1662] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:50:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:50:09.849947 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bfa079-a563-48a9-b5f4-5d8f2c909508 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:09.850233 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bfa079-a563-48a9-b5f4-5d8f2c909508 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:09.850507 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bfa079-a563-48a9-b5f4-5d8f2c909508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:09.901055 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-a0bfa079-a563-48a9-b5f4-5d8f2c909508 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:09.903375 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-a0bfa079-a563-48a9-b5f4-5d8f2c909508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:09.932988 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 832/1663] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:50:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:50:09.935886 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79128715-b4c6-4428-acb0-4f1e0acaa985 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:09.951184 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79128715-b4c6-4428-acb0-4f1e0acaa985 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:09.959696 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1795c52a-9bbb-44bf-a937-cc4929f28a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:09.960746 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1795c52a-9bbb-44bf-a937-cc4929f28a73 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:09.961364 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1795c52a-9bbb-44bf-a937-cc4929f28a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:09.961864 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1795c52a-9bbb-44bf-a937-cc4929f28a73 admin admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:09.963876 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1795c52a-9bbb-44bf-a937-cc4929f28a73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:50:09.964358 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1795c52a-9bbb-44bf-a937-cc4929f28a73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:09.972311 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1795c52a-9bbb-44bf-a937-cc4929f28a73 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:09.990388 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 832/1664] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Jul 18 16:50:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:50:09.995349 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bfa079-a563-48a9-b5f4-5d8f2c909508 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:10.010603 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bfa079-a563-48a9-b5f4-5d8f2c909508 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:10.022045 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f9ca9-feb3-44db-9f1a-2c6a49a457cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:10.022676 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f9ca9-feb3-44db-9f1a-2c6a49a457cd admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:10.028850 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f9ca9-feb3-44db-9f1a-2c6a49a457cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:10.029679 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f9ca9-feb3-44db-9f1a-2c6a49a457cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:10.031090 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94f9ca9-feb3-44db-9f1a-2c6a49a457cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:10.037162 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94f9ca9-feb3-44db-9f1a-2c6a49a457cd admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:10.290061 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 833/1665] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:50:09 2022] POST /identity/v3/projects => generated 355 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:50:10.294873 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1795c52a-9bbb-44bf-a937-cc4929f28a73 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:10.315142 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1795c52a-9bbb-44bf-a937-cc4929f28a73 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:10.544301 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b095cd8f-b0a1-4d35-a8b3-0958b78ced1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:10.544996 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095cd8f-b0a1-4d35-a8b3-0958b78ced1a admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:10.545276 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095cd8f-b0a1-4d35-a8b3-0958b78ced1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:10.545556 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095cd8f-b0a1-4d35-a8b3-0958b78ced1a admin admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:10.546271 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b095cd8f-b0a1-4d35-a8b3-0958b78ced1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:10.551066 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b095cd8f-b0a1-4d35-a8b3-0958b78ced1a admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:10.666024 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 833/1666] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 16:50:10 2022] POST /identity/v3/users => generated 278 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:50:10.667016 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f9ca9-feb3-44db-9f1a-2c6a49a457cd admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:10.684301 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f9ca9-feb3-44db-9f1a-2c6a49a457cd admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:10.706358 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e2820-7e2c-4992-af18-314b09dea0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:10.707401 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e2820-7e2c-4992-af18-314b09dea0e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:10.707940 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e2820-7e2c-4992-af18-314b09dea0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:10.708450 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e2820-7e2c-4992-af18-314b09dea0e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:10.709443 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737e2820-7e2c-4992-af18-314b09dea0e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:10.711458 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737e2820-7e2c-4992-af18-314b09dea0e1 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:10.735783 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 834/1667] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:50:10.745110 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b095cd8f-b0a1-4d35-a8b3-0958b78ced1a admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:10.781924 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b095cd8f-b0a1-4d35-a8b3-0958b78ced1a admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:10.788220 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d173941-1726-4cff-9208-efaf87458553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:10.788936 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d173941-1726-4cff-9208-efaf87458553 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:10.789562 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d173941-1726-4cff-9208-efaf87458553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:10.790002 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d173941-1726-4cff-9208-efaf87458553 admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:10.790935 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d173941-1726-4cff-9208-efaf87458553 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:10.793658 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d173941-1726-4cff-9208-efaf87458553 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:10.824193 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 834/1668] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:50:10.824841 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e2820-7e2c-4992-af18-314b09dea0e1 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:10.859654 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e2820-7e2c-4992-af18-314b09dea0e1 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:10.868067 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b601947c-a78b-4319-adc2-265413842e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:10.868952 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601947c-a78b-4319-adc2-265413842e41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:10.869235 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601947c-a78b-4319-adc2-265413842e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:10.870079 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601947c-a78b-4319-adc2-265413842e41 admin admin] PATH_INFO: `/v3/projects/4f1a1a20d4a8420eaa48d6d3b50dcd30/users/50eadc00829142d58d10d0e65c2bb812/roles/ad3a2bc7b2094a4da1a95a143c8d9436` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:10.922166 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b601947c-a78b-4319-adc2-265413842e41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f1a1a20d4a8420eaa48d6d3b50dcd30, user_id=50eadc00829142d58d10d0e65c2bb812, role_id=ad3a2bc7b2094a4da1a95a143c8d9436)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:10.935597 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b601947c-a78b-4319-adc2-265413842e41 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:11.206135 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d173941-1726-4cff-9208-efaf87458553 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:11.208077 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-8d173941-1726-4cff-9208-efaf87458553 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:11.234959 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d173941-1726-4cff-9208-efaf87458553 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:11.240144 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37979c82-383d-4567-bff7-183c7a31ccac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:11.241042 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37979c82-383d-4567-bff7-183c7a31ccac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:11.241328 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37979c82-383d-4567-bff7-183c7a31ccac admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:11.241607 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37979c82-383d-4567-bff7-183c7a31ccac admin admin] PATH_INFO: `/v3/projects/733bea5a64d24b53a95038a0d535f7bc` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:11.256215 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37979c82-383d-4567-bff7-183c7a31ccac admin admin] RBAC: Authorizing `identity:delete_project(project_id=733bea5a64d24b53a95038a0d535f7bc)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:11.256215 dv-cinder-846173-3-smb devstack@keystone.service[80544]: WARNING py.warnings [None req-37979c82-383d-4567-bff7-183c7a31ccac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 16:50:11.256215 dv-cinder-846173-3-smb devstack@keystone.service[80544]: warnings.warn(msg) Jul 18 16:50:11.256215 dv-cinder-846173-3-smb devstack@keystone.service[80544]: Jul 18 16:50:11.256215 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37979c82-383d-4567-bff7-183c7a31ccac admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:11.288036 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 835/1669] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:50:10 2022] PUT /identity/v3/projects/4f1a1a20d4a8420eaa48d6d3b50dcd30/users/50eadc00829142d58d10d0e65c2bb812/roles/ad3a2bc7b2094a4da1a95a143c8d9436 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:50:11.303624 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ba142-a9b1-404c-8a63-32ec88d7e7c7 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:11.303975 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ba142-a9b1-404c-8a63-32ec88d7e7c7 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:11.304266 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ba142-a9b1-404c-8a63-32ec88d7e7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:11.356148 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:11.376114 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-0a4ba142-a9b1-404c-8a63-32ec88d7e7c7 None None] MFA Rules not processed for user `50eadc00829142d58d10d0e65c2bb812`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:11.377621 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-0a4ba142-a9b1-404c-8a63-32ec88d7e7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:11.520633 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-37979c82-383d-4567-bff7-183c7a31ccac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '733bea5a64d24b53a95038a0d535f7bc', 'request_id': 'req-37979c82-383d-4567-bff7-183c7a31ccac'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:11.543706 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-37979c82-383d-4567-bff7-183c7a31ccac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '733bea5a64d24b53a95038a0d535f7bc', 'request_id': 'req-37979c82-383d-4567-bff7-183c7a31ccac'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:11.596681 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-37979c82-383d-4567-bff7-183c7a31ccac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '733bea5a64d24b53a95038a0d535f7bc', 'request_id': 'req-37979c82-383d-4567-bff7-183c7a31ccac'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:11.655765 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 836/1670] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:50:11 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:50:11.657194 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4ba142-a9b1-404c-8a63-32ec88d7e7c7 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:11.659864 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-0a4ba142-a9b1-404c-8a63-32ec88d7e7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:11.698725 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-37979c82-383d-4567-bff7-183c7a31ccac admin admin] The token cache is being invalidate because project 733bea5a64d24b53a95038a0d535f7bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:50:11.699176 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-37979c82-383d-4567-bff7-183c7a31ccac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:11.704257 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-37979c82-383d-4567-bff7-183c7a31ccac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:11.714137 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 835/1671] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 16:50:11 2022] DELETE /identity/v3/projects/733bea5a64d24b53a95038a0d535f7bc => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:50:11.715559 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37979c82-383d-4567-bff7-183c7a31ccac admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:11.728110 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-37979c82-383d-4567-bff7-183c7a31ccac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:11.790654 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4ba142-a9b1-404c-8a63-32ec88d7e7c7 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:11.918757 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37979c82-383d-4567-bff7-183c7a31ccac admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:11.926722 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1552604f-967b-4705-95fd-79be1935634c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:11.929419 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552604f-967b-4705-95fd-79be1935634c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:11.929912 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552604f-967b-4705-95fd-79be1935634c admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:11.930333 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552604f-967b-4705-95fd-79be1935634c admin admin] PATH_INFO: `/v3/users/ee174b41048044878d4989322a226d49` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:11.932067 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1552604f-967b-4705-95fd-79be1935634c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee174b41048044878d4989322a226d49)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:11.935111 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1552604f-967b-4705-95fd-79be1935634c admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:11.990038 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7155a-6798-4f65-a71c-019f55733b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:11.990964 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7155a-6798-4f65-a71c-019f55733b52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:11.991414 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7155a-6798-4f65-a71c-019f55733b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:11.991860 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7155a-6798-4f65-a71c-019f55733b52 admin admin] PATH_INFO: `/v3/projects/9ad0385007b248f99e23e7a98282a626` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:11.993601 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f7155a-6798-4f65-a71c-019f55733b52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ad0385007b248f99e23e7a98282a626)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:11.997166 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f7155a-6798-4f65-a71c-019f55733b52 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:12.207035 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-1552604f-967b-4705-95fd-79be1935634c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee174b41048044878d4989322a226d49'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:12.226138 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-d9f7155a-6798-4f65-a71c-019f55733b52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ad0385007b248f99e23e7a98282a626', 'request_id': 'req-d9f7155a-6798-4f65-a71c-019f55733b52'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:12.236449 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-1552604f-967b-4705-95fd-79be1935634c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee174b41048044878d4989322a226d49'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:12.237437 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-1552604f-967b-4705-95fd-79be1935634c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee174b41048044878d4989322a226d49'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:12.256386 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-1552604f-967b-4705-95fd-79be1935634c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee174b41048044878d4989322a226d49'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:12.346330 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-d9f7155a-6798-4f65-a71c-019f55733b52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ad0385007b248f99e23e7a98282a626', 'request_id': 'req-d9f7155a-6798-4f65-a71c-019f55733b52'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:12.367814 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-d9f7155a-6798-4f65-a71c-019f55733b52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ad0385007b248f99e23e7a98282a626', 'request_id': 'req-d9f7155a-6798-4f65-a71c-019f55733b52'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:12.387054 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-d9f7155a-6798-4f65-a71c-019f55733b52 admin admin] The token cache is being invalidate because project 9ad0385007b248f99e23e7a98282a626 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:50:12.387573 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-d9f7155a-6798-4f65-a71c-019f55733b52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:12.388474 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-d9f7155a-6798-4f65-a71c-019f55733b52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:12.390598 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 837/1672] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 16:50:11 2022] DELETE /identity/v3/projects/9ad0385007b248f99e23e7a98282a626 => generated 0 bytes in 734 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:50:12.391537 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7155a-6798-4f65-a71c-019f55733b52 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:12.393544 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-d9f7155a-6798-4f65-a71c-019f55733b52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:12.476902 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7155a-6798-4f65-a71c-019f55733b52 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:12.486522 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00883d0-6873-4c42-a4c5-66211f094439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:12.486522 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00883d0-6873-4c42-a4c5-66211f094439 admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:12.486821 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00883d0-6873-4c42-a4c5-66211f094439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:12.487148 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00883d0-6873-4c42-a4c5-66211f094439 admin admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:12.490345 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00883d0-6873-4c42-a4c5-66211f094439 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:12.497515 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00883d0-6873-4c42-a4c5-66211f094439 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:12.498660 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-1552604f-967b-4705-95fd-79be1935634c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee174b41048044878d4989322a226d49'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:12.512999 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:12.534345 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 836/1673] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 16:50:11 2022] DELETE /identity/v3/users/ee174b41048044878d4989322a226d49 => generated 0 bytes in 818 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:50:12.539315 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1552604f-967b-4705-95fd-79be1935634c admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:12.552542 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-1552604f-967b-4705-95fd-79be1935634c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:12.669028 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 838/1674] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:50:12 2022] POST /identity/v3/projects => generated 357 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:50:12.669028 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91780e-db47-4beb-8fea-ba9ab81aeb42 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:12.669028 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91780e-db47-4beb-8fea-ba9ab81aeb42 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:12.672174 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91780e-db47-4beb-8fea-ba9ab81aeb42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:12.716072 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1552604f-967b-4705-95fd-79be1935634c admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:12.733903 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-7f91780e-db47-4beb-8fea-ba9ab81aeb42 None None] MFA Rules not processed for user `0f292cde7f7142f08e961a3d20d76b31`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:12.735256 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-7f91780e-db47-4beb-8fea-ba9ab81aeb42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:12.862538 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:12.899480 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 839/1675] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:50:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:50:12.899480 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f91780e-db47-4beb-8fea-ba9ab81aeb42 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:12.899480 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-7f91780e-db47-4beb-8fea-ba9ab81aeb42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:12.929009 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f399da0-4ed1-4589-820a-24d7001c8df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:12.929916 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f399da0-4ed1-4589-820a-24d7001c8df6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:12.930190 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f399da0-4ed1-4589-820a-24d7001c8df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:12.930556 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f399da0-4ed1-4589-820a-24d7001c8df6 admin admin] PATH_INFO: `/v3/users/36472eacb10144169ae235bf13d78f92` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:12.933308 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f399da0-4ed1-4589-820a-24d7001c8df6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36472eacb10144169ae235bf13d78f92)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:12.935299 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f399da0-4ed1-4589-820a-24d7001c8df6 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:13.023748 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f91780e-db47-4beb-8fea-ba9ab81aeb42 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:13.032734 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5447d2a4-c435-4426-8ea8-369cfba77cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:13.033780 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447d2a4-c435-4426-8ea8-369cfba77cbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:13.034126 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447d2a4-c435-4426-8ea8-369cfba77cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:13.034417 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447d2a4-c435-4426-8ea8-369cfba77cbf admin admin] PATH_INFO: `/v3/users/268ba628e84b40bf8927cc810909302b` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:13.035910 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5447d2a4-c435-4426-8ea8-369cfba77cbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=268ba628e84b40bf8927cc810909302b)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:13.038586 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5447d2a4-c435-4426-8ea8-369cfba77cbf admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:13.121823 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-2f399da0-4ed1-4589-820a-24d7001c8df6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36472eacb10144169ae235bf13d78f92'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:13.155693 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-2f399da0-4ed1-4589-820a-24d7001c8df6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36472eacb10144169ae235bf13d78f92'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:13.161517 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-2f399da0-4ed1-4589-820a-24d7001c8df6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36472eacb10144169ae235bf13d78f92'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:13.181973 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-2f399da0-4ed1-4589-820a-24d7001c8df6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36472eacb10144169ae235bf13d78f92'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:13.289186 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-5447d2a4-c435-4426-8ea8-369cfba77cbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '268ba628e84b40bf8927cc810909302b'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:13.291012 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-5447d2a4-c435-4426-8ea8-369cfba77cbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '268ba628e84b40bf8927cc810909302b'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:13.295229 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-2f399da0-4ed1-4589-820a-24d7001c8df6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36472eacb10144169ae235bf13d78f92'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:13.305816 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 837/1676] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 16:50:12 2022] DELETE /identity/v3/users/36472eacb10144169ae235bf13d78f92 => generated 0 bytes in 770 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:50:13.307558 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46888442-5842-4083-9151-4c27ad80083f None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:13.307890 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46888442-5842-4083-9151-4c27ad80083f None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:13.308148 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46888442-5842-4083-9151-4c27ad80083f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:13.328234 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-5447d2a4-c435-4426-8ea8-369cfba77cbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '268ba628e84b40bf8927cc810909302b'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:13.360819 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-46888442-5842-4083-9151-4c27ad80083f None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:13.370591 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-46888442-5842-4083-9151-4c27ad80083f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:13.449913 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-5447d2a4-c435-4426-8ea8-369cfba77cbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '268ba628e84b40bf8927cc810909302b'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:13.462309 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-5447d2a4-c435-4426-8ea8-369cfba77cbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '268ba628e84b40bf8927cc810909302b'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:13.488026 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 840/1677] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 16:50:12 2022] DELETE /identity/v3/users/268ba628e84b40bf8927cc810909302b => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:50:13.488026 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5447d2a4-c435-4426-8ea8-369cfba77cbf admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:13.488026 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-5447d2a4-c435-4426-8ea8-369cfba77cbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:13.568096 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 838/1678] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:50:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:50:13.573625 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3262fe45-57ad-415d-b25c-d230fa244219 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:13.574094 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3262fe45-57ad-415d-b25c-d230fa244219 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:13.574451 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3262fe45-57ad-415d-b25c-d230fa244219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:13.624839 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-3262fe45-57ad-415d-b25c-d230fa244219 None None] MFA Rules not processed for user `0f292cde7f7142f08e961a3d20d76b31`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:13.626359 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-3262fe45-57ad-415d-b25c-d230fa244219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:13.677932 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5447d2a4-c435-4426-8ea8-369cfba77cbf admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:13.693909 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ff09a-a012-4675-9f19-9289cfa690c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:13.694618 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ff09a-a012-4675-9f19-9289cfa690c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:13.695043 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ff09a-a012-4675-9f19-9289cfa690c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:13.695330 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ff09a-a012-4675-9f19-9289cfa690c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:13.696060 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9ff09a-a012-4675-9f19-9289cfa690c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:13.698692 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9ff09a-a012-4675-9f19-9289cfa690c6 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:13.761409 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 839/1679] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:50:13 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:50:13.763071 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3262fe45-57ad-415d-b25c-d230fa244219 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:13.766068 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-3262fe45-57ad-415d-b25c-d230fa244219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:13.838143 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 841/1680] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 16:50:13 2022] POST /identity/v3/users => generated 285 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:50:13.841252 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ff09a-a012-4675-9f19-9289cfa690c6 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:13.849912 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-dd9ff09a-a012-4675-9f19-9289cfa690c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:13.915840 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3262fe45-57ad-415d-b25c-d230fa244219 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:13.921470 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbcb4c0-19f3-4ef6-b6a1-c1e1c5459a9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:13.922970 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbcb4c0-19f3-4ef6-b6a1-c1e1c5459a9f service neutron] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:13.923396 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbcb4c0-19f3-4ef6-b6a1-c1e1c5459a9f service neutron] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:13.923785 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbcb4c0-19f3-4ef6-b6a1-c1e1c5459a9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:13.940361 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbcb4c0-19f3-4ef6-b6a1-c1e1c5459a9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:13.946618 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbcb4c0-19f3-4ef6-b6a1-c1e1c5459a9f service neutron] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:13.991289 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 840/1681] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:50:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:50:13.992472 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbcb4c0-19f3-4ef6-b6a1-c1e1c5459a9f service neutron] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:14.028131 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbcb4c0-19f3-4ef6-b6a1-c1e1c5459a9f service neutron] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:14.041155 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51776b14-5501-412c-8f73-f583e6001f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:14.042336 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51776b14-5501-412c-8f73-f583e6001f41 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:14.042719 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51776b14-5501-412c-8f73-f583e6001f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:14.043101 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51776b14-5501-412c-8f73-f583e6001f41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:14.043965 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51776b14-5501-412c-8f73-f583e6001f41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:14.046961 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51776b14-5501-412c-8f73-f583e6001f41 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:14.069538 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 841/1682] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:50:14.070666 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51776b14-5501-412c-8f73-f583e6001f41 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:14.083115 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51776b14-5501-412c-8f73-f583e6001f41 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:14.212616 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ff09a-a012-4675-9f19-9289cfa690c6 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:14.213801 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60d4d1-1fd3-4c36-8bb1-d5f1905289b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:14.213801 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60d4d1-1fd3-4c36-8bb1-d5f1905289b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:14.213801 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60d4d1-1fd3-4c36-8bb1-d5f1905289b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:14.213801 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60d4d1-1fd3-4c36-8bb1-d5f1905289b5 admin admin] PATH_INFO: `/v3/projects/d8515b5ade7d4e289c576a4cd2a451a6/users/3188e9dd12cc4c7db9e3a6fe011c1a09/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:14.214402 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a822d20d-bc73-4eaa-81fd-03cee3c2266f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07f0c5bf1bee48a0bafdf7a9e4537c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:14.214402 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822d20d-bc73-4eaa-81fd-03cee3c2266f service nova] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:14.214402 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822d20d-bc73-4eaa-81fd-03cee3c2266f service nova] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:14.214402 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822d20d-bc73-4eaa-81fd-03cee3c2266f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:14.214891 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-a822d20d-bc73-4eaa-81fd-03cee3c2266f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:14.214891 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a822d20d-bc73-4eaa-81fd-03cee3c2266f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:14.214891 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a822d20d-bc73-4eaa-81fd-03cee3c2266f service nova] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:14.215056 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef60d4d1-1fd3-4c36-8bb1-d5f1905289b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8515b5ade7d4e289c576a4cd2a451a6, user_id=3188e9dd12cc4c7db9e3a6fe011c1a09, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:14.215056 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef60d4d1-1fd3-4c36-8bb1-d5f1905289b5 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:14.215177 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 842/1683] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:50:13 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:50:14.436359 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:14.476218 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 842/1684] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:50:14 2022] PUT /identity/v3/projects/d8515b5ade7d4e289c576a4cd2a451a6/users/3188e9dd12cc4c7db9e3a6fe011c1a09/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:50:14.479022 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a822d20d-bc73-4eaa-81fd-03cee3c2266f service nova] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:14.507312 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a822d20d-bc73-4eaa-81fd-03cee3c2266f service nova] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:14.527463 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:14.658860 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6db5b7-57b6-4e44-badc-43ef8fdd643f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:14.659755 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6db5b7-57b6-4e44-badc-43ef8fdd643f admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:14.660142 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6db5b7-57b6-4e44-badc-43ef8fdd643f admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:14.660591 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6db5b7-57b6-4e44-badc-43ef8fdd643f admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:14.661510 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6db5b7-57b6-4e44-badc-43ef8fdd643f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:14.667877 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6db5b7-57b6-4e44-badc-43ef8fdd643f admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:14.693482 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 843/1685] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:50:14.696249 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60d4d1-1fd3-4c36-8bb1-d5f1905289b5 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:14.720383 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60d4d1-1fd3-4c36-8bb1-d5f1905289b5 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:14.739634 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce9910d-5ebd-4c79-94f7-914901e7c8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:14.741376 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9910d-5ebd-4c79-94f7-914901e7c8e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:14.741800 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9910d-5ebd-4c79-94f7-914901e7c8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:14.742358 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9910d-5ebd-4c79-94f7-914901e7c8e0 admin admin] PATH_INFO: `/v3/projects/d8515b5ade7d4e289c576a4cd2a451a6/users/3188e9dd12cc4c7db9e3a6fe011c1a09/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:14.774617 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce9910d-5ebd-4c79-94f7-914901e7c8e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8515b5ade7d4e289c576a4cd2a451a6, user_id=3188e9dd12cc4c7db9e3a6fe011c1a09, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:14.781257 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6db5b7-57b6-4e44-badc-43ef8fdd643f admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:14.781385 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce9910d-5ebd-4c79-94f7-914901e7c8e0 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:14.783275 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-be6db5b7-57b6-4e44-badc-43ef8fdd643f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:14.814361 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6db5b7-57b6-4e44-badc-43ef8fdd643f admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:14.835956 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 843/1686] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:50:14 2022] PUT /identity/v3/projects/d8515b5ade7d4e289c576a4cd2a451a6/users/3188e9dd12cc4c7db9e3a6fe011c1a09/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:50:14.843264 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aafaef-27d0-41b2-bb4d-a2a2898b3a4c None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:14.845390 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aafaef-27d0-41b2-bb4d-a2a2898b3a4c None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:14.845390 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aafaef-27d0-41b2-bb4d-a2a2898b3a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:14.938422 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-e9aafaef-27d0-41b2-bb4d-a2a2898b3a4c None None] MFA Rules not processed for user `3188e9dd12cc4c7db9e3a6fe011c1a09`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:14.940461 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-e9aafaef-27d0-41b2-bb4d-a2a2898b3a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:14.961175 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff18199e-7b04-4b91-9394-dee044479658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:14.962313 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff18199e-7b04-4b91-9394-dee044479658 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:14.962791 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff18199e-7b04-4b91-9394-dee044479658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:14.963247 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff18199e-7b04-4b91-9394-dee044479658 admin admin] PATH_INFO: `/v3/projects/5ccf3d71a97b4d12a83cc966c210f7ff` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:14.970539 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff18199e-7b04-4b91-9394-dee044479658 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ccf3d71a97b4d12a83cc966c210f7ff)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:14.972563 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff18199e-7b04-4b91-9394-dee044479658 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:15.118741 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 844/1687] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:50:14 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:50:15.144665 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-ff18199e-7b04-4b91-9394-dee044479658 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ccf3d71a97b4d12a83cc966c210f7ff', 'request_id': 'req-ff18199e-7b04-4b91-9394-dee044479658'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:15.145705 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aafaef-27d0-41b2-bb4d-a2a2898b3a4c None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:15.147466 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-e9aafaef-27d0-41b2-bb4d-a2a2898b3a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:15.238945 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-ff18199e-7b04-4b91-9394-dee044479658 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ccf3d71a97b4d12a83cc966c210f7ff', 'request_id': 'req-ff18199e-7b04-4b91-9394-dee044479658'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:15.257324 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-ff18199e-7b04-4b91-9394-dee044479658 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ccf3d71a97b4d12a83cc966c210f7ff', 'request_id': 'req-ff18199e-7b04-4b91-9394-dee044479658'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:15.308442 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-ff18199e-7b04-4b91-9394-dee044479658 admin admin] The token cache is being invalidate because project 5ccf3d71a97b4d12a83cc966c210f7ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:50:15.308442 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-ff18199e-7b04-4b91-9394-dee044479658 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:15.317793 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-ff18199e-7b04-4b91-9394-dee044479658 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:15.324611 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 844/1688] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 16:50:14 2022] DELETE /identity/v3/projects/5ccf3d71a97b4d12a83cc966c210f7ff => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:50:15.326980 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aafaef-27d0-41b2-bb4d-a2a2898b3a4c None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:15.328763 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6de49-0461-4cb4-9755-d2c37b3ee53d None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:15.328763 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6de49-0461-4cb4-9755-d2c37b3ee53d None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:15.329257 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6de49-0461-4cb4-9755-d2c37b3ee53d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:15.392231 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-f5d6de49-0461-4cb4-9755-d2c37b3ee53d None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:15.394020 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-f5d6de49-0461-4cb4-9755-d2c37b3ee53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:15.469775 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeed64a-c93e-452b-bc66-0e463908dd49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:15.470552 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeed64a-c93e-452b-bc66-0e463908dd49 service cinder] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:15.470845 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeed64a-c93e-452b-bc66-0e463908dd49 service cinder] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:15.471270 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeed64a-c93e-452b-bc66-0e463908dd49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:15.476583 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-aeeed64a-c93e-452b-bc66-0e463908dd49 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:15.576270 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:15.635140 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 845/1689] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:50:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:50:15.637646 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547369d1-1fc8-40ac-90eb-33cf4f053fe7 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:15.639110 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547369d1-1fc8-40ac-90eb-33cf4f053fe7 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:15.639568 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547369d1-1fc8-40ac-90eb-33cf4f053fe7 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:15.647118 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 846/1690] 10.222.0.81 () {54 vars in 912 bytes} [Mon Jul 18 16:50:15 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:50:15.649557 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9afbdf9-72d5-4130-9563-b0e16566fd84 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:15.650068 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9afbdf9-72d5-4130-9563-b0e16566fd84 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:15.651175 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9afbdf9-72d5-4130-9563-b0e16566fd84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:15.669541 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeed64a-c93e-452b-bc66-0e463908dd49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:15.674769 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeed64a-c93e-452b-bc66-0e463908dd49 service cinder] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:15.706659 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 845/1691] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:50:15 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 16:50:15.709345 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8fd78c-5cc7-41e0-8988-ee4a1eae9c98 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:15.710834 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8fd78c-5cc7-41e0-8988-ee4a1eae9c98 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:15.716110 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8fd78c-5cc7-41e0-8988-ee4a1eae9c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:15.721496 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-c9afbdf9-72d5-4130-9563-b0e16566fd84 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:15.723905 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-c9afbdf9-72d5-4130-9563-b0e16566fd84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:15.756098 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 847/1692] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:50:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:50:15.759046 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9afbdf9-72d5-4130-9563-b0e16566fd84 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:15.804135 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9afbdf9-72d5-4130-9563-b0e16566fd84 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:15.811622 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-ba8fd78c-5cc7-41e0-8988-ee4a1eae9c98 None None] MFA Rules not processed for user `b742c540de6545249fe3245047d00c81`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:15.813915 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb1c45-f09d-42c1-ba14-1dca3ddf753d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:15.815222 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb1c45-f09d-42c1-ba14-1dca3ddf753d admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:15.815971 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb1c45-f09d-42c1-ba14-1dca3ddf753d admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:15.819396 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-ba8fd78c-5cc7-41e0-8988-ee4a1eae9c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:15.820427 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb1c45-f09d-42c1-ba14-1dca3ddf753d admin admin] PATH_INFO: `/v3/domains` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:15.822022 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bb1c45-f09d-42c1-ba14-1dca3ddf753d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:50:15.822865 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bb1c45-f09d-42c1-ba14-1dca3ddf753d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:15.838905 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bb1c45-f09d-42c1-ba14-1dca3ddf753d admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:15.880278 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 848/1693] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Jul 18 16:50:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:50:15.885328 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb1c45-f09d-42c1-ba14-1dca3ddf753d admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:15.920720 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb1c45-f09d-42c1-ba14-1dca3ddf753d admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:15.933651 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff80620e-2805-49df-a0c6-5bda57dfd483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:15.934928 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff80620e-2805-49df-a0c6-5bda57dfd483 admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:15.935300 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff80620e-2805-49df-a0c6-5bda57dfd483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:15.941646 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff80620e-2805-49df-a0c6-5bda57dfd483 admin admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:15.943109 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff80620e-2805-49df-a0c6-5bda57dfd483 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:15.946958 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff80620e-2805-49df-a0c6-5bda57dfd483 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:15.952289 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 846/1694] 10.222.0.81 () {58 vars in 1009 bytes} [Mon Jul 18 16:50:15 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:50:15.953287 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8fd78c-5cc7-41e0-8988-ee4a1eae9c98 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:15.957465 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-ba8fd78c-5cc7-41e0-8988-ee4a1eae9c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:15.987103 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8fd78c-5cc7-41e0-8988-ee4a1eae9c98 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:16.010917 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f30262d-e352-4a0d-a967-ddeeafebad54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:16.012047 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30262d-e352-4a0d-a967-ddeeafebad54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:16.012344 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30262d-e352-4a0d-a967-ddeeafebad54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:16.012627 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30262d-e352-4a0d-a967-ddeeafebad54 admin admin] PATH_INFO: `/v3/projects/e6e3f8c343fd45629d9c389cd18c7e59` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:16.015605 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f30262d-e352-4a0d-a967-ddeeafebad54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6e3f8c343fd45629d9c389cd18c7e59)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:16.020332 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f30262d-e352-4a0d-a967-ddeeafebad54 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:16.098977 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 849/1695] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:50:15 2022] POST /identity/v3/projects => generated 365 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:50:16.100129 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff80620e-2805-49df-a0c6-5bda57dfd483 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:16.106675 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-ff80620e-2805-49df-a0c6-5bda57dfd483 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:16.217279 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff80620e-2805-49df-a0c6-5bda57dfd483 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:16.227906 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c625394e-c2d4-4f26-b9d4-d01cfa1d2671 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:16.232134 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625394e-c2d4-4f26-b9d4-d01cfa1d2671 service neutron] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:16.232134 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625394e-c2d4-4f26-b9d4-d01cfa1d2671 service neutron] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:16.232134 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625394e-c2d4-4f26-b9d4-d01cfa1d2671 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:16.250423 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-1f30262d-e352-4a0d-a967-ddeeafebad54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6e3f8c343fd45629d9c389cd18c7e59', 'request_id': 'req-1f30262d-e352-4a0d-a967-ddeeafebad54'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:16.251612 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c625394e-c2d4-4f26-b9d4-d01cfa1d2671 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:16.253126 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c625394e-c2d4-4f26-b9d4-d01cfa1d2671 service neutron] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:16.258958 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-1f30262d-e352-4a0d-a967-ddeeafebad54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6e3f8c343fd45629d9c389cd18c7e59', 'request_id': 'req-1f30262d-e352-4a0d-a967-ddeeafebad54'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:16.269604 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-1f30262d-e352-4a0d-a967-ddeeafebad54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6e3f8c343fd45629d9c389cd18c7e59', 'request_id': 'req-1f30262d-e352-4a0d-a967-ddeeafebad54'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:16.280949 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 850/1696] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:50:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:50:16.281903 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c625394e-c2d4-4f26-b9d4-d01cfa1d2671 service neutron] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:16.283483 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-c625394e-c2d4-4f26-b9d4-d01cfa1d2671 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:16.362680 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-1f30262d-e352-4a0d-a967-ddeeafebad54 admin admin] The token cache is being invalidate because project e6e3f8c343fd45629d9c389cd18c7e59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:50:16.363297 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-1f30262d-e352-4a0d-a967-ddeeafebad54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:16.365710 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-1f30262d-e352-4a0d-a967-ddeeafebad54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:16.370471 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 847/1697] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 16:50:15 2022] DELETE /identity/v3/projects/e6e3f8c343fd45629d9c389cd18c7e59 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:50:16.375523 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f30262d-e352-4a0d-a967-ddeeafebad54 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:16.382421 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-1f30262d-e352-4a0d-a967-ddeeafebad54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:16.417378 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c625394e-c2d4-4f26-b9d4-d01cfa1d2671 service neutron] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:16.499514 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ea760a-9826-48e0-b8fb-7c55e235941a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:16.503454 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea760a-9826-48e0-b8fb-7c55e235941a service cinder] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:16.503965 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea760a-9826-48e0-b8fb-7c55e235941a service cinder] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:16.504408 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea760a-9826-48e0-b8fb-7c55e235941a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:16.506838 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-c3ea760a-9826-48e0-b8fb-7c55e235941a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:16.557521 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:16.583761 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f30262d-e352-4a0d-a967-ddeeafebad54 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:16.592971 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0329d13-c057-4465-b543-7903371ed142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:16.594014 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0329d13-c057-4465-b543-7903371ed142 admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:16.594688 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0329d13-c057-4465-b543-7903371ed142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:16.595211 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0329d13-c057-4465-b543-7903371ed142 admin admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:16.596938 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0329d13-c057-4465-b543-7903371ed142 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:16.599174 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0329d13-c057-4465-b543-7903371ed142 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:16.674185 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ea760a-9826-48e0-b8fb-7c55e235941a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:16.675803 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ea760a-9826-48e0-b8fb-7c55e235941a service cinder] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:16.699842 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 851/1698] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:50:16 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:50:16.700745 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ea760a-9826-48e0-b8fb-7c55e235941a service cinder] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:16.707517 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-c3ea760a-9826-48e0-b8fb-7c55e235941a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:16.726063 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 848/1699] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 16:50:16 2022] POST /identity/v3/users => generated 283 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:50:16.727245 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0329d13-c057-4465-b543-7903371ed142 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:16.734193 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ea760a-9826-48e0-b8fb-7c55e235941a service cinder] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:16.736820 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-f0329d13-c057-4465-b543-7903371ed142 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:16.743516 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ca9aa-d2dc-4c4a-83df-e3bb5503ae02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:16.747941 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ca9aa-d2dc-4c4a-83df-e3bb5503ae02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:16.747941 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ca9aa-d2dc-4c4a-83df-e3bb5503ae02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:16.747941 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ca9aa-d2dc-4c4a-83df-e3bb5503ae02 admin admin] PATH_INFO: `/v3/projects/783bc7905a5f428b9dd7bf41b3dc2b81` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:16.749619 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10ca9aa-d2dc-4c4a-83df-e3bb5503ae02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=783bc7905a5f428b9dd7bf41b3dc2b81)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:16.752071 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10ca9aa-d2dc-4c4a-83df-e3bb5503ae02 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:16.787984 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0329d13-c057-4465-b543-7903371ed142 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:16.811938 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc72596e-a3f1-4871-a96c-3bbcca71686c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:16.813334 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72596e-a3f1-4871-a96c-3bbcca71686c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:16.816672 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72596e-a3f1-4871-a96c-3bbcca71686c admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:16.816672 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72596e-a3f1-4871-a96c-3bbcca71686c admin admin] PATH_INFO: `/v3/users/4a8ee14fd4b84114b06b2c5208038a42` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:16.817791 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc72596e-a3f1-4871-a96c-3bbcca71686c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a8ee14fd4b84114b06b2c5208038a42)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:16.829112 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc72596e-a3f1-4871-a96c-3bbcca71686c admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:16.931233 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-e10ca9aa-d2dc-4c4a-83df-e3bb5503ae02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '783bc7905a5f428b9dd7bf41b3dc2b81', 'request_id': 'req-e10ca9aa-d2dc-4c4a-83df-e3bb5503ae02'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:17.073397 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-e10ca9aa-d2dc-4c4a-83df-e3bb5503ae02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '783bc7905a5f428b9dd7bf41b3dc2b81', 'request_id': 'req-e10ca9aa-d2dc-4c4a-83df-e3bb5503ae02'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:17.090545 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-e10ca9aa-d2dc-4c4a-83df-e3bb5503ae02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '783bc7905a5f428b9dd7bf41b3dc2b81', 'request_id': 'req-e10ca9aa-d2dc-4c4a-83df-e3bb5503ae02'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:17.124307 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-e10ca9aa-d2dc-4c4a-83df-e3bb5503ae02 admin admin] The token cache is being invalidate because project 783bc7905a5f428b9dd7bf41b3dc2b81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:50:17.125992 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-e10ca9aa-d2dc-4c4a-83df-e3bb5503ae02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:17.126927 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-e10ca9aa-d2dc-4c4a-83df-e3bb5503ae02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:17.140927 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 852/1700] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 16:50:16 2022] DELETE /identity/v3/projects/783bc7905a5f428b9dd7bf41b3dc2b81 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:50:17.143064 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ca9aa-d2dc-4c4a-83df-e3bb5503ae02 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:17.148121 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-e10ca9aa-d2dc-4c4a-83df-e3bb5503ae02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:17.192200 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-bc72596e-a3f1-4871-a96c-3bbcca71686c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a8ee14fd4b84114b06b2c5208038a42'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:17.231565 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-bc72596e-a3f1-4871-a96c-3bbcca71686c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a8ee14fd4b84114b06b2c5208038a42'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:17.237261 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-bc72596e-a3f1-4871-a96c-3bbcca71686c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a8ee14fd4b84114b06b2c5208038a42'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:17.253420 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-bc72596e-a3f1-4871-a96c-3bbcca71686c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a8ee14fd4b84114b06b2c5208038a42'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:17.336869 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ca9aa-d2dc-4c4a-83df-e3bb5503ae02 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:17.343558 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-bc72596e-a3f1-4871-a96c-3bbcca71686c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a8ee14fd4b84114b06b2c5208038a42'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:17.355702 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 849/1701] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 16:50:16 2022] DELETE /identity/v3/users/4a8ee14fd4b84114b06b2c5208038a42 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:50:17.357579 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733eb6cc-b1cd-4ec4-8bea-5731c6cb2378 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:17.357873 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733eb6cc-b1cd-4ec4-8bea-5731c6cb2378 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:17.358153 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733eb6cc-b1cd-4ec4-8bea-5731c6cb2378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:17.360196 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af8858-f28f-41cd-88a6-1c9ce8540301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:17.362438 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af8858-f28f-41cd-88a6-1c9ce8540301 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:17.363790 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af8858-f28f-41cd-88a6-1c9ce8540301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:17.364699 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af8858-f28f-41cd-88a6-1c9ce8540301 admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:17.367275 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18af8858-f28f-41cd-88a6-1c9ce8540301 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:17.371671 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18af8858-f28f-41cd-88a6-1c9ce8540301 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:17.414942 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-733eb6cc-b1cd-4ec4-8bea-5731c6cb2378 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:17.423041 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-733eb6cc-b1cd-4ec4-8bea-5731c6cb2378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:17.427812 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 853/1702] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:50:17 2022] GET /identity/v3/roles => generated 1420 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:50:17.430707 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af8858-f28f-41cd-88a6-1c9ce8540301 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:17.434848 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-18af8858-f28f-41cd-88a6-1c9ce8540301 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:17.490770 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af8858-f28f-41cd-88a6-1c9ce8540301 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:17.538734 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:17.584943 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 850/1703] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:50:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:50:17.586541 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1134a3-1580-4eb5-b0c7-89f6e7b3dee1 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:17.587171 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1134a3-1580-4eb5-b0c7-89f6e7b3dee1 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:17.588600 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1134a3-1580-4eb5-b0c7-89f6e7b3dee1 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:17.589798 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 851/1704] 10.222.0.81 () {54 vars in 961 bytes} [Mon Jul 18 16:50:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:50:17.597807 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e907042-79da-48d2-8098-87f04d765953 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:17.600345 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e907042-79da-48d2-8098-87f04d765953 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:17.605392 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:17.607454 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e907042-79da-48d2-8098-87f04d765953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:17.649644 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-1e907042-79da-48d2-8098-87f04d765953 None None] MFA Rules not processed for user `5700ad7df774415b89737c7dddcc5b2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:17.651662 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-1e907042-79da-48d2-8098-87f04d765953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:17.791468 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9326f1c5-ca6b-40a6-95cd-947711d85f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:17.795516 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326f1c5-ca6b-40a6-95cd-947711d85f79 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:17.797526 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326f1c5-ca6b-40a6-95cd-947711d85f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:17.802998 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326f1c5-ca6b-40a6-95cd-947711d85f79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:17.804698 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9326f1c5-ca6b-40a6-95cd-947711d85f79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:17.809538 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 852/1705] 10.222.0.81 () {58 vars in 1058 bytes} [Mon Jul 18 16:50:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:50:17.811313 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2e114-eb3d-4bcc-9a00-1473c2e06152 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:17.811682 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2e114-eb3d-4bcc-9a00-1473c2e06152 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:17.811880 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9326f1c5-ca6b-40a6-95cd-947711d85f79 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:17.812117 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2e114-eb3d-4bcc-9a00-1473c2e06152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:17.843739 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-d7f2e114-eb3d-4bcc-9a00-1473c2e06152 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:17.845023 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-d7f2e114-eb3d-4bcc-9a00-1473c2e06152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:17.856217 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 853/1706] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:50:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:50:17.857919 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f2e114-eb3d-4bcc-9a00-1473c2e06152 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:17.869122 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 854/1707] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:50:17 2022] GET /identity/v3/roles => generated 1420 bytes in 440 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:50:17.877663 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9326f1c5-ca6b-40a6-95cd-947711d85f79 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:17.901544 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f2e114-eb3d-4bcc-9a00-1473c2e06152 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:17.916785 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dc7bd3-8a1a-478f-85c4-9f603c734456 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700ad7df774415b89737c7dddcc5b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:17.917541 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc7bd3-8a1a-478f-85c4-9f603c734456 service placement] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:17.917897 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc7bd3-8a1a-478f-85c4-9f603c734456 service placement] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:17.918967 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc7bd3-8a1a-478f-85c4-9f603c734456 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:17.921387 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9326f1c5-ca6b-40a6-95cd-947711d85f79 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:17.922436 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-99dc7bd3-8a1a-478f-85c4-9f603c734456 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:17.939105 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36366b0b-da2a-4266-95d0-0804f83f3770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:17.941743 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36366b0b-da2a-4266-95d0-0804f83f3770 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:17.942238 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36366b0b-da2a-4266-95d0-0804f83f3770 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:17.943015 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36366b0b-da2a-4266-95d0-0804f83f3770 admin admin] PATH_INFO: `/v3/domains` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:17.945658 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36366b0b-da2a-4266-95d0-0804f83f3770 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:50:17.949345 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36366b0b-da2a-4266-95d0-0804f83f3770 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:17.956179 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36366b0b-da2a-4266-95d0-0804f83f3770 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:17.971970 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dc7bd3-8a1a-478f-85c4-9f603c734456 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:17.976269 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dc7bd3-8a1a-478f-85c4-9f603c734456 service placement] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:18.005762 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 855/1708] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Jul 18 16:50:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:50:18.006766 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36366b0b-da2a-4266-95d0-0804f83f3770 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:18.022146 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 854/1709] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:50:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:50:18.026978 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77960ad9-7311-4ab5-ae6f-70b082a330c9 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:18.027487 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77960ad9-7311-4ab5-ae6f-70b082a330c9 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:18.031995 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77960ad9-7311-4ab5-ae6f-70b082a330c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:18.046458 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36366b0b-da2a-4266-95d0-0804f83f3770 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:18.061036 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb85f22-dd99-4955-b7b5-40d6326f6c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:18.062080 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb85f22-dd99-4955-b7b5-40d6326f6c9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:18.062275 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb85f22-dd99-4955-b7b5-40d6326f6c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:18.062554 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb85f22-dd99-4955-b7b5-40d6326f6c9e admin admin] PATH_INFO: `/v3/projects/a04a6ee2c45b46e89130b9d6e2a3cfa4/users/21bfd9cd7f734ce5aa407159f1e7f69d/roles/ad3a2bc7b2094a4da1a95a143c8d9436` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:18.067692 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-77960ad9-7311-4ab5-ae6f-70b082a330c9 None None] MFA Rules not processed for user `0f292cde7f7142f08e961a3d20d76b31`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:18.069055 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-77960ad9-7311-4ab5-ae6f-70b082a330c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:18.119057 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb85f22-dd99-4955-b7b5-40d6326f6c9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a04a6ee2c45b46e89130b9d6e2a3cfa4, user_id=21bfd9cd7f734ce5aa407159f1e7f69d, role_id=ad3a2bc7b2094a4da1a95a143c8d9436)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:18.122901 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb85f22-dd99-4955-b7b5-40d6326f6c9e admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:18.242487 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 856/1710] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:50:18 2022] PUT /identity/v3/projects/a04a6ee2c45b46e89130b9d6e2a3cfa4/users/21bfd9cd7f734ce5aa407159f1e7f69d/roles/ad3a2bc7b2094a4da1a95a143c8d9436 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:50:18.245041 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb85f22-dd99-4955-b7b5-40d6326f6c9e admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:18.300598 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 855/1711] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:50:18 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:50:18.303441 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896b975-4413-49b2-a791-e4a8a48a7181 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:18.303441 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896b975-4413-49b2-a791-e4a8a48a7181 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:18.303615 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896b975-4413-49b2-a791-e4a8a48a7181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:18.441890 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-2896b975-4413-49b2-a791-e4a8a48a7181 None None] MFA Rules not processed for user `21bfd9cd7f734ce5aa407159f1e7f69d`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:18.444947 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-2896b975-4413-49b2-a791-e4a8a48a7181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:18.498702 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb85f22-dd99-4955-b7b5-40d6326f6c9e admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:18.502048 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=88,keystone:DELETE=8,keystone:INSERT=4 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:18.513920 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7681819f-2725-4a0b-a7d8-01f2d9877b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:18.514773 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7681819f-2725-4a0b-a7d8-01f2d9877b9c admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:18.515164 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7681819f-2725-4a0b-a7d8-01f2d9877b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:18.515559 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7681819f-2725-4a0b-a7d8-01f2d9877b9c admin admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:18.516668 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7681819f-2725-4a0b-a7d8-01f2d9877b9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:18.523397 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7681819f-2725-4a0b-a7d8-01f2d9877b9c admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:18.682317 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 857/1712] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:50:18 2022] POST /identity/v3/projects => generated 369 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:50:18.686692 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7681819f-2725-4a0b-a7d8-01f2d9877b9c admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:18.723666 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 856/1713] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:50:18 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 422 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:50:18.726361 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2896b975-4413-49b2-a791-e4a8a48a7181 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:18.756390 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2896b975-4413-49b2-a791-e4a8a48a7181 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:18.864063 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7681819f-2725-4a0b-a7d8-01f2d9877b9c admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:18.878012 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90985e5d-c573-46f5-b013-d92f841dff00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:18.878012 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90985e5d-c573-46f5-b013-d92f841dff00 admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:18.878012 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90985e5d-c573-46f5-b013-d92f841dff00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:18.878012 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90985e5d-c573-46f5-b013-d92f841dff00 admin admin] PATH_INFO: `/v3/users` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:18.878279 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90985e5d-c573-46f5-b013-d92f841dff00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:18.879832 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90985e5d-c573-46f5-b013-d92f841dff00 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:18.943916 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f315c-2ec0-4e61-b366-593fa99af8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:18.945313 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f315c-2ec0-4e61-b366-593fa99af8b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:18.945933 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f315c-2ec0-4e61-b366-593fa99af8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:18.947999 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f315c-2ec0-4e61-b366-593fa99af8b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:18.948915 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0f315c-2ec0-4e61-b366-593fa99af8b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:18.954431 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0f315c-2ec0-4e61-b366-593fa99af8b2 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:19.019784 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 858/1714] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 16:50:18 2022] POST /identity/v3/users => generated 285 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:50:19.022066 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90985e5d-c573-46f5-b013-d92f841dff00 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:19.054159 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90985e5d-c573-46f5-b013-d92f841dff00 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:19.069554 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba5dfe0-7b7e-43ef-9bf8-83dd988a85d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:19.071476 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba5dfe0-7b7e-43ef-9bf8-83dd988a85d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:19.071960 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba5dfe0-7b7e-43ef-9bf8-83dd988a85d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:19.073134 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba5dfe0-7b7e-43ef-9bf8-83dd988a85d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:19.074538 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba5dfe0-7b7e-43ef-9bf8-83dd988a85d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:19.081029 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba5dfe0-7b7e-43ef-9bf8-83dd988a85d8 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:19.120280 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 857/1715] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:50:18 2022] POST /identity/v3/projects => generated 365 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:50:19.124977 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f315c-2ec0-4e61-b366-593fa99af8b2 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:19.133931 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 859/1716] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:50:19 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:50:19.135692 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba5dfe0-7b7e-43ef-9bf8-83dd988a85d8 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:19.187004 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba5dfe0-7b7e-43ef-9bf8-83dd988a85d8 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:19.379210 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f315c-2ec0-4e61-b366-593fa99af8b2 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:19.395296 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0b9f3e-c78a-41e3-970c-b17993e0a1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:19.395582 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b9f3e-c78a-41e3-970c-b17993e0a1c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:19.396090 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b9f3e-c78a-41e3-970c-b17993e0a1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:19.396470 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b9f3e-c78a-41e3-970c-b17993e0a1c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:19.397452 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0b9f3e-c78a-41e3-970c-b17993e0a1c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:19.403018 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0b9f3e-c78a-41e3-970c-b17993e0a1c1 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:19.409305 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd439c4-2e8a-47c7-b20a-dfe614aded85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:19.410144 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd439c4-2e8a-47c7-b20a-dfe614aded85 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:19.412797 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd439c4-2e8a-47c7-b20a-dfe614aded85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:19.413141 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd439c4-2e8a-47c7-b20a-dfe614aded85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:19.413941 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd439c4-2e8a-47c7-b20a-dfe614aded85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:19.419652 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd439c4-2e8a-47c7-b20a-dfe614aded85 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:19.461732 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 860/1717] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:50:19 2022] GET /identity/v3/roles => generated 1420 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:50:19.465064 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd439c4-2e8a-47c7-b20a-dfe614aded85 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:19.498365 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd439c4-2e8a-47c7-b20a-dfe614aded85 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:19.529464 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb32b9ae-1188-42a9-9441-f1893e9477f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:19.530392 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32b9ae-1188-42a9-9441-f1893e9477f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:19.530672 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32b9ae-1188-42a9-9441-f1893e9477f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:19.530944 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32b9ae-1188-42a9-9441-f1893e9477f1 admin admin] PATH_INFO: `/v3/projects/eda2393d6f2f49cd8b19c79347385331/users/af422e904a394f31b6c3285f4ad79c30/roles/ad3a2bc7b2094a4da1a95a143c8d9436` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:19.596599 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb32b9ae-1188-42a9-9441-f1893e9477f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eda2393d6f2f49cd8b19c79347385331, user_id=af422e904a394f31b6c3285f4ad79c30, role_id=ad3a2bc7b2094a4da1a95a143c8d9436)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:19.599484 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb32b9ae-1188-42a9-9441-f1893e9477f1 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:19.601287 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 858/1718] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 16:50:19 2022] POST /identity/v3/users => generated 289 bytes in 477 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:50:19.602717 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd009b1-109e-4e0a-84f8-e54272f3f0da None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:19.603012 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd009b1-109e-4e0a-84f8-e54272f3f0da None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:19.606415 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd009b1-109e-4e0a-84f8-e54272f3f0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:19.696915 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-cbd009b1-109e-4e0a-84f8-e54272f3f0da None None] MFA Rules not processed for user `27015a61b08249388e22187e1e56c057`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:19.702375 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-cbd009b1-109e-4e0a-84f8-e54272f3f0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:19.753199 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 861/1719] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:50:19 2022] PUT /identity/v3/projects/eda2393d6f2f49cd8b19c79347385331/users/af422e904a394f31b6c3285f4ad79c30/roles/ad3a2bc7b2094a4da1a95a143c8d9436 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:50:19.754417 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb32b9ae-1188-42a9-9441-f1893e9477f1 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:19.878941 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 859/1720] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:50:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:50:19.880601 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd0667f-7e27-4f98-bf80-74235237a575 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:19.880966 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd0667f-7e27-4f98-bf80-74235237a575 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:19.881325 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd0667f-7e27-4f98-bf80-74235237a575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:19.922998 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-2bd0667f-7e27-4f98-bf80-74235237a575 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:19.924738 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-2bd0667f-7e27-4f98-bf80-74235237a575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:20.026269 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb32b9ae-1188-42a9-9441-f1893e9477f1 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:20.058241 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:20.063669 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e238d-1090-411b-8747-52de352b0849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:20.064973 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e238d-1090-411b-8747-52de352b0849 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:20.065906 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e238d-1090-411b-8747-52de352b0849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:20.066389 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e238d-1090-411b-8747-52de352b0849 admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:20.068300 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3e238d-1090-411b-8747-52de352b0849 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:20.074510 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3e238d-1090-411b-8747-52de352b0849 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:20.089867 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 860/1721] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:50:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:50:20.090960 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd0667f-7e27-4f98-bf80-74235237a575 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:20.095550 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 862/1722] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:50:19 2022] GET /identity/v3/roles => generated 1420 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:50:20.100337 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e238d-1090-411b-8747-52de352b0849 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:20.101607 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-2bd0667f-7e27-4f98-bf80-74235237a575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:20.112004 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-ea3e238d-1090-411b-8747-52de352b0849 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:20.399327 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e238d-1090-411b-8747-52de352b0849 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:20.435850 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0006c23-03a5-48b7-be72-8e3eec2262ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:20.438179 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0006c23-03a5-48b7-be72-8e3eec2262ba service neutron] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:20.438568 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd0667f-7e27-4f98-bf80-74235237a575 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:20.440762 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0006c23-03a5-48b7-be72-8e3eec2262ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:20.441254 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0006c23-03a5-48b7-be72-8e3eec2262ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:20.459952 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a476a3ba-70d2-4c0b-9444-bec3423e1fe2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07f0c5bf1bee48a0bafdf7a9e4537c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:20.460616 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a476a3ba-70d2-4c0b-9444-bec3423e1fe2 service nova] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:20.460958 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a476a3ba-70d2-4c0b-9444-bec3423e1fe2 service nova] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:20.461221 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a476a3ba-70d2-4c0b-9444-bec3423e1fe2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:20.493713 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0006c23-03a5-48b7-be72-8e3eec2262ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:20.497296 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0006c23-03a5-48b7-be72-8e3eec2262ba service neutron] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:20.528844 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 863/1723] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:50:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:50:20.532941 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0006c23-03a5-48b7-be72-8e3eec2262ba service neutron] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:20.559967 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0006c23-03a5-48b7-be72-8e3eec2262ba service neutron] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:20.575432 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee5a9c-d6ab-46aa-b6e4-024ceda77838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:20.576446 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee5a9c-d6ab-46aa-b6e4-024ceda77838 admin admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:20.576803 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee5a9c-d6ab-46aa-b6e4-024ceda77838 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:20.577200 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee5a9c-d6ab-46aa-b6e4-024ceda77838 admin admin] PATH_INFO: `/v3/projects/a89af1e6a71f490b85bec802d5364a73/users/1c30a7bcfde04fccba4a96d02f2b62e5/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:20.617698 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ee5a9c-d6ab-46aa-b6e4-024ceda77838 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a89af1e6a71f490b85bec802d5364a73, user_id=1c30a7bcfde04fccba4a96d02f2b62e5, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:20.622870 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ee5a9c-d6ab-46aa-b6e4-024ceda77838 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:20.647596 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a476a3ba-70d2-4c0b-9444-bec3423e1fe2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:20.649410 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a476a3ba-70d2-4c0b-9444-bec3423e1fe2 service nova] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:20.684345 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 861/1724] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:50:20 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 591 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:50:20.691605 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d2658-95b6-48cf-ac82-d436ceaa05ba None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:20.693502 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d2658-95b6-48cf-ac82-d436ceaa05ba None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:20.694431 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d2658-95b6-48cf-ac82-d436ceaa05ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:20.740696 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 864/1725] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:50:20 2022] PUT /identity/v3/projects/a89af1e6a71f490b85bec802d5364a73/users/1c30a7bcfde04fccba4a96d02f2b62e5/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:50:20.741836 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee5a9c-d6ab-46aa-b6e4-024ceda77838 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:20.747612 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-a8ee5a9c-d6ab-46aa-b6e4-024ceda77838 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:20.758552 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-352d2658-95b6-48cf-ac82-d436ceaa05ba None None] MFA Rules not processed for user `512342c273bb4299ad5fc29e69b5aeb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:20.760120 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-352d2658-95b6-48cf-ac82-d436ceaa05ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:20.919859 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee5a9c-d6ab-46aa-b6e4-024ceda77838 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:20.933632 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8448b48-4286-4403-9de6-c8096a41c474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:20.934754 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8448b48-4286-4403-9de6-c8096a41c474 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:20.935039 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8448b48-4286-4403-9de6-c8096a41c474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:20.935325 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8448b48-4286-4403-9de6-c8096a41c474 admin admin] PATH_INFO: `/v3/projects/eff0d73c0605461dbe13cde546987c2d` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:20.937350 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8448b48-4286-4403-9de6-c8096a41c474 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eff0d73c0605461dbe13cde546987c2d)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:20.939029 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8448b48-4286-4403-9de6-c8096a41c474 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:20.957436 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 862/1726] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:50:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:50:20.958742 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d2658-95b6-48cf-ac82-d436ceaa05ba None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:21.033374 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:21.043408 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d2658-95b6-48cf-ac82-d436ceaa05ba None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:21.066217 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d110d14f-f698-4af0-a8d3-a913d0abba9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:21.068439 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110d14f-f698-4af0-a8d3-a913d0abba9f admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:21.070689 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110d14f-f698-4af0-a8d3-a913d0abba9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:21.071037 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110d14f-f698-4af0-a8d3-a913d0abba9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:21.077944 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d110d14f-f698-4af0-a8d3-a913d0abba9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:21.079703 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d110d14f-f698-4af0-a8d3-a913d0abba9f admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:21.097392 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-e8448b48-4286-4403-9de6-c8096a41c474 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eff0d73c0605461dbe13cde546987c2d', 'request_id': 'req-e8448b48-4286-4403-9de6-c8096a41c474'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:21.124424 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 863/1727] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:50:20 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:50:21.132292 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d110d14f-f698-4af0-a8d3-a913d0abba9f admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:21.137372 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-d110d14f-f698-4af0-a8d3-a913d0abba9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:21.201113 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-e8448b48-4286-4403-9de6-c8096a41c474 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eff0d73c0605461dbe13cde546987c2d', 'request_id': 'req-e8448b48-4286-4403-9de6-c8096a41c474'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:21.208765 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-e8448b48-4286-4403-9de6-c8096a41c474 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eff0d73c0605461dbe13cde546987c2d', 'request_id': 'req-e8448b48-4286-4403-9de6-c8096a41c474'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:21.252786 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-e8448b48-4286-4403-9de6-c8096a41c474 admin admin] The token cache is being invalidate because project eff0d73c0605461dbe13cde546987c2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:50:21.255701 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-e8448b48-4286-4403-9de6-c8096a41c474 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:21.257785 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-e8448b48-4286-4403-9de6-c8096a41c474 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:21.265669 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 865/1728] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 16:50:20 2022] DELETE /identity/v3/projects/eff0d73c0605461dbe13cde546987c2d => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:50:21.268182 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8448b48-4286-4403-9de6-c8096a41c474 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:21.290513 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-e8448b48-4286-4403-9de6-c8096a41c474 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:21.503761 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d110d14f-f698-4af0-a8d3-a913d0abba9f admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:21.617591 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8448b48-4286-4403-9de6-c8096a41c474 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:21.641721 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88eeddb-4d76-4a86-a6c6-62713b04e418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:21.643954 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88eeddb-4d76-4a86-a6c6-62713b04e418 admin admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:21.644721 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88eeddb-4d76-4a86-a6c6-62713b04e418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:21.649045 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88eeddb-4d76-4a86-a6c6-62713b04e418 admin admin] PATH_INFO: `/v3/projects/a89af1e6a71f490b85bec802d5364a73/users/1c30a7bcfde04fccba4a96d02f2b62e5/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:21.655471 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88eeddb-4d76-4a86-a6c6-62713b04e418 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a89af1e6a71f490b85bec802d5364a73, user_id=1c30a7bcfde04fccba4a96d02f2b62e5, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:21.663229 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88eeddb-4d76-4a86-a6c6-62713b04e418 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:21.710477 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 866/1729] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:50:21 2022] PUT /identity/v3/projects/a89af1e6a71f490b85bec802d5364a73/users/1c30a7bcfde04fccba4a96d02f2b62e5/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:50:21.714634 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a60f0c-c255-473c-8b39-ce6ca0a2792d None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:21.715430 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a60f0c-c255-473c-8b39-ce6ca0a2792d None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:21.716204 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a60f0c-c255-473c-8b39-ce6ca0a2792d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:21.734280 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea52c9c-959a-4387-8327-984a29f9af3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07f0c5bf1bee48a0bafdf7a9e4537c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:21.735118 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea52c9c-959a-4387-8327-984a29f9af3f service nova] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:21.737587 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea52c9c-959a-4387-8327-984a29f9af3f service nova] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:21.737587 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea52c9c-959a-4387-8327-984a29f9af3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:21.749189 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-dea52c9c-959a-4387-8327-984a29f9af3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:21.799404 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-b3a60f0c-c255-473c-8b39-ce6ca0a2792d None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:21.799404 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-b3a60f0c-c255-473c-8b39-ce6ca0a2792d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:21.972797 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea52c9c-959a-4387-8327-984a29f9af3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:21.974570 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea52c9c-959a-4387-8327-984a29f9af3f service nova] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:22.012841 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 864/1730] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:50:21 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 881 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:50:22.014520 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df88c8-f31b-4af0-8f03-1f8b20b95b4c None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:22.014927 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df88c8-f31b-4af0-8f03-1f8b20b95b4c None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:22.015275 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df88c8-f31b-4af0-8f03-1f8b20b95b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:22.050485 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 867/1731] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:50:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:50:22.066253 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da78c2-4c40-4dd7-8417-0fa395afad11 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:22.066728 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da78c2-4c40-4dd7-8417-0fa395afad11 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:22.067051 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da78c2-4c40-4dd7-8417-0fa395afad11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:22.118048 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-66da78c2-4c40-4dd7-8417-0fa395afad11 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:22.120225 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-66da78c2-4c40-4dd7-8417-0fa395afad11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:22.123239 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-44df88c8-f31b-4af0-8f03-1f8b20b95b4c None None] MFA Rules not processed for user `1c30a7bcfde04fccba4a96d02f2b62e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:22.126232 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-44df88c8-f31b-4af0-8f03-1f8b20b95b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:22.137550 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 868/1732] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:50:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:50:22.142354 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da78c2-4c40-4dd7-8417-0fa395afad11 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:22.182990 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da78c2-4c40-4dd7-8417-0fa395afad11 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:22.208266 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e84626-25de-4a0c-87bf-103d44e34faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:22.213793 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e84626-25de-4a0c-87bf-103d44e34faf admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:22.213793 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e84626-25de-4a0c-87bf-103d44e34faf admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:22.213793 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e84626-25de-4a0c-87bf-103d44e34faf admin admin] PATH_INFO: `/v3/domains` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:22.213793 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e84626-25de-4a0c-87bf-103d44e34faf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:50:22.213793 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e84626-25de-4a0c-87bf-103d44e34faf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:22.218773 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e84626-25de-4a0c-87bf-103d44e34faf admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:22.287977 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 869/1733] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Jul 18 16:50:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:50:22.289951 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e84626-25de-4a0c-87bf-103d44e34faf admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:22.340059 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e84626-25de-4a0c-87bf-103d44e34faf admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:22.355121 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 865/1734] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:50:22 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:50:22.372981 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df88c8-f31b-4af0-8f03-1f8b20b95b4c None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:22.374908 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84fb37-7c37-4d7a-8ce3-fe1536900081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:22.380489 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84fb37-7c37-4d7a-8ce3-fe1536900081 admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:22.380908 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84fb37-7c37-4d7a-8ce3-fe1536900081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:22.381238 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84fb37-7c37-4d7a-8ce3-fe1536900081 admin admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:22.382355 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-44df88c8-f31b-4af0-8f03-1f8b20b95b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:22.386777 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f84fb37-7c37-4d7a-8ce3-fe1536900081 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:22.392002 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f84fb37-7c37-4d7a-8ce3-fe1536900081 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:22.525487 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 870/1735] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:50:22 2022] POST /identity/v3/projects => generated 369 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:50:22.529912 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84fb37-7c37-4d7a-8ce3-fe1536900081 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:22.536450 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:22.585021 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df88c8-f31b-4af0-8f03-1f8b20b95b4c None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:22.713845 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18a0046-ab64-4202-ab7e-5e8472f5dc4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:22.715404 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a0046-ab64-4202-ab7e-5e8472f5dc4b service cinder] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:22.715982 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a0046-ab64-4202-ab7e-5e8472f5dc4b service cinder] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:22.716955 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a0046-ab64-4202-ab7e-5e8472f5dc4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:22.794069 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84fb37-7c37-4d7a-8ce3-fe1536900081 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:22.814193 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab07242-297e-4c04-b088-22e5e82788ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:22.815082 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab07242-297e-4c04-b088-22e5e82788ac admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:22.815369 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab07242-297e-4c04-b088-22e5e82788ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:22.815833 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab07242-297e-4c04-b088-22e5e82788ac admin admin] PATH_INFO: `/v3/users` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:22.816665 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab07242-297e-4c04-b088-22e5e82788ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:22.819943 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab07242-297e-4c04-b088-22e5e82788ac admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:22.870235 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18a0046-ab64-4202-ab7e-5e8472f5dc4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:22.880350 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18a0046-ab64-4202-ab7e-5e8472f5dc4b service cinder] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:22.915542 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 866/1736] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:50:22 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:50:22.930054 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 871/1737] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 16:50:22 2022] POST /identity/v3/users => generated 285 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:50:22.930708 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18a0046-ab64-4202-ab7e-5e8472f5dc4b service cinder] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:22.965023 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18a0046-ab64-4202-ab7e-5e8472f5dc4b service cinder] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:22.973090 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4810849-b498-4d0b-9731-6410f2bed58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:22.974768 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4810849-b498-4d0b-9731-6410f2bed58e admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:22.975366 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4810849-b498-4d0b-9731-6410f2bed58e admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:22.976182 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4810849-b498-4d0b-9731-6410f2bed58e admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:22.977895 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4810849-b498-4d0b-9731-6410f2bed58e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:22.981219 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4810849-b498-4d0b-9731-6410f2bed58e admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:23.003675 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 867/1738] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:50:22 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:50:23.007366 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab07242-297e-4c04-b088-22e5e82788ac admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:23.021393 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab07242-297e-4c04-b088-22e5e82788ac admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:23.038119 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0c6bd4-d3e1-4757-a26c-fa427478543c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:23.039077 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c6bd4-d3e1-4757-a26c-fa427478543c admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:23.039345 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c6bd4-d3e1-4757-a26c-fa427478543c admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:23.039621 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c6bd4-d3e1-4757-a26c-fa427478543c admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:23.040453 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0c6bd4-d3e1-4757-a26c-fa427478543c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:23.043434 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0c6bd4-d3e1-4757-a26c-fa427478543c admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:23.061742 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 872/1739] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:50:23 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:50:23.062939 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4810849-b498-4d0b-9731-6410f2bed58e admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:23.077868 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4810849-b498-4d0b-9731-6410f2bed58e admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:23.083590 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b3b83-a0fd-4ff8-a355-014b50a275e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:23.085562 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b3b83-a0fd-4ff8-a355-014b50a275e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:23.085562 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b3b83-a0fd-4ff8-a355-014b50a275e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:23.085965 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b3b83-a0fd-4ff8-a355-014b50a275e4 admin admin] PATH_INFO: `/v3/projects/3b2148f3572345548bba391ed7c7ab9b/users/d7132dab10ad4585b1239d22d25f6cbf/roles/ad3a2bc7b2094a4da1a95a143c8d9436` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:23.115696 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611b3b83-a0fd-4ff8-a355-014b50a275e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b2148f3572345548bba391ed7c7ab9b, user_id=d7132dab10ad4585b1239d22d25f6cbf, role_id=ad3a2bc7b2094a4da1a95a143c8d9436)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:23.121908 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611b3b83-a0fd-4ff8-a355-014b50a275e4 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:23.257430 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a32139-eed5-441b-a3d1-1db9eb8c80d1 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:23.257627 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a32139-eed5-441b-a3d1-1db9eb8c80d1 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:23.257972 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a32139-eed5-441b-a3d1-1db9eb8c80d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:23.259394 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 868/1740] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:50:23 2022] PUT /identity/v3/projects/3b2148f3572345548bba391ed7c7ab9b/users/d7132dab10ad4585b1239d22d25f6cbf/roles/ad3a2bc7b2094a4da1a95a143c8d9436 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:50:23.317716 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-47a32139-eed5-441b-a3d1-1db9eb8c80d1 None None] MFA Rules not processed for user `d7132dab10ad4585b1239d22d25f6cbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:23.319132 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-47a32139-eed5-441b-a3d1-1db9eb8c80d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:23.332253 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b3b83-a0fd-4ff8-a355-014b50a275e4 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:23.527797 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 873/1741] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:50:23 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:50:23.531689 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a32139-eed5-441b-a3d1-1db9eb8c80d1 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:23.553660 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b3b83-a0fd-4ff8-a355-014b50a275e4 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:23.573851 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9866eb47-f08a-45e6-98a4-28182ad126c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:23.574791 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9866eb47-f08a-45e6-98a4-28182ad126c6 service cinder] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:23.576292 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9866eb47-f08a-45e6-98a4-28182ad126c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:23.576742 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9866eb47-f08a-45e6-98a4-28182ad126c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:23.583225 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-9866eb47-f08a-45e6-98a4-28182ad126c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:23.770629 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:23.863881 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a32139-eed5-441b-a3d1-1db9eb8c80d1 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:23.880312 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4742f5c1-31f9-4a58-8bc5-d4d8f094341c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:23.882298 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742f5c1-31f9-4a58-8bc5-d4d8f094341c admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:23.884177 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9866eb47-f08a-45e6-98a4-28182ad126c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:23.884438 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742f5c1-31f9-4a58-8bc5-d4d8f094341c admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:23.884438 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742f5c1-31f9-4a58-8bc5-d4d8f094341c admin admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:23.886062 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4742f5c1-31f9-4a58-8bc5-d4d8f094341c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:23.888952 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9866eb47-f08a-45e6-98a4-28182ad126c6 service cinder] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:23.889613 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4742f5c1-31f9-4a58-8bc5-d4d8f094341c admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:23.932706 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 869/1742] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:50:23 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 601 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:50:24.129816 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 874/1743] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:50:23 2022] POST /identity/v3/projects => generated 369 bytes in 598 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:50:24.137640 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9866eb47-f08a-45e6-98a4-28182ad126c6 service cinder] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:24.173365 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9866eb47-f08a-45e6-98a4-28182ad126c6 service cinder] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:24.291484 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e797227-844a-482b-beb7-22388633e087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:24.292581 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e797227-844a-482b-beb7-22388633e087 admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:24.292875 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e797227-844a-482b-beb7-22388633e087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:24.293453 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e797227-844a-482b-beb7-22388633e087 admin admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:24.294870 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e797227-844a-482b-beb7-22388633e087 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:24.299558 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e797227-844a-482b-beb7-22388633e087 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:24.347232 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842a542-a1d0-41e2-92f2-412006ec3092 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:24.353134 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842a542-a1d0-41e2-92f2-412006ec3092 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:24.353134 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842a542-a1d0-41e2-92f2-412006ec3092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:24.421507 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 870/1744] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 16:50:24 2022] POST /identity/v3/users => generated 291 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:50:24.422883 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e797227-844a-482b-beb7-22388633e087 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:24.461689 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e797227-844a-482b-beb7-22388633e087 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:24.486009 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef3726-4694-459b-8638-515649d092e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:24.498369 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-e842a542-a1d0-41e2-92f2-412006ec3092 None None] MFA Rules not processed for user `7c6f005f5340494dabfc000fe19fe60a`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:24.503828 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-e842a542-a1d0-41e2-92f2-412006ec3092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:24.529177 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef3726-4694-459b-8638-515649d092e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:24.536007 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef3726-4694-459b-8638-515649d092e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:24.537254 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef3726-4694-459b-8638-515649d092e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:24.545317 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bef3726-4694-459b-8638-515649d092e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:24.563169 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bef3726-4694-459b-8638-515649d092e4 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:24.595104 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 871/1745] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:50:24 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:50:24.601052 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef3726-4694-459b-8638-515649d092e4 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:24.650559 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef3726-4694-459b-8638-515649d092e4 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:24.667349 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd8f696-128f-4162-a36d-dc493e3f5a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:24.668373 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8f696-128f-4162-a36d-dc493e3f5a6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:24.668603 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8f696-128f-4162-a36d-dc493e3f5a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:24.668882 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8f696-128f-4162-a36d-dc493e3f5a6d admin admin] PATH_INFO: `/v3/projects/d96d39095d41479e9a42b33761a582ee/users/542a3533a6e44525ba0b98a134fc51f9/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:24.812125 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd8f696-128f-4162-a36d-dc493e3f5a6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d96d39095d41479e9a42b33761a582ee, user_id=542a3533a6e44525ba0b98a134fc51f9, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:24.814931 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd8f696-128f-4162-a36d-dc493e3f5a6d admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:24.912561 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 875/1746] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:50:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 567 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:50:24.915037 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca46f80-4a27-47e4-a44b-8c71fafb8d42 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:24.915504 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca46f80-4a27-47e4-a44b-8c71fafb8d42 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:24.916877 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca46f80-4a27-47e4-a44b-8c71fafb8d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:24.992099 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 872/1747] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:50:24 2022] PUT /identity/v3/projects/d96d39095d41479e9a42b33761a582ee/users/542a3533a6e44525ba0b98a134fc51f9/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:50:24.993638 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b4f522-2863-4a09-97b8-96c7d48846ec None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:24.993926 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b4f522-2863-4a09-97b8-96c7d48846ec None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:24.994239 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b4f522-2863-4a09-97b8-96c7d48846ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:25.067063 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-a6b4f522-2863-4a09-97b8-96c7d48846ec None None] MFA Rules not processed for user `7c6f005f5340494dabfc000fe19fe60a`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:25.073215 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-a6b4f522-2863-4a09-97b8-96c7d48846ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:25.189539 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-8ca46f80-4a27-47e4-a44b-8c71fafb8d42 None None] MFA Rules not processed for user `ea2a096c4b964f03aed533d1e5e96db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:25.190798 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-8ca46f80-4a27-47e4-a44b-8c71fafb8d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:25.241239 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:25.330424 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 873/1748] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:50:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:50:25.331078 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b4f522-2863-4a09-97b8-96c7d48846ec None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:25.338047 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:25.563963 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 876/1749] 10.222.0.81 () {58 vars in 1009 bytes} [Mon Jul 18 16:50:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 651 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:50:25.590756 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca46f80-4a27-47e4-a44b-8c71fafb8d42 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:25.602801 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-8ca46f80-4a27-47e4-a44b-8c71fafb8d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:25.614441 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b4f522-2863-4a09-97b8-96c7d48846ec None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:25.653159 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41b58e9-5df3-4777-a555-1a9fc9194783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:25.653869 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b58e9-5df3-4777-a555-1a9fc9194783 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:25.659430 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b58e9-5df3-4777-a555-1a9fc9194783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:25.659740 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b58e9-5df3-4777-a555-1a9fc9194783 admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:25.666773 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41b58e9-5df3-4777-a555-1a9fc9194783 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:25.666773 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41b58e9-5df3-4777-a555-1a9fc9194783 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:25.725527 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 874/1750] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:50:25 2022] GET /identity/v3/roles => generated 1420 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:50:25.727146 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41b58e9-5df3-4777-a555-1a9fc9194783 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:25.765244 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41b58e9-5df3-4777-a555-1a9fc9194783 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:25.790645 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab071dc-c7d1-45a3-a3be-3225b72d2c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:25.799855 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab071dc-c7d1-45a3-a3be-3225b72d2c30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:25.800250 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab071dc-c7d1-45a3-a3be-3225b72d2c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:25.800550 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab071dc-c7d1-45a3-a3be-3225b72d2c30 admin admin] PATH_INFO: `/v3/projects/d96d39095d41479e9a42b33761a582ee/users/542a3533a6e44525ba0b98a134fc51f9/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:25.811686 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab071dc-c7d1-45a3-a3be-3225b72d2c30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d96d39095d41479e9a42b33761a582ee, user_id=542a3533a6e44525ba0b98a134fc51f9, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:25.821363 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab071dc-c7d1-45a3-a3be-3225b72d2c30 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:25.870551 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 875/1751] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:50:25 2022] PUT /identity/v3/projects/d96d39095d41479e9a42b33761a582ee/users/542a3533a6e44525ba0b98a134fc51f9/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:50:25.881967 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef70dbf-932a-4e49-809b-2768eebb1594 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:25.882500 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef70dbf-932a-4e49-809b-2768eebb1594 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:25.882932 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef70dbf-932a-4e49-809b-2768eebb1594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:25.897849 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca46f80-4a27-47e4-a44b-8c71fafb8d42 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:25.997416 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-2ef70dbf-932a-4e49-809b-2768eebb1594 None None] MFA Rules not processed for user `542a3533a6e44525ba0b98a134fc51f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:25.998655 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-2ef70dbf-932a-4e49-809b-2768eebb1594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:26.126155 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad3a54f-815e-4a96-ba4a-53e794f58f1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07f0c5bf1bee48a0bafdf7a9e4537c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:26.128567 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3a54f-815e-4a96-ba4a-53e794f58f1e service nova] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:26.128859 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3a54f-815e-4a96-ba4a-53e794f58f1e service nova] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:26.136359 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3a54f-815e-4a96-ba4a-53e794f58f1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:26.221477 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 876/1752] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:50:25 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:50:26.222861 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef70dbf-932a-4e49-809b-2768eebb1594 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:26.225548 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-2ef70dbf-932a-4e49-809b-2768eebb1594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:26.355863 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad3a54f-815e-4a96-ba4a-53e794f58f1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:26.357396 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad3a54f-815e-4a96-ba4a-53e794f58f1e service nova] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:26.383758 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 877/1753] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:50:25 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 819 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:50:26.385716 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89e3c8-13f2-4fe8-a7c8-b9a0221d9e7a None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:26.387290 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89e3c8-13f2-4fe8-a7c8-b9a0221d9e7a None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:26.387997 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89e3c8-13f2-4fe8-a7c8-b9a0221d9e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:26.442973 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-df89e3c8-13f2-4fe8-a7c8-b9a0221d9e7a None None] MFA Rules not processed for user `af422e904a394f31b6c3285f4ad79c30`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:26.445119 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-df89e3c8-13f2-4fe8-a7c8-b9a0221d9e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:26.508622 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef70dbf-932a-4e49-809b-2768eebb1594 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:26.527925 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b075d3-b5ea-4bcf-81a5-f8779d9c8547 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251475c53ac64cd48ae84567d8c2ee87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:26.528659 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b075d3-b5ea-4bcf-81a5-f8779d9c8547 service swift] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:26.528949 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b075d3-b5ea-4bcf-81a5-f8779d9c8547 service swift] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:26.529231 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b075d3-b5ea-4bcf-81a5-f8779d9c8547 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:26.623814 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 878/1754] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:50:26 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:50:26.624789 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df89e3c8-13f2-4fe8-a7c8-b9a0221d9e7a None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:26.727857 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df89e3c8-13f2-4fe8-a7c8-b9a0221d9e7a None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:26.734280 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2fae67-7f66-4030-aaac-cfb0c598a7d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:26.735094 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2fae67-7f66-4030-aaac-cfb0c598a7d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:26.742921 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2fae67-7f66-4030-aaac-cfb0c598a7d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:26.742921 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2fae67-7f66-4030-aaac-cfb0c598a7d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:26.758126 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2fae67-7f66-4030-aaac-cfb0c598a7d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:26.764127 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2fae67-7f66-4030-aaac-cfb0c598a7d6 service cinder] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:26.803862 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 879/1755] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:50:26 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:50:26.805286 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b075d3-b5ea-4bcf-81a5-f8779d9c8547 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:26.810834 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2fae67-7f66-4030-aaac-cfb0c598a7d6 service cinder] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:26.812147 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b075d3-b5ea-4bcf-81a5-f8779d9c8547 service swift] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:26.813638 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-1b2fae67-7f66-4030-aaac-cfb0c598a7d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:26.842380 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 877/1756] 10.222.0.81 () {60 vars in 1384 bytes} [Mon Jul 18 16:50:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 620 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 16:50:27.018383 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:27.169054 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2fae67-7f66-4030-aaac-cfb0c598a7d6 service cinder] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:27.182656 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf14cd-48f6-4901-9989-9e99f3e14b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:27.183391 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf14cd-48f6-4901-9989-9e99f3e14b52 admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:27.183678 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf14cd-48f6-4901-9989-9e99f3e14b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:27.184043 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf14cd-48f6-4901-9989-9e99f3e14b52 admin admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:27.184904 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcf14cd-48f6-4901-9989-9e99f3e14b52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:27.189136 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcf14cd-48f6-4901-9989-9e99f3e14b52 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:27.384400 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 880/1757] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:50:26 2022] POST /identity/v3/projects => generated 373 bytes in 580 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:50:27.389590 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b075d3-b5ea-4bcf-81a5-f8779d9c8547 service swift] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:27.393263 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:27.411889 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b075d3-b5ea-4bcf-81a5-f8779d9c8547 service swift] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:27.620709 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb1091c-efad-422a-8aa8-8f4fdc8b0a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:27.622741 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1091c-efad-422a-8aa8-8f4fdc8b0a60 admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:27.623208 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1091c-efad-422a-8aa8-8f4fdc8b0a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:27.624373 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1091c-efad-422a-8aa8-8f4fdc8b0a60 admin admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:27.625671 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb1091c-efad-422a-8aa8-8f4fdc8b0a60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:27.636365 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb1091c-efad-422a-8aa8-8f4fdc8b0a60 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:27.827522 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 878/1758] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 16:50:27 2022] POST /identity/v3/users => generated 293 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:50:27.828583 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf14cd-48f6-4901-9989-9e99f3e14b52 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:27.844643 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf14cd-48f6-4901-9989-9e99f3e14b52 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:27.889201 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e598c1-b036-4782-8598-fdfa24c87a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:27.892905 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e598c1-b036-4782-8598-fdfa24c87a96 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:27.893306 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e598c1-b036-4782-8598-fdfa24c87a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:27.893605 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e598c1-b036-4782-8598-fdfa24c87a96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:27.894460 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e598c1-b036-4782-8598-fdfa24c87a96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:27.904083 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e598c1-b036-4782-8598-fdfa24c87a96 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:27.971082 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 881/1759] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:50:27 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:50:27.972473 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb1091c-efad-422a-8aa8-8f4fdc8b0a60 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:28.005050 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb1091c-efad-422a-8aa8-8f4fdc8b0a60 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:28.023618 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490b34d1-9028-4e1e-b66f-4f0587dab383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:28.024984 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b34d1-9028-4e1e-b66f-4f0587dab383 admin admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:28.025579 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b34d1-9028-4e1e-b66f-4f0587dab383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:28.027602 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b34d1-9028-4e1e-b66f-4f0587dab383 admin admin] PATH_INFO: `/v3/projects/6472cff744d84cf7b925701776b283b9/users/fe7394e622a44ebdb0a2e10276f3354a/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:28.093530 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490b34d1-9028-4e1e-b66f-4f0587dab383 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6472cff744d84cf7b925701776b283b9, user_id=fe7394e622a44ebdb0a2e10276f3354a, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:28.097464 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490b34d1-9028-4e1e-b66f-4f0587dab383 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:28.115856 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33d647-c89d-4b8d-aaf3-fc2b579f0b3b None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:28.116210 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33d647-c89d-4b8d-aaf3-fc2b579f0b3b None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:28.116715 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33d647-c89d-4b8d-aaf3-fc2b579f0b3b None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:28.119163 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 882/1760] 10.222.0.81 () {54 vars in 912 bytes} [Mon Jul 18 16:50:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:50:28.136463 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df620f-db4b-4bb2-a91b-08aca258ff3d None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:28.142158 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df620f-db4b-4bb2-a91b-08aca258ff3d None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:28.142158 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df620f-db4b-4bb2-a91b-08aca258ff3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:28.187388 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:28.194825 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-18df620f-db4b-4bb2-a91b-08aca258ff3d None None] MFA Rules not processed for user `b742c540de6545249fe3245047d00c81`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:28.199896 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-18df620f-db4b-4bb2-a91b-08aca258ff3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:28.369014 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 879/1761] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:50:27 2022] PUT /identity/v3/projects/6472cff744d84cf7b925701776b283b9/users/fe7394e622a44ebdb0a2e10276f3354a/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:50:28.375557 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490b34d1-9028-4e1e-b66f-4f0587dab383 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:28.414719 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 883/1762] 10.222.0.81 () {58 vars in 1009 bytes} [Mon Jul 18 16:50:28 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:50:28.481296 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df620f-db4b-4bb2-a91b-08aca258ff3d None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:28.482937 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-18df620f-db4b-4bb2-a91b-08aca258ff3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:28.518070 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df620f-db4b-4bb2-a91b-08aca258ff3d None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:28.663745 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490b34d1-9028-4e1e-b66f-4f0587dab383 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:28.686977 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d08c7d-1c9d-4fe6-a51b-e7a1e34bdc98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:28.688302 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d08c7d-1c9d-4fe6-a51b-e7a1e34bdc98 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:28.693655 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d08c7d-1c9d-4fe6-a51b-e7a1e34bdc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:28.693655 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d08c7d-1c9d-4fe6-a51b-e7a1e34bdc98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:28.693655 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d08c7d-1c9d-4fe6-a51b-e7a1e34bdc98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:28.696884 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d08c7d-1c9d-4fe6-a51b-e7a1e34bdc98 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:28.757262 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 880/1763] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:50:28 2022] GET /identity/v3/roles => generated 1420 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:50:28.768908 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d08c7d-1c9d-4fe6-a51b-e7a1e34bdc98 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:28.789887 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e5351c-a2cc-4b47-a8b5-6135c140cd4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:28.792722 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5351c-a2cc-4b47-a8b5-6135c140cd4d service neutron] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:28.795604 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5351c-a2cc-4b47-a8b5-6135c140cd4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:28.796178 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5351c-a2cc-4b47-a8b5-6135c140cd4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:28.809443 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d08c7d-1c9d-4fe6-a51b-e7a1e34bdc98 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:28.839990 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e5351c-a2cc-4b47-a8b5-6135c140cd4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:28.843509 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e5351c-a2cc-4b47-a8b5-6135c140cd4d service neutron] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:28.844977 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6574e863-7c6e-411b-9106-f26f5014c95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:28.851451 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574e863-7c6e-411b-9106-f26f5014c95f admin admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:28.851969 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574e863-7c6e-411b-9106-f26f5014c95f admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:28.852435 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574e863-7c6e-411b-9106-f26f5014c95f admin admin] PATH_INFO: `/v3/projects/6472cff744d84cf7b925701776b283b9/users/fe7394e622a44ebdb0a2e10276f3354a/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:28.874762 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6574e863-7c6e-411b-9106-f26f5014c95f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6472cff744d84cf7b925701776b283b9, user_id=fe7394e622a44ebdb0a2e10276f3354a, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:28.881590 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 884/1764] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:50:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 16:50:28.891599 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6574e863-7c6e-411b-9106-f26f5014c95f admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:28.919253 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 881/1765] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:50:28 2022] PUT /identity/v3/projects/6472cff744d84cf7b925701776b283b9/users/fe7394e622a44ebdb0a2e10276f3354a/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:50:29.598488 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:29.866827 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:30.225830 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944eebaa-5ae7-4268-8715-ab77dc31df3d None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:30.240285 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944eebaa-5ae7-4268-8715-ab77dc31df3d None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:30.240285 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944eebaa-5ae7-4268-8715-ab77dc31df3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:30.263257 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-944eebaa-5ae7-4268-8715-ab77dc31df3d None None] MFA Rules not processed for user `27015a61b08249388e22187e1e56c057`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:30.264681 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-944eebaa-5ae7-4268-8715-ab77dc31df3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:30.418337 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 885/1766] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:50:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:50:31.182439 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824c640-1899-42be-8441-81bfd6a308b3 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:31.182439 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824c640-1899-42be-8441-81bfd6a308b3 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:31.182439 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824c640-1899-42be-8441-81bfd6a308b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:31.229621 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-f824c640-1899-42be-8441-81bfd6a308b3 None None] MFA Rules not processed for user `b742c540de6545249fe3245047d00c81`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:31.231787 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-f824c640-1899-42be-8441-81bfd6a308b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:31.510702 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:31.557355 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 882/1767] 10.222.0.89 () {58 vars in 1015 bytes} [Mon Jul 18 16:50:31 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:50:31.662670 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944eebaa-5ae7-4268-8715-ab77dc31df3d None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:31.673311 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-944eebaa-5ae7-4268-8715-ab77dc31df3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:31.743537 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944eebaa-5ae7-4268-8715-ab77dc31df3d None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:31.766169 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f10f2a-3ea1-4be7-a572-858271b5270f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:31.767352 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f10f2a-3ea1-4be7-a572-858271b5270f service neutron] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:31.767882 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f10f2a-3ea1-4be7-a572-858271b5270f service neutron] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:31.768362 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f10f2a-3ea1-4be7-a572-858271b5270f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:31.838530 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f10f2a-3ea1-4be7-a572-858271b5270f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:31.840056 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f10f2a-3ea1-4be7-a572-858271b5270f service neutron] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:31.876859 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 886/1768] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:50:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:50:32.124915 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:32.158268 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824c640-1899-42be-8441-81bfd6a308b3 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:32.174038 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824c640-1899-42be-8441-81bfd6a308b3 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:32.178489 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50673a50-c422-4074-8ca2-5d5bb984a87d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:32.179584 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50673a50-c422-4074-8ca2-5d5bb984a87d service neutron] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:32.180360 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50673a50-c422-4074-8ca2-5d5bb984a87d service neutron] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:32.180784 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50673a50-c422-4074-8ca2-5d5bb984a87d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:32.202087 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50673a50-c422-4074-8ca2-5d5bb984a87d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:32.203595 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50673a50-c422-4074-8ca2-5d5bb984a87d service neutron] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:32.218074 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 883/1769] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:50:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:50:34.305182 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3f13b-1ce0-4aa1-ab0f-9e05f5eb2b39 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:34.306051 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3f13b-1ce0-4aa1-ab0f-9e05f5eb2b39 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:34.306051 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3f13b-1ce0-4aa1-ab0f-9e05f5eb2b39 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:34.307675 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 887/1770] 10.222.0.81 () {54 vars in 921 bytes} [Mon Jul 18 16:50:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:50:34.345836 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b49b395-b520-4933-9b15-481b5e460449 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:34.345836 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b49b395-b520-4933-9b15-481b5e460449 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:34.345836 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b49b395-b520-4933-9b15-481b5e460449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:34.409539 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-6b49b395-b520-4933-9b15-481b5e460449 None None] MFA Rules not processed for user `07f0c5bf1bee48a0bafdf7a9e4537c70`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:34.410831 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-6b49b395-b520-4933-9b15-481b5e460449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:34.663815 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 884/1771] 10.222.0.81 () {58 vars in 1018 bytes} [Mon Jul 18 16:50:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:50:35.397251 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:35.816940 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace3f13b-1ce0-4aa1-ab0f-9e05f5eb2b39 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:35.870546 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace3f13b-1ce0-4aa1-ab0f-9e05f5eb2b39 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:35.913632 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4004e739-6286-4600-9466-e23875ecef7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07f0c5bf1bee48a0bafdf7a9e4537c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:35.918420 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004e739-6286-4600-9466-e23875ecef7e service nova] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:35.919012 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004e739-6286-4600-9466-e23875ecef7e service nova] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:35.919673 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004e739-6286-4600-9466-e23875ecef7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:35.948585 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4004e739-6286-4600-9466-e23875ecef7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:35.951865 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4004e739-6286-4600-9466-e23875ecef7e service nova] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:35.986352 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 888/1772] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:50:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:50:36.318458 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b49b395-b520-4933-9b15-481b5e460449 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:36.433733 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb812b-7c47-498b-9ac1-559d6ce203ba None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:36.434225 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb812b-7c47-498b-9ac1-559d6ce203ba None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:36.434674 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb812b-7c47-498b-9ac1-559d6ce203ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:36.499242 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-5afb812b-7c47-498b-9ac1-559d6ce203ba None None] MFA Rules not processed for user `512342c273bb4299ad5fc29e69b5aeb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:36.504280 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-5afb812b-7c47-498b-9ac1-559d6ce203ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:36.706899 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b49b395-b520-4933-9b15-481b5e460449 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:36.757357 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d83fa-420e-402f-b0a4-f5b0c2547c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:36.758281 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d83fa-420e-402f-b0a4-f5b0c2547c85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:36.758572 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d83fa-420e-402f-b0a4-f5b0c2547c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:36.758848 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d83fa-420e-402f-b0a4-f5b0c2547c85 admin admin] PATH_INFO: `/v3/users/d7132dab10ad4585b1239d22d25f6cbf` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:36.762957 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8d83fa-420e-402f-b0a4-f5b0c2547c85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7132dab10ad4585b1239d22d25f6cbf)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:36.768743 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 889/1773] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:50:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:50:36.780758 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8d83fa-420e-402f-b0a4-f5b0c2547c85 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:36.875148 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:37.092604 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-4e8d83fa-420e-402f-b0a4-f5b0c2547c85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7132dab10ad4585b1239d22d25f6cbf'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:37.174197 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-4e8d83fa-420e-402f-b0a4-f5b0c2547c85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7132dab10ad4585b1239d22d25f6cbf'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:37.177477 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-4e8d83fa-420e-402f-b0a4-f5b0c2547c85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7132dab10ad4585b1239d22d25f6cbf'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:37.206454 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-4e8d83fa-420e-402f-b0a4-f5b0c2547c85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7132dab10ad4585b1239d22d25f6cbf'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:37.304061 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-4e8d83fa-420e-402f-b0a4-f5b0c2547c85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7132dab10ad4585b1239d22d25f6cbf'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:37.341341 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 885/1774] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 16:50:36 2022] DELETE /identity/v3/users/d7132dab10ad4585b1239d22d25f6cbf => generated 0 bytes in 1023 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:50:37.347111 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57052f-7253-4b7b-82d9-4aca74a28538 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:37.347920 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57052f-7253-4b7b-82d9-4aca74a28538 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:37.348718 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57052f-7253-4b7b-82d9-4aca74a28538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:37.412468 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:37.418003 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-2f57052f-7253-4b7b-82d9-4aca74a28538 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:37.430550 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-2f57052f-7253-4b7b-82d9-4aca74a28538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:37.651984 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 890/1775] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:50:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:50:37.713054 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d83fa-420e-402f-b0a4-f5b0c2547c85 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:37.715662 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-4e8d83fa-420e-402f-b0a4-f5b0c2547c85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:37.930366 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d83fa-420e-402f-b0a4-f5b0c2547c85 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:37.938730 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df39820e-62a4-49bb-ad06-c840d6dc131e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:37.943882 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39820e-62a4-49bb-ad06-c840d6dc131e service neutron] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:37.944523 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39820e-62a4-49bb-ad06-c840d6dc131e service neutron] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:37.945050 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39820e-62a4-49bb-ad06-c840d6dc131e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:37.966789 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df39820e-62a4-49bb-ad06-c840d6dc131e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:37.971920 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df39820e-62a4-49bb-ad06-c840d6dc131e service neutron] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:37.988415 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 886/1776] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:50:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:50:38.643961 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:38.684196 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1f0ee-d027-41b3-a798-c55654ab3fde None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:38.684479 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1f0ee-d027-41b3-a798-c55654ab3fde None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:38.684950 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1f0ee-d027-41b3-a798-c55654ab3fde None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:38.686868 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 891/1777] 10.222.0.81 () {54 vars in 921 bytes} [Mon Jul 18 16:50:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:50:38.744583 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23704271-c166-4048-94ff-e8ccfe138524 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:38.745178 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23704271-c166-4048-94ff-e8ccfe138524 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:38.745178 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23704271-c166-4048-94ff-e8ccfe138524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:38.800653 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-23704271-c166-4048-94ff-e8ccfe138524 None None] MFA Rules not processed for user `07f0c5bf1bee48a0bafdf7a9e4537c70`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:38.812199 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d1fa9-947e-4655-a3c3-b7f4f75606b8 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:38.812504 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d1fa9-947e-4655-a3c3-b7f4f75606b8 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:38.812774 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d1fa9-947e-4655-a3c3-b7f4f75606b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:38.833562 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-23704271-c166-4048-94ff-e8ccfe138524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:38.943481 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-003d1fa9-947e-4655-a3c3-b7f4f75606b8 None None] MFA Rules not processed for user `fe7394e622a44ebdb0a2e10276f3354a`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:38.944786 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-003d1fa9-947e-4655-a3c3-b7f4f75606b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:39.015881 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 887/1778] 10.222.0.81 () {58 vars in 1018 bytes} [Mon Jul 18 16:50:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:50:39.184484 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 892/1779] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:50:38 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:50:39.186485 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29176c4-a9f1-4e34-b267-d8fb9ee8695d None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:39.187243 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29176c4-a9f1-4e34-b267-d8fb9ee8695d None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:39.187672 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29176c4-a9f1-4e34-b267-d8fb9ee8695d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:39.270105 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-c29176c4-a9f1-4e34-b267-d8fb9ee8695d None None] MFA Rules not processed for user `af422e904a394f31b6c3285f4ad79c30`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:39.273411 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-c29176c4-a9f1-4e34-b267-d8fb9ee8695d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:39.458502 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:39.544716 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 888/1780] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:50:39 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:50:39.749180 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003d1fa9-947e-4655-a3c3-b7f4f75606b8 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:39.750818 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-003d1fa9-947e-4655-a3c3-b7f4f75606b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:39.772537 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003d1fa9-947e-4655-a3c3-b7f4f75606b8 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:39.790065 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d450f758-d538-4f32-9281-aaf8b6f978fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:39.792144 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d450f758-d538-4f32-9281-aaf8b6f978fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:39.792618 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d450f758-d538-4f32-9281-aaf8b6f978fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:39.793054 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d450f758-d538-4f32-9281-aaf8b6f978fe admin admin] PATH_INFO: `/v3/users/21bfd9cd7f734ce5aa407159f1e7f69d` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:39.795303 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d450f758-d538-4f32-9281-aaf8b6f978fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=21bfd9cd7f734ce5aa407159f1e7f69d)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:39.799288 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d450f758-d538-4f32-9281-aaf8b6f978fe admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:39.838195 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29176c4-a9f1-4e34-b267-d8fb9ee8695d None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:39.839597 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-c29176c4-a9f1-4e34-b267-d8fb9ee8695d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:39.889285 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29176c4-a9f1-4e34-b267-d8fb9ee8695d None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:39.899804 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067e326b-2d5e-410f-a051-552db1620680 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07f0c5bf1bee48a0bafdf7a9e4537c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:39.903872 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e326b-2d5e-410f-a051-552db1620680 service nova] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:39.903872 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e326b-2d5e-410f-a051-552db1620680 service nova] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:39.903872 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e326b-2d5e-410f-a051-552db1620680 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:39.917983 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067e326b-2d5e-410f-a051-552db1620680 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:39.919946 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067e326b-2d5e-410f-a051-552db1620680 service nova] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:39.993196 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 889/1781] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:50:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:50:40.131048 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-d450f758-d538-4f32-9281-aaf8b6f978fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21bfd9cd7f734ce5aa407159f1e7f69d'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:40.135018 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-d450f758-d538-4f32-9281-aaf8b6f978fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21bfd9cd7f734ce5aa407159f1e7f69d'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:40.190624 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-d450f758-d538-4f32-9281-aaf8b6f978fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21bfd9cd7f734ce5aa407159f1e7f69d'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:40.358017 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-d450f758-d538-4f32-9281-aaf8b6f978fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21bfd9cd7f734ce5aa407159f1e7f69d'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:40.388029 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-d450f758-d538-4f32-9281-aaf8b6f978fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21bfd9cd7f734ce5aa407159f1e7f69d'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:40.407050 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 893/1782] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 16:50:39 2022] DELETE /identity/v3/users/21bfd9cd7f734ce5aa407159f1e7f69d => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:50:40.412860 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e9b7be-4f53-48b6-9a60-129dabd564e3 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:40.413427 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e9b7be-4f53-48b6-9a60-129dabd564e3 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:40.413913 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e9b7be-4f53-48b6-9a60-129dabd564e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:40.440526 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-f4e9b7be-4f53-48b6-9a60-129dabd564e3 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:40.442344 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-f4e9b7be-4f53-48b6-9a60-129dabd564e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:40.500986 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:40.520606 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d450f758-d538-4f32-9281-aaf8b6f978fe admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:40.522250 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-d450f758-d538-4f32-9281-aaf8b6f978fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:40.655833 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 890/1783] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:50:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:50:40.685005 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e9b7be-4f53-48b6-9a60-129dabd564e3 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:40.695817 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-f4e9b7be-4f53-48b6-9a60-129dabd564e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:40.811213 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d450f758-d538-4f32-9281-aaf8b6f978fe admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:40.852563 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8042d124-7cf2-479a-b581-e278f5bb4c64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07f0c5bf1bee48a0bafdf7a9e4537c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:40.853491 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8042d124-7cf2-479a-b581-e278f5bb4c64 service nova] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:40.853704 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8042d124-7cf2-479a-b581-e278f5bb4c64 service nova] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:40.856344 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8042d124-7cf2-479a-b581-e278f5bb4c64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:40.862570 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-8042d124-7cf2-479a-b581-e278f5bb4c64 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:40.927332 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e9b7be-4f53-48b6-9a60-129dabd564e3 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:40.956423 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a514a-b61c-42cc-8883-671d82cda551 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:40.960993 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a514a-b61c-42cc-8883-671d82cda551 service neutron] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:40.960993 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a514a-b61c-42cc-8883-671d82cda551 service neutron] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:40.960993 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a514a-b61c-42cc-8883-671d82cda551 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:40.985675 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946a514a-b61c-42cc-8883-671d82cda551 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:40.987373 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946a514a-b61c-42cc-8883-671d82cda551 service neutron] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:41.001007 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 891/1784] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:50:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 16:50:41.030206 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8042d124-7cf2-479a-b581-e278f5bb4c64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:41.032153 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8042d124-7cf2-479a-b581-e278f5bb4c64 service nova] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:41.043844 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 894/1785] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:50:40 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:50:41.501663 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:41.580698 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a514a-b61c-42cc-8883-671d82cda551 service neutron] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:41.582623 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-946a514a-b61c-42cc-8883-671d82cda551 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:41.630375 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a514a-b61c-42cc-8883-671d82cda551 service neutron] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:41.647071 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c419d9-d835-43d7-b85d-dec76b41a436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:41.648327 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c419d9-d835-43d7-b85d-dec76b41a436 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:41.648929 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c419d9-d835-43d7-b85d-dec76b41a436 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:41.651245 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c419d9-d835-43d7-b85d-dec76b41a436 admin admin] PATH_INFO: `/v3/projects/3b2148f3572345548bba391ed7c7ab9b` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:41.656574 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c419d9-d835-43d7-b85d-dec76b41a436 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b2148f3572345548bba391ed7c7ab9b)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:41.681121 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c419d9-d835-43d7-b85d-dec76b41a436 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:42.000524 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-32c419d9-d835-43d7-b85d-dec76b41a436 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b2148f3572345548bba391ed7c7ab9b', 'request_id': 'req-32c419d9-d835-43d7-b85d-dec76b41a436'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:42.018041 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-32c419d9-d835-43d7-b85d-dec76b41a436 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b2148f3572345548bba391ed7c7ab9b', 'request_id': 'req-32c419d9-d835-43d7-b85d-dec76b41a436'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:42.033746 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-32c419d9-d835-43d7-b85d-dec76b41a436 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b2148f3572345548bba391ed7c7ab9b', 'request_id': 'req-32c419d9-d835-43d7-b85d-dec76b41a436'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:42.164258 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-32c419d9-d835-43d7-b85d-dec76b41a436 admin admin] The token cache is being invalidate because project 3b2148f3572345548bba391ed7c7ab9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:50:42.164940 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-32c419d9-d835-43d7-b85d-dec76b41a436 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:42.165797 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-32c419d9-d835-43d7-b85d-dec76b41a436 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:42.172636 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8042d124-7cf2-479a-b581-e278f5bb4c64 service nova] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:42.173866 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 892/1786] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 16:50:41 2022] DELETE /identity/v3/projects/3b2148f3572345548bba391ed7c7ab9b => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:50:42.185346 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8042d124-7cf2-479a-b581-e278f5bb4c64 service nova] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:42.283998 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2125028d-759f-4bfc-be99-3986317e1a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:42.285223 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125028d-759f-4bfc-be99-3986317e1a59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:42.287804 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125028d-759f-4bfc-be99-3986317e1a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:42.288012 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125028d-759f-4bfc-be99-3986317e1a59 admin admin] PATH_INFO: `/v3/users/542a3533a6e44525ba0b98a134fc51f9` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:42.291784 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2125028d-759f-4bfc-be99-3986317e1a59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=542a3533a6e44525ba0b98a134fc51f9)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:42.296732 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2125028d-759f-4bfc-be99-3986317e1a59 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:42.547762 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-2125028d-759f-4bfc-be99-3986317e1a59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '542a3533a6e44525ba0b98a134fc51f9'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:42.557887 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-2125028d-759f-4bfc-be99-3986317e1a59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '542a3533a6e44525ba0b98a134fc51f9'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:42.566721 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:42.602539 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-2125028d-759f-4bfc-be99-3986317e1a59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '542a3533a6e44525ba0b98a134fc51f9'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:42.669519 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:42.709193 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-2125028d-759f-4bfc-be99-3986317e1a59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '542a3533a6e44525ba0b98a134fc51f9'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:42.728216 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-2125028d-759f-4bfc-be99-3986317e1a59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '542a3533a6e44525ba0b98a134fc51f9'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:42.749484 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 895/1787] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 16:50:42 2022] DELETE /identity/v3/users/542a3533a6e44525ba0b98a134fc51f9 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:50:42.811525 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c419d9-d835-43d7-b85d-dec76b41a436 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:42.813093 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-32c419d9-d835-43d7-b85d-dec76b41a436 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:42.838327 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c419d9-d835-43d7-b85d-dec76b41a436 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:43.053466 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d73f0e-9bd8-4708-a702-d3cc144b90de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:43.053466 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d73f0e-9bd8-4708-a702-d3cc144b90de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:43.054254 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d73f0e-9bd8-4708-a702-d3cc144b90de admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:43.054254 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d73f0e-9bd8-4708-a702-d3cc144b90de admin admin] PATH_INFO: `/v3/projects/a04a6ee2c45b46e89130b9d6e2a3cfa4` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:43.055159 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d73f0e-9bd8-4708-a702-d3cc144b90de admin admin] RBAC: Authorizing `identity:delete_project(project_id=a04a6ee2c45b46e89130b9d6e2a3cfa4)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:43.057802 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d73f0e-9bd8-4708-a702-d3cc144b90de admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:43.312335 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-77d73f0e-9bd8-4708-a702-d3cc144b90de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a04a6ee2c45b46e89130b9d6e2a3cfa4', 'request_id': 'req-77d73f0e-9bd8-4708-a702-d3cc144b90de'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:43.321059 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-77d73f0e-9bd8-4708-a702-d3cc144b90de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a04a6ee2c45b46e89130b9d6e2a3cfa4', 'request_id': 'req-77d73f0e-9bd8-4708-a702-d3cc144b90de'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:43.352101 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-77d73f0e-9bd8-4708-a702-d3cc144b90de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a04a6ee2c45b46e89130b9d6e2a3cfa4', 'request_id': 'req-77d73f0e-9bd8-4708-a702-d3cc144b90de'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:43.649470 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-77d73f0e-9bd8-4708-a702-d3cc144b90de admin admin] The token cache is being invalidate because project a04a6ee2c45b46e89130b9d6e2a3cfa4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:50:43.649818 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-77d73f0e-9bd8-4708-a702-d3cc144b90de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:43.650949 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-77d73f0e-9bd8-4708-a702-d3cc144b90de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:43.654239 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 893/1788] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 16:50:42 2022] DELETE /identity/v3/projects/a04a6ee2c45b46e89130b9d6e2a3cfa4 => generated 0 bytes in 843 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:50:43.659731 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2125028d-759f-4bfc-be99-3986317e1a59 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:43.661586 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-2125028d-759f-4bfc-be99-3986317e1a59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:43.675333 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2125028d-759f-4bfc-be99-3986317e1a59 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:43.741866 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f0a6a-1add-4cce-9f2b-b5a95d9bfb12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:43.744427 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f0a6a-1add-4cce-9f2b-b5a95d9bfb12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:43.745370 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f0a6a-1add-4cce-9f2b-b5a95d9bfb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:43.745864 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f0a6a-1add-4cce-9f2b-b5a95d9bfb12 admin admin] PATH_INFO: `/v3/users/1c30a7bcfde04fccba4a96d02f2b62e5` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:43.747618 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858f0a6a-1add-4cce-9f2b-b5a95d9bfb12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c30a7bcfde04fccba4a96d02f2b62e5)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:43.751607 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858f0a6a-1add-4cce-9f2b-b5a95d9bfb12 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:44.049114 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-858f0a6a-1add-4cce-9f2b-b5a95d9bfb12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c30a7bcfde04fccba4a96d02f2b62e5'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:44.051960 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-858f0a6a-1add-4cce-9f2b-b5a95d9bfb12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c30a7bcfde04fccba4a96d02f2b62e5'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:44.080883 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-858f0a6a-1add-4cce-9f2b-b5a95d9bfb12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c30a7bcfde04fccba4a96d02f2b62e5'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:44.108475 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d73f0e-9bd8-4708-a702-d3cc144b90de admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:44.110138 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-77d73f0e-9bd8-4708-a702-d3cc144b90de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:44.141730 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d73f0e-9bd8-4708-a702-d3cc144b90de admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:44.147014 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b977c-35e3-443f-a331-95e29375235d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:44.148110 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b977c-35e3-443f-a331-95e29375235d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:44.148610 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b977c-35e3-443f-a331-95e29375235d admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:44.148727 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b977c-35e3-443f-a331-95e29375235d admin admin] PATH_INFO: `/v3/projects/d96d39095d41479e9a42b33761a582ee` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:44.151809 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1b977c-35e3-443f-a331-95e29375235d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d96d39095d41479e9a42b33761a582ee)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:44.153861 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1b977c-35e3-443f-a331-95e29375235d admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:44.161310 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-858f0a6a-1add-4cce-9f2b-b5a95d9bfb12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c30a7bcfde04fccba4a96d02f2b62e5'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:44.182236 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-858f0a6a-1add-4cce-9f2b-b5a95d9bfb12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c30a7bcfde04fccba4a96d02f2b62e5'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:44.203183 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 896/1789] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 16:50:43 2022] DELETE /identity/v3/users/1c30a7bcfde04fccba4a96d02f2b62e5 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:50:44.385556 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-4e1b977c-35e3-443f-a331-95e29375235d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd96d39095d41479e9a42b33761a582ee', 'request_id': 'req-4e1b977c-35e3-443f-a331-95e29375235d'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:44.391456 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-4e1b977c-35e3-443f-a331-95e29375235d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd96d39095d41479e9a42b33761a582ee', 'request_id': 'req-4e1b977c-35e3-443f-a331-95e29375235d'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:44.398328 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-4e1b977c-35e3-443f-a331-95e29375235d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd96d39095d41479e9a42b33761a582ee', 'request_id': 'req-4e1b977c-35e3-443f-a331-95e29375235d'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:44.517420 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-4e1b977c-35e3-443f-a331-95e29375235d admin admin] The token cache is being invalidate because project d96d39095d41479e9a42b33761a582ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:50:44.517904 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-4e1b977c-35e3-443f-a331-95e29375235d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:44.518542 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-4e1b977c-35e3-443f-a331-95e29375235d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:44.521573 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 894/1790] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 16:50:44 2022] DELETE /identity/v3/projects/d96d39095d41479e9a42b33761a582ee => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:50:44.526694 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70784daa-fe3a-48db-a5a3-f9d8b05307dc None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:44.526977 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70784daa-fe3a-48db-a5a3-f9d8b05307dc None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:44.527248 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70784daa-fe3a-48db-a5a3-f9d8b05307dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:44.549232 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-70784daa-fe3a-48db-a5a3-f9d8b05307dc None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:44.550512 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-70784daa-fe3a-48db-a5a3-f9d8b05307dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:44.619988 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 897/1791] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:50:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:50:44.622489 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc41be-24e0-48f3-a10f-8429e40dc756 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:44.622808 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc41be-24e0-48f3-a10f-8429e40dc756 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:44.623090 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc41be-24e0-48f3-a10f-8429e40dc756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:44.643416 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-cbfc41be-24e0-48f3-a10f-8429e40dc756 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:44.644851 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-cbfc41be-24e0-48f3-a10f-8429e40dc756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:44.653452 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 895/1792] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:50:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:50:44.657746 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70784daa-fe3a-48db-a5a3-f9d8b05307dc None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:44.668477 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70784daa-fe3a-48db-a5a3-f9d8b05307dc None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:44.673765 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be286b8-42fe-418d-80c8-3fc1e7cd13a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:44.683547 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be286b8-42fe-418d-80c8-3fc1e7cd13a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:44.683547 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be286b8-42fe-418d-80c8-3fc1e7cd13a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:44.683547 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be286b8-42fe-418d-80c8-3fc1e7cd13a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:44.683547 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be286b8-42fe-418d-80c8-3fc1e7cd13a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:50:44.683547 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be286b8-42fe-418d-80c8-3fc1e7cd13a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:44.683547 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be286b8-42fe-418d-80c8-3fc1e7cd13a9 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:44.693169 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 898/1793] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Jul 18 16:50:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:50:44.697850 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc41be-24e0-48f3-a10f-8429e40dc756 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:44.707585 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc41be-24e0-48f3-a10f-8429e40dc756 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:44.712243 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc19546a-000d-4729-b1c5-4f9172f9f623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:44.712980 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc19546a-000d-4729-b1c5-4f9172f9f623 admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:44.713266 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc19546a-000d-4729-b1c5-4f9172f9f623 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:44.713690 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc19546a-000d-4729-b1c5-4f9172f9f623 admin admin] PATH_INFO: `/v3/projects` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:44.714447 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc19546a-000d-4729-b1c5-4f9172f9f623 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:44.716426 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc19546a-000d-4729-b1c5-4f9172f9f623 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:44.886264 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be286b8-42fe-418d-80c8-3fc1e7cd13a9 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:44.888105 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-6be286b8-42fe-418d-80c8-3fc1e7cd13a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:44.897003 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 896/1794] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:50:44 2022] POST /identity/v3/projects => generated 379 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:50:44.902576 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc19546a-000d-4729-b1c5-4f9172f9f623 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:44.908957 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be286b8-42fe-418d-80c8-3fc1e7cd13a9 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:44.933475 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:44.977512 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc19546a-000d-4729-b1c5-4f9172f9f623 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:44.982985 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01ea789-3575-4e6e-8747-f89708a41ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:44.983672 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ea789-3575-4e6e-8747-f89708a41ace admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:44.983990 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ea789-3575-4e6e-8747-f89708a41ace admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:44.984404 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ea789-3575-4e6e-8747-f89708a41ace admin admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:44.985114 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01ea789-3575-4e6e-8747-f89708a41ace admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:44.987034 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01ea789-3575-4e6e-8747-f89708a41ace admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:44.991094 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ac4a2d-b6d7-40ea-9e81-73b4eb4a00cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:44.992755 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac4a2d-b6d7-40ea-9e81-73b4eb4a00cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:44.993052 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac4a2d-b6d7-40ea-9e81-73b4eb4a00cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:44.993392 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac4a2d-b6d7-40ea-9e81-73b4eb4a00cd admin admin] PATH_INFO: `/v3/projects/a89af1e6a71f490b85bec802d5364a73` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:44.994857 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ac4a2d-b6d7-40ea-9e81-73b4eb4a00cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a89af1e6a71f490b85bec802d5364a73)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:44.996846 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ac4a2d-b6d7-40ea-9e81-73b4eb4a00cd admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:45.069097 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 897/1795] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 16:50:44 2022] POST /identity/v3/users => generated 290 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:50:45.074418 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01ea789-3575-4e6e-8747-f89708a41ace admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:45.083875 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01ea789-3575-4e6e-8747-f89708a41ace admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:45.088988 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d501548d-d195-4893-b4c0-07d3835e38c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:45.089628 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501548d-d195-4893-b4c0-07d3835e38c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:45.089928 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501548d-d195-4893-b4c0-07d3835e38c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:45.090403 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501548d-d195-4893-b4c0-07d3835e38c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:45.090917 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d501548d-d195-4893-b4c0-07d3835e38c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:45.092568 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d501548d-d195-4893-b4c0-07d3835e38c1 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:45.106539 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 898/1796] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:50:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 16:50:45.107686 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d501548d-d195-4893-b4c0-07d3835e38c1 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:45.118005 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d501548d-d195-4893-b4c0-07d3835e38c1 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:45.121221 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-f0ac4a2d-b6d7-40ea-9e81-73b4eb4a00cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a89af1e6a71f490b85bec802d5364a73', 'request_id': 'req-f0ac4a2d-b6d7-40ea-9e81-73b4eb4a00cd'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:45.180049 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced73316-e498-4f1f-8630-be43f6b9067e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:45.180638 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced73316-e498-4f1f-8630-be43f6b9067e admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:45.180922 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced73316-e498-4f1f-8630-be43f6b9067e admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:45.181203 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced73316-e498-4f1f-8630-be43f6b9067e admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:45.182013 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced73316-e498-4f1f-8630-be43f6b9067e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:45.183613 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced73316-e498-4f1f-8630-be43f6b9067e admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:45.194606 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 899/1797] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:50:45 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 16:50:45.199438 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced73316-e498-4f1f-8630-be43f6b9067e admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:45.209284 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-f0ac4a2d-b6d7-40ea-9e81-73b4eb4a00cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a89af1e6a71f490b85bec802d5364a73', 'request_id': 'req-f0ac4a2d-b6d7-40ea-9e81-73b4eb4a00cd'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:45.209885 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced73316-e498-4f1f-8630-be43f6b9067e admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:45.214758 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2cd20f-3937-4acd-8bbd-8861b72b9839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:45.219532 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2cd20f-3937-4acd-8bbd-8861b72b9839 admin admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:45.219532 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2cd20f-3937-4acd-8bbd-8861b72b9839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:45.219532 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2cd20f-3937-4acd-8bbd-8861b72b9839 admin admin] PATH_INFO: `/v3/projects/382d5ae0e7ad4cf386b5b158fdb770a1/users/56852a8b9c654939add5720580cfb151/roles/ad3a2bc7b2094a4da1a95a143c8d9436` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:45.219860 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-f0ac4a2d-b6d7-40ea-9e81-73b4eb4a00cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a89af1e6a71f490b85bec802d5364a73', 'request_id': 'req-f0ac4a2d-b6d7-40ea-9e81-73b4eb4a00cd'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:45.228845 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-f0ac4a2d-b6d7-40ea-9e81-73b4eb4a00cd admin admin] The token cache is being invalidate because project a89af1e6a71f490b85bec802d5364a73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:50:45.229136 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-f0ac4a2d-b6d7-40ea-9e81-73b4eb4a00cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:45.229809 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-f0ac4a2d-b6d7-40ea-9e81-73b4eb4a00cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:45.231238 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2cd20f-3937-4acd-8bbd-8861b72b9839 admin admin] RBAC: Authorizing `identity:create_grant(project_id=382d5ae0e7ad4cf386b5b158fdb770a1, user_id=56852a8b9c654939add5720580cfb151, role_id=ad3a2bc7b2094a4da1a95a143c8d9436)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:45.231685 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 899/1798] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 16:50:44 2022] DELETE /identity/v3/projects/a89af1e6a71f490b85bec802d5364a73 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:50:45.234152 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2cd20f-3937-4acd-8bbd-8861b72b9839 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:45.236719 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5c802b-f5be-4316-9733-6e8aa6165c75 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:45.237043 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5c802b-f5be-4316-9733-6e8aa6165c75 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:45.237327 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5c802b-f5be-4316-9733-6e8aa6165c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:45.255459 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-8f5c802b-f5be-4316-9733-6e8aa6165c75 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:45.256829 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-8f5c802b-f5be-4316-9733-6e8aa6165c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:45.265534 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 900/1799] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:50:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:50:45.274646 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0ad97-9637-4123-88d0-8362e6bfec51 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:45.274934 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0ad97-9637-4123-88d0-8362e6bfec51 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:45.275854 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0ad97-9637-4123-88d0-8362e6bfec51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:45.293280 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-abf0ad97-9637-4123-88d0-8362e6bfec51 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:45.297414 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-abf0ad97-9637-4123-88d0-8362e6bfec51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:45.311911 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 901/1800] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:50:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:50:45.312929 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf0ad97-9637-4123-88d0-8362e6bfec51 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:45.332143 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 900/1801] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:50:45 2022] PUT /identity/v3/projects/382d5ae0e7ad4cf386b5b158fdb770a1/users/56852a8b9c654939add5720580cfb151/roles/ad3a2bc7b2094a4da1a95a143c8d9436 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:50:45.332244 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf0ad97-9637-4123-88d0-8362e6bfec51 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:45.342664 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b59f72-9868-4760-aa26-60bdf83ccd12 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:45.343208 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b59f72-9868-4760-aa26-60bdf83ccd12 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:45.343832 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b59f72-9868-4760-aa26-60bdf83ccd12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:45.456324 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-54b59f72-9868-4760-aa26-60bdf83ccd12 None None] MFA Rules not processed for user `56852a8b9c654939add5720580cfb151`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:45.461952 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-54b59f72-9868-4760-aa26-60bdf83ccd12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:45.498925 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba89abc-1c90-4f64-aa91-37d3f34e6353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:45.499610 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba89abc-1c90-4f64-aa91-37d3f34e6353 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:45.500590 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba89abc-1c90-4f64-aa91-37d3f34e6353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:45.500590 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba89abc-1c90-4f64-aa91-37d3f34e6353 admin admin] PATH_INFO: `/v3/domains` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:45.504170 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba89abc-1c90-4f64-aa91-37d3f34e6353 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:50:45.504170 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba89abc-1c90-4f64-aa91-37d3f34e6353 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:45.504170 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba89abc-1c90-4f64-aa91-37d3f34e6353 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:45.560079 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 902/1802] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Jul 18 16:50:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:50:45.565592 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba89abc-1c90-4f64-aa91-37d3f34e6353 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:45.610187 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba89abc-1c90-4f64-aa91-37d3f34e6353 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:45.618792 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 901/1803] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:50:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:50:45.619704 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b59f72-9868-4760-aa26-60bdf83ccd12 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:45.621734 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-54b59f72-9868-4760-aa26-60bdf83ccd12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:45.626048 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d996c192-b552-4083-9bee-5920ae5316a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:45.627353 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996c192-b552-4083-9bee-5920ae5316a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:45.627877 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996c192-b552-4083-9bee-5920ae5316a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:45.628349 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996c192-b552-4083-9bee-5920ae5316a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:45.629238 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d996c192-b552-4083-9bee-5920ae5316a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:45.631384 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d996c192-b552-4083-9bee-5920ae5316a0 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:45.642758 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b59f72-9868-4760-aa26-60bdf83ccd12 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:45.663977 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203adfc9-4e33-4238-a581-ec50f4c531f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:45.664404 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203adfc9-4e33-4238-a581-ec50f4c531f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:45.664690 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203adfc9-4e33-4238-a581-ec50f4c531f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:45.664968 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203adfc9-4e33-4238-a581-ec50f4c531f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:45.666240 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203adfc9-4e33-4238-a581-ec50f4c531f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:45.668212 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203adfc9-4e33-4238-a581-ec50f4c531f4 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:45.720004 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:45.788190 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 903/1804] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:50:45 2022] POST /identity/v3/projects => generated 363 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:50:45.789891 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d996c192-b552-4083-9bee-5920ae5316a0 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:45.834999 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 902/1805] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:50:45 2022] POST /identity/v3/projects => generated 379 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:50:45.836452 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203adfc9-4e33-4238-a581-ec50f4c531f4 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:45.876697 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:45.927443 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d996c192-b552-4083-9bee-5920ae5316a0 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:45.943762 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae39e818-79fa-485b-94d0-1d3d08863b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:45.944489 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39e818-79fa-485b-94d0-1d3d08863b52 admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:45.944966 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39e818-79fa-485b-94d0-1d3d08863b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:45.945253 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39e818-79fa-485b-94d0-1d3d08863b52 admin admin] PATH_INFO: `/v3/users` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:45.945999 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae39e818-79fa-485b-94d0-1d3d08863b52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:45.948667 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae39e818-79fa-485b-94d0-1d3d08863b52 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:45.957439 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203adfc9-4e33-4238-a581-ec50f4c531f4 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:45.963430 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf9d06-2e5b-4a60-90bb-4df6682cf6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:45.964168 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf9d06-2e5b-4a60-90bb-4df6682cf6b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:45.964451 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf9d06-2e5b-4a60-90bb-4df6682cf6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:45.964728 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf9d06-2e5b-4a60-90bb-4df6682cf6b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:45.965428 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cf9d06-2e5b-4a60-90bb-4df6682cf6b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:45.967375 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cf9d06-2e5b-4a60-90bb-4df6682cf6b9 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:46.030324 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 904/1806] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 16:50:45 2022] POST /identity/v3/users => generated 282 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:50:46.034177 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae39e818-79fa-485b-94d0-1d3d08863b52 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:46.044234 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae39e818-79fa-485b-94d0-1d3d08863b52 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:46.050235 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dc50ba-eea9-4cba-8f8d-1bdc604b1d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:46.050918 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc50ba-eea9-4cba-8f8d-1bdc604b1d6d admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:46.051208 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc50ba-eea9-4cba-8f8d-1bdc604b1d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:46.051487 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc50ba-eea9-4cba-8f8d-1bdc604b1d6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:46.052265 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dc50ba-eea9-4cba-8f8d-1bdc604b1d6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:46.053871 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dc50ba-eea9-4cba-8f8d-1bdc604b1d6d admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:46.054383 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 903/1807] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 16:50:45 2022] POST /identity/v3/users => generated 296 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:50:46.058387 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf9d06-2e5b-4a60-90bb-4df6682cf6b9 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:46.068457 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 905/1808] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 16:50:46.069396 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dc50ba-eea9-4cba-8f8d-1bdc604b1d6d admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:46.070464 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf9d06-2e5b-4a60-90bb-4df6682cf6b9 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:46.082875 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca657e25-0e60-40b7-9c71-5953ddf2cefd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:46.083573 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca657e25-0e60-40b7-9c71-5953ddf2cefd admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:46.083685 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dc50ba-eea9-4cba-8f8d-1bdc604b1d6d admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:46.083883 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca657e25-0e60-40b7-9c71-5953ddf2cefd admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:46.084169 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca657e25-0e60-40b7-9c71-5953ddf2cefd admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:46.085017 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca657e25-0e60-40b7-9c71-5953ddf2cefd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:46.087366 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca657e25-0e60-40b7-9c71-5953ddf2cefd admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:46.089965 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4972ce-1fa8-430a-89c9-529bb57502cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:46.090691 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4972ce-1fa8-430a-89c9-529bb57502cb admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:46.090977 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4972ce-1fa8-430a-89c9-529bb57502cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:46.091247 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4972ce-1fa8-430a-89c9-529bb57502cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:46.092072 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4972ce-1fa8-430a-89c9-529bb57502cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:46.093673 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4972ce-1fa8-430a-89c9-529bb57502cb admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:46.105779 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 904/1809] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 16:50:46.107500 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 906/1810] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:50:46.110749 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca657e25-0e60-40b7-9c71-5953ddf2cefd admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:46.111446 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4972ce-1fa8-430a-89c9-529bb57502cb admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:46.122017 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca657e25-0e60-40b7-9c71-5953ddf2cefd admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:46.126849 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4972ce-1fa8-430a-89c9-529bb57502cb admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:46.128978 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e4f055-eb8c-4b9b-be0c-dd7e2f1b3343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:46.131192 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4f055-eb8c-4b9b-be0c-dd7e2f1b3343 admin admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:46.131482 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4f055-eb8c-4b9b-be0c-dd7e2f1b3343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:46.131804 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4f055-eb8c-4b9b-be0c-dd7e2f1b3343 admin admin] PATH_INFO: `/v3/projects/4a7198a24afc40ea8c7126b05b16a80e/users/7572d549b874498cab8f0c8ce079c7db/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:46.132823 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86789534-3b90-4c58-87e0-9b8831d3a187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:46.133853 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86789534-3b90-4c58-87e0-9b8831d3a187 admin admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:46.134150 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86789534-3b90-4c58-87e0-9b8831d3a187 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:46.135046 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86789534-3b90-4c58-87e0-9b8831d3a187 admin admin] PATH_INFO: `/v3/projects/947130dadeab48279a851c5741aa94c2/users/2b1331df61de4a29bc81357a62a31f70/roles/ad3a2bc7b2094a4da1a95a143c8d9436` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:46.149886 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e4f055-eb8c-4b9b-be0c-dd7e2f1b3343 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a7198a24afc40ea8c7126b05b16a80e, user_id=7572d549b874498cab8f0c8ce079c7db, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:46.153729 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e4f055-eb8c-4b9b-be0c-dd7e2f1b3343 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:46.154428 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86789534-3b90-4c58-87e0-9b8831d3a187 admin admin] RBAC: Authorizing `identity:create_grant(project_id=947130dadeab48279a851c5741aa94c2, user_id=2b1331df61de4a29bc81357a62a31f70, role_id=ad3a2bc7b2094a4da1a95a143c8d9436)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:46.157201 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86789534-3b90-4c58-87e0-9b8831d3a187 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:46.308759 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 907/1811] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:50:46 2022] PUT /identity/v3/projects/947130dadeab48279a851c5741aa94c2/users/2b1331df61de4a29bc81357a62a31f70/roles/ad3a2bc7b2094a4da1a95a143c8d9436 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:50:46.309051 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 905/1812] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:50:46 2022] PUT /identity/v3/projects/4a7198a24afc40ea8c7126b05b16a80e/users/7572d549b874498cab8f0c8ce079c7db/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:50:46.313037 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86789534-3b90-4c58-87e0-9b8831d3a187 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:46.319147 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f57b15-cb26-400e-b318-b39652964baa None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:46.319444 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f57b15-cb26-400e-b318-b39652964baa None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:46.319794 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f57b15-cb26-400e-b318-b39652964baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:46.351730 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-f8f57b15-cb26-400e-b318-b39652964baa None None] MFA Rules not processed for user `2b1331df61de4a29bc81357a62a31f70`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:46.353218 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-f8f57b15-cb26-400e-b318-b39652964baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:46.391899 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86789534-3b90-4c58-87e0-9b8831d3a187 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:46.402495 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01651ce2-1d8b-4238-a3fe-cf60dadb7eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:46.403372 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01651ce2-1d8b-4238-a3fe-cf60dadb7eaf admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:46.403667 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01651ce2-1d8b-4238-a3fe-cf60dadb7eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:46.404017 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01651ce2-1d8b-4238-a3fe-cf60dadb7eaf admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:46.404823 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01651ce2-1d8b-4238-a3fe-cf60dadb7eaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:46.406748 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01651ce2-1d8b-4238-a3fe-cf60dadb7eaf admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:46.419604 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 908/1813] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:50:46.427978 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01651ce2-1d8b-4238-a3fe-cf60dadb7eaf admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:46.439741 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01651ce2-1d8b-4238-a3fe-cf60dadb7eaf admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:46.444851 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e8c31-246c-456f-a9d0-df9fa04a0c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:46.445766 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e8c31-246c-456f-a9d0-df9fa04a0c7c admin admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:46.446050 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e8c31-246c-456f-a9d0-df9fa04a0c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:46.446321 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e8c31-246c-456f-a9d0-df9fa04a0c7c admin admin] PATH_INFO: `/v3/projects/4a7198a24afc40ea8c7126b05b16a80e/users/7572d549b874498cab8f0c8ce079c7db/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:46.448705 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6e8c31-246c-456f-a9d0-df9fa04a0c7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a7198a24afc40ea8c7126b05b16a80e, user_id=7572d549b874498cab8f0c8ce079c7db, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:46.451434 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6e8c31-246c-456f-a9d0-df9fa04a0c7c admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:46.463763 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 909/1814] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:50:46 2022] PUT /identity/v3/projects/4a7198a24afc40ea8c7126b05b16a80e/users/7572d549b874498cab8f0c8ce079c7db/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:50:46.468443 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 906/1815] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:50:46 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:50:46.473945 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e8c31-246c-456f-a9d0-df9fa04a0c7c admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:46.474145 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882cf71-8100-46bb-9d9d-f27c534d236c None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:46.474418 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882cf71-8100-46bb-9d9d-f27c534d236c None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:46.475246 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882cf71-8100-46bb-9d9d-f27c534d236c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:46.510320 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-3882cf71-8100-46bb-9d9d-f27c534d236c None None] MFA Rules not processed for user `7572d549b874498cab8f0c8ce079c7db`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:46.522721 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-3882cf71-8100-46bb-9d9d-f27c534d236c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:46.573502 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e8c31-246c-456f-a9d0-df9fa04a0c7c admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:46.581874 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cfb3f8-0693-4036-b384-8fac56e7ba07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:46.591368 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cfb3f8-0693-4036-b384-8fac56e7ba07 admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:46.591368 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cfb3f8-0693-4036-b384-8fac56e7ba07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:46.591368 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cfb3f8-0693-4036-b384-8fac56e7ba07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:46.591368 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cfb3f8-0693-4036-b384-8fac56e7ba07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:46.591368 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cfb3f8-0693-4036-b384-8fac56e7ba07 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:46.601733 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 907/1816] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:50:46 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:50:46.614885 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882cf71-8100-46bb-9d9d-f27c534d236c None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:46.616538 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-3882cf71-8100-46bb-9d9d-f27c534d236c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:46.686074 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882cf71-8100-46bb-9d9d-f27c534d236c None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:46.696062 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4880d91-6719-46bd-8134-13f1905b50bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:46.696062 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4880d91-6719-46bd-8134-13f1905b50bc service cinder] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:46.696062 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4880d91-6719-46bd-8134-13f1905b50bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:46.696062 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4880d91-6719-46bd-8134-13f1905b50bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:46.709636 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 910/1817] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:50:46 2022] POST /identity/v3/projects => generated 367 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:50:46.714213 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cfb3f8-0693-4036-b384-8fac56e7ba07 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:46.714381 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4880d91-6719-46bd-8134-13f1905b50bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:46.720363 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4880d91-6719-46bd-8134-13f1905b50bc service cinder] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:46.732887 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 908/1818] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:50:46 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 16:50:46.807250 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cfb3f8-0693-4036-b384-8fac56e7ba07 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:46.816266 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f48ca8-91dc-467e-a29a-0edbf10dd1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:46.816706 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f48ca8-91dc-467e-a29a-0edbf10dd1e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:46.817089 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f48ca8-91dc-467e-a29a-0edbf10dd1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:46.817459 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f48ca8-91dc-467e-a29a-0edbf10dd1e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:46.818253 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f48ca8-91dc-467e-a29a-0edbf10dd1e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:46.820336 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f48ca8-91dc-467e-a29a-0edbf10dd1e8 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:46.872608 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=82,keystone:INSERT=3,keystone:DELETE=15 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:46.933337 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 911/1819] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 16:50:46 2022] POST /identity/v3/users => generated 290 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:50:46.937445 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4880d91-6719-46bd-8134-13f1905b50bc service cinder] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:46.948837 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4880d91-6719-46bd-8134-13f1905b50bc service cinder] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:46.953662 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513bdd4c-5b03-41a6-b764-3e3e81ce90d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:46.954340 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513bdd4c-5b03-41a6-b764-3e3e81ce90d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:46.954646 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513bdd4c-5b03-41a6-b764-3e3e81ce90d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:46.954921 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513bdd4c-5b03-41a6-b764-3e3e81ce90d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:46.955649 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513bdd4c-5b03-41a6-b764-3e3e81ce90d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:46.958004 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513bdd4c-5b03-41a6-b764-3e3e81ce90d4 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:46.970150 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 909/1820] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:50:46.981205 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f48ca8-91dc-467e-a29a-0edbf10dd1e8 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:46.993485 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f48ca8-91dc-467e-a29a-0edbf10dd1e8 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:47.002221 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacc5097-7c58-44a9-9f47-131b7975bfea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:47.003086 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc5097-7c58-44a9-9f47-131b7975bfea admin admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:47.003363 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc5097-7c58-44a9-9f47-131b7975bfea admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:47.003639 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc5097-7c58-44a9-9f47-131b7975bfea admin admin] PATH_INFO: `/v3/projects/e2ca84e4e7094367bdb06f11e82a80f9/users/b25fd317acad49b0af3c0494400c9537/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:47.027565 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacc5097-7c58-44a9-9f47-131b7975bfea admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2ca84e4e7094367bdb06f11e82a80f9, user_id=b25fd317acad49b0af3c0494400c9537, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:47.030539 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacc5097-7c58-44a9-9f47-131b7975bfea admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:47.101648 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 912/1821] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:50:46 2022] PUT /identity/v3/projects/e2ca84e4e7094367bdb06f11e82a80f9/users/b25fd317acad49b0af3c0494400c9537/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:50:47.105873 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513bdd4c-5b03-41a6-b764-3e3e81ce90d4 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:47.117208 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513bdd4c-5b03-41a6-b764-3e3e81ce90d4 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:47.184062 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6708f776-e9dc-4148-98e2-d808b92bdf54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:47.184742 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6708f776-e9dc-4148-98e2-d808b92bdf54 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:47.185087 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6708f776-e9dc-4148-98e2-d808b92bdf54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:47.185378 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6708f776-e9dc-4148-98e2-d808b92bdf54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:47.186107 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6708f776-e9dc-4148-98e2-d808b92bdf54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:47.187749 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6708f776-e9dc-4148-98e2-d808b92bdf54 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:47.198765 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 910/1822] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:50:47.203055 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacc5097-7c58-44a9-9f47-131b7975bfea admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:47.213335 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacc5097-7c58-44a9-9f47-131b7975bfea admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:47.218182 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf4fd4-d882-46e5-a6ec-671f3cbe894c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:47.219078 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf4fd4-d882-46e5-a6ec-671f3cbe894c admin admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:47.219358 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf4fd4-d882-46e5-a6ec-671f3cbe894c admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:47.219631 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf4fd4-d882-46e5-a6ec-671f3cbe894c admin admin] PATH_INFO: `/v3/projects/e2ca84e4e7094367bdb06f11e82a80f9/users/b25fd317acad49b0af3c0494400c9537/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:47.223222 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bf4fd4-d882-46e5-a6ec-671f3cbe894c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2ca84e4e7094367bdb06f11e82a80f9, user_id=b25fd317acad49b0af3c0494400c9537, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:47.224769 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bf4fd4-d882-46e5-a6ec-671f3cbe894c admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:47.236232 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 913/1823] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:50:47 2022] PUT /identity/v3/projects/e2ca84e4e7094367bdb06f11e82a80f9/users/b25fd317acad49b0af3c0494400c9537/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:50:47.247237 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b869164-1331-4e78-9e9a-15200c3b744b None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:47.247614 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b869164-1331-4e78-9e9a-15200c3b744b None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:47.248101 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b869164-1331-4e78-9e9a-15200c3b744b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:47.286689 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-0b869164-1331-4e78-9e9a-15200c3b744b None None] MFA Rules not processed for user `b25fd317acad49b0af3c0494400c9537`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:47.288452 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-0b869164-1331-4e78-9e9a-15200c3b744b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:47.372190 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 911/1824] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:50:47 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:50:47.557214 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf4fd4-d882-46e5-a6ec-671f3cbe894c admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:47.605132 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:47.614778 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf4fd4-d882-46e5-a6ec-671f3cbe894c admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:47.618438 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6458aab3-376a-4f7d-9fa2-0a35b073c488 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:47.619882 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458aab3-376a-4f7d-9fa2-0a35b073c488 service cinder] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:47.620102 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458aab3-376a-4f7d-9fa2-0a35b073c488 service cinder] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:47.620381 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458aab3-376a-4f7d-9fa2-0a35b073c488 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:47.630830 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6458aab3-376a-4f7d-9fa2-0a35b073c488 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:47.632333 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6458aab3-376a-4f7d-9fa2-0a35b073c488 service cinder] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:47.643520 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 914/1825] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:50:47 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:50:47.881576 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b869164-1331-4e78-9e9a-15200c3b744b None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:47.955574 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b869164-1331-4e78-9e9a-15200c3b744b None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:47.960006 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6458aab3-376a-4f7d-9fa2-0a35b073c488 service cinder] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:47.961687 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a23beac-ea76-43ca-9c45-c01d35fdb71c tempest-VolumeQuotaClassesTest-154970335 tempest-VolumeQuotaClassesTest-154970335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7572d549b874498cab8f0c8ce079c7db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7198a24afc40ea8c7126b05b16a80e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:47.962368 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23beac-ea76-43ca-9c45-c01d35fdb71c tempest-VolumeQuotaClassesTest-154970335 tempest-VolumeQuotaClassesTest-154970335-project-admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:47.963191 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23beac-ea76-43ca-9c45-c01d35fdb71c tempest-VolumeQuotaClassesTest-154970335 tempest-VolumeQuotaClassesTest-154970335-project-admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:47.963474 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23beac-ea76-43ca-9c45-c01d35fdb71c tempest-VolumeQuotaClassesTest-154970335 tempest-VolumeQuotaClassesTest-154970335-project-admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:47.964266 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a23beac-ea76-43ca-9c45-c01d35fdb71c tempest-VolumeQuotaClassesTest-154970335 tempest-VolumeQuotaClassesTest-154970335-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:50:47.964625 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a23beac-ea76-43ca-9c45-c01d35fdb71c tempest-VolumeQuotaClassesTest-154970335 tempest-VolumeQuotaClassesTest-154970335-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:47.966388 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a23beac-ea76-43ca-9c45-c01d35fdb71c tempest-VolumeQuotaClassesTest-154970335 tempest-VolumeQuotaClassesTest-154970335-project-admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:47.979675 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6458aab3-376a-4f7d-9fa2-0a35b073c488 service cinder] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:47.984330 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38682e3a-bca1-4413-a8f6-170059111245 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:47.984979 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 912/1826] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Jul 18 16:50:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:50:47.985732 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38682e3a-bca1-4413-a8f6-170059111245 service cinder] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:47.985897 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a23beac-ea76-43ca-9c45-c01d35fdb71c tempest-VolumeQuotaClassesTest-154970335 tempest-VolumeQuotaClassesTest-154970335-project-admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:47.986305 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38682e3a-bca1-4413-a8f6-170059111245 service cinder] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:47.986586 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38682e3a-bca1-4413-a8f6-170059111245 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:47.997252 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a23beac-ea76-43ca-9c45-c01d35fdb71c tempest-VolumeQuotaClassesTest-154970335 tempest-VolumeQuotaClassesTest-154970335-project-admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:48.003459 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac3492c-1c00-47ef-a7eb-823753a81d9b tempest-VolumeQuotaClassesTest-154970335 tempest-VolumeQuotaClassesTest-154970335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7572d549b874498cab8f0c8ce079c7db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7198a24afc40ea8c7126b05b16a80e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:48.004481 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3492c-1c00-47ef-a7eb-823753a81d9b tempest-VolumeQuotaClassesTest-154970335 tempest-VolumeQuotaClassesTest-154970335-project-admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:48.009932 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3492c-1c00-47ef-a7eb-823753a81d9b tempest-VolumeQuotaClassesTest-154970335 tempest-VolumeQuotaClassesTest-154970335-project-admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:48.009932 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3492c-1c00-47ef-a7eb-823753a81d9b tempest-VolumeQuotaClassesTest-154970335 tempest-VolumeQuotaClassesTest-154970335-project-admin] PATH_INFO: `/v3/projects` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:48.009932 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac3492c-1c00-47ef-a7eb-823753a81d9b tempest-VolumeQuotaClassesTest-154970335 tempest-VolumeQuotaClassesTest-154970335-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:48.009932 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac3492c-1c00-47ef-a7eb-823753a81d9b tempest-VolumeQuotaClassesTest-154970335 tempest-VolumeQuotaClassesTest-154970335-project-admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:48.060533 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38682e3a-bca1-4413-a8f6-170059111245 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:48.062020 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38682e3a-bca1-4413-a8f6-170059111245 service cinder] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:48.071310 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 915/1827] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:50:47 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:50:48.131314 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 913/1828] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:50:47 2022] POST /identity/v3/projects => generated 354 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:50:48.132664 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38682e3a-bca1-4413-a8f6-170059111245 service cinder] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:48.143933 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38682e3a-bca1-4413-a8f6-170059111245 service cinder] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:48.206596 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e817ab1-eb3a-4aac-9c0d-f9288c9184b5 tempest-VolumeQuotaClassesTest-154970335 tempest-VolumeQuotaClassesTest-154970335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7572d549b874498cab8f0c8ce079c7db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7198a24afc40ea8c7126b05b16a80e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:48.207266 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e817ab1-eb3a-4aac-9c0d-f9288c9184b5 tempest-VolumeQuotaClassesTest-154970335 tempest-VolumeQuotaClassesTest-154970335-project-admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:48.207550 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e817ab1-eb3a-4aac-9c0d-f9288c9184b5 tempest-VolumeQuotaClassesTest-154970335 tempest-VolumeQuotaClassesTest-154970335-project-admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:48.207861 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e817ab1-eb3a-4aac-9c0d-f9288c9184b5 tempest-VolumeQuotaClassesTest-154970335 tempest-VolumeQuotaClassesTest-154970335-project-admin] PATH_INFO: `/v3/domains` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:48.208591 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e817ab1-eb3a-4aac-9c0d-f9288c9184b5 tempest-VolumeQuotaClassesTest-154970335 tempest-VolumeQuotaClassesTest-154970335-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:50:48.208900 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e817ab1-eb3a-4aac-9c0d-f9288c9184b5 tempest-VolumeQuotaClassesTest-154970335 tempest-VolumeQuotaClassesTest-154970335-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:48.210649 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e817ab1-eb3a-4aac-9c0d-f9288c9184b5 tempest-VolumeQuotaClassesTest-154970335 tempest-VolumeQuotaClassesTest-154970335-project-admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:48.224411 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 916/1829] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Jul 18 16:50:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:50:48.276358 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac3492c-1c00-47ef-a7eb-823753a81d9b tempest-VolumeQuotaClassesTest-154970335 tempest-VolumeQuotaClassesTest-154970335-project-admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:48.286715 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac3492c-1c00-47ef-a7eb-823753a81d9b tempest-VolumeQuotaClassesTest-154970335 tempest-VolumeQuotaClassesTest-154970335-project-admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:48.292558 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa79c6-6cb2-4ab4-b59b-ae094b829d84 tempest-VolumeQuotaClassesTest-154970335 tempest-VolumeQuotaClassesTest-154970335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7572d549b874498cab8f0c8ce079c7db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7198a24afc40ea8c7126b05b16a80e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:48.293550 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa79c6-6cb2-4ab4-b59b-ae094b829d84 tempest-VolumeQuotaClassesTest-154970335 tempest-VolumeQuotaClassesTest-154970335-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:48.293894 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa79c6-6cb2-4ab4-b59b-ae094b829d84 tempest-VolumeQuotaClassesTest-154970335 tempest-VolumeQuotaClassesTest-154970335-project-admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:48.294237 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa79c6-6cb2-4ab4-b59b-ae094b829d84 tempest-VolumeQuotaClassesTest-154970335 tempest-VolumeQuotaClassesTest-154970335-project-admin] PATH_INFO: `/v3/projects/e70e58d8db754d5c801edb3ed79286f5` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:48.295508 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaa79c6-6cb2-4ab4-b59b-ae094b829d84 tempest-VolumeQuotaClassesTest-154970335 tempest-VolumeQuotaClassesTest-154970335-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e70e58d8db754d5c801edb3ed79286f5)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:48.297516 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaa79c6-6cb2-4ab4-b59b-ae094b829d84 tempest-VolumeQuotaClassesTest-154970335 tempest-VolumeQuotaClassesTest-154970335-project-admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:48.428141 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-3eaa79c6-6cb2-4ab4-b59b-ae094b829d84 tempest-VolumeQuotaClassesTest-154970335 tempest-VolumeQuotaClassesTest-154970335-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e70e58d8db754d5c801edb3ed79286f5', 'request_id': 'req-3eaa79c6-6cb2-4ab4-b59b-ae094b829d84'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:48.433830 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-3eaa79c6-6cb2-4ab4-b59b-ae094b829d84 tempest-VolumeQuotaClassesTest-154970335 tempest-VolumeQuotaClassesTest-154970335-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e70e58d8db754d5c801edb3ed79286f5', 'request_id': 'req-3eaa79c6-6cb2-4ab4-b59b-ae094b829d84'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:48.472438 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-3eaa79c6-6cb2-4ab4-b59b-ae094b829d84 tempest-VolumeQuotaClassesTest-154970335 tempest-VolumeQuotaClassesTest-154970335-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e70e58d8db754d5c801edb3ed79286f5', 'request_id': 'req-3eaa79c6-6cb2-4ab4-b59b-ae094b829d84'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:49.550101 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-3eaa79c6-6cb2-4ab4-b59b-ae094b829d84 tempest-VolumeQuotaClassesTest-154970335 tempest-VolumeQuotaClassesTest-154970335-project-admin] The token cache is being invalidate because project e70e58d8db754d5c801edb3ed79286f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:50:49.550101 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-3eaa79c6-6cb2-4ab4-b59b-ae094b829d84 tempest-VolumeQuotaClassesTest-154970335 tempest-VolumeQuotaClassesTest-154970335-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:49.550101 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-3eaa79c6-6cb2-4ab4-b59b-ae094b829d84 tempest-VolumeQuotaClassesTest-154970335 tempest-VolumeQuotaClassesTest-154970335-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:49.550101 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 914/1830] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 16:50:48 2022] DELETE /identity/v3/projects/e70e58d8db754d5c801edb3ed79286f5 => generated 0 bytes in 1273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:50:50.035172 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:50.468862 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e817ab1-eb3a-4aac-9c0d-f9288c9184b5 tempest-VolumeQuotaClassesTest-154970335 tempest-VolumeQuotaClassesTest-154970335-project-admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:50.470804 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-1e817ab1-eb3a-4aac-9c0d-f9288c9184b5 tempest-VolumeQuotaClassesTest-154970335 tempest-VolumeQuotaClassesTest-154970335-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:50.539571 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e817ab1-eb3a-4aac-9c0d-f9288c9184b5 tempest-VolumeQuotaClassesTest-154970335 tempest-VolumeQuotaClassesTest-154970335-project-admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:50.597588 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a610b4-dc31-4e9c-9b0c-858099d5d76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:50.598531 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a610b4-dc31-4e9c-9b0c-858099d5d76b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:50.598939 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a610b4-dc31-4e9c-9b0c-858099d5d76b admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:50.599130 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a610b4-dc31-4e9c-9b0c-858099d5d76b admin admin] PATH_INFO: `/v3/users/56852a8b9c654939add5720580cfb151` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:50.600426 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a610b4-dc31-4e9c-9b0c-858099d5d76b admin admin] RBAC: Authorizing `identity:delete_user(user_id=56852a8b9c654939add5720580cfb151)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:50.602396 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a610b4-dc31-4e9c-9b0c-858099d5d76b admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:50.874979 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:50.902330 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-b9a610b4-dc31-4e9c-9b0c-858099d5d76b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56852a8b9c654939add5720580cfb151'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:50.905379 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-b9a610b4-dc31-4e9c-9b0c-858099d5d76b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56852a8b9c654939add5720580cfb151'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:50.932082 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-b9a610b4-dc31-4e9c-9b0c-858099d5d76b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56852a8b9c654939add5720580cfb151'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:51.064826 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-b9a610b4-dc31-4e9c-9b0c-858099d5d76b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56852a8b9c654939add5720580cfb151'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:51.084738 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-b9a610b4-dc31-4e9c-9b0c-858099d5d76b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56852a8b9c654939add5720580cfb151'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:51.095759 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 917/1831] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 16:50:50 2022] DELETE /identity/v3/users/56852a8b9c654939add5720580cfb151 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:50:51.097662 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60691973-5813-472c-81ab-bcaec328b3ef None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:51.098129 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60691973-5813-472c-81ab-bcaec328b3ef None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:51.098724 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60691973-5813-472c-81ab-bcaec328b3ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:51.119286 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-60691973-5813-472c-81ab-bcaec328b3ef None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:51.120845 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-60691973-5813-472c-81ab-bcaec328b3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:51.194263 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 915/1832] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:50:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:50:51.205310 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a610b4-dc31-4e9c-9b0c-858099d5d76b admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:51.206805 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-b9a610b4-dc31-4e9c-9b0c-858099d5d76b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:51.282229 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a610b4-dc31-4e9c-9b0c-858099d5d76b admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:51.286252 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db956774-c7ff-42cc-8f39-53396c02f3bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:51.287136 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db956774-c7ff-42cc-8f39-53396c02f3bb service neutron] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:51.287519 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db956774-c7ff-42cc-8f39-53396c02f3bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:51.287914 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db956774-c7ff-42cc-8f39-53396c02f3bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:51.299372 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db956774-c7ff-42cc-8f39-53396c02f3bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:51.301186 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db956774-c7ff-42cc-8f39-53396c02f3bb service neutron] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:51.314281 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 918/1833] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:50:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:50:51.641330 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60691973-5813-472c-81ab-bcaec328b3ef None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:51.645212 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:51.646505 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-60691973-5813-472c-81ab-bcaec328b3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:51.663921 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60691973-5813-472c-81ab-bcaec328b3ef None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:51.670131 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829e5705-48e8-4581-bdd1-f49b570b2f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:51.671531 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e5705-48e8-4581-bdd1-f49b570b2f25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:51.678978 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e5705-48e8-4581-bdd1-f49b570b2f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:51.678978 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e5705-48e8-4581-bdd1-f49b570b2f25 admin admin] PATH_INFO: `/v3/users/50eadc00829142d58d10d0e65c2bb812` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:51.678978 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829e5705-48e8-4581-bdd1-f49b570b2f25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50eadc00829142d58d10d0e65c2bb812)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:51.678978 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829e5705-48e8-4581-bdd1-f49b570b2f25 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:51.914017 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-829e5705-48e8-4581-bdd1-f49b570b2f25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50eadc00829142d58d10d0e65c2bb812'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:51.927431 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-829e5705-48e8-4581-bdd1-f49b570b2f25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50eadc00829142d58d10d0e65c2bb812'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:51.928192 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-829e5705-48e8-4581-bdd1-f49b570b2f25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50eadc00829142d58d10d0e65c2bb812'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:51.936035 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-829e5705-48e8-4581-bdd1-f49b570b2f25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50eadc00829142d58d10d0e65c2bb812'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:52.046692 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-829e5705-48e8-4581-bdd1-f49b570b2f25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50eadc00829142d58d10d0e65c2bb812'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:52.058688 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 916/1834] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 16:50:51 2022] DELETE /identity/v3/users/50eadc00829142d58d10d0e65c2bb812 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:50:52.069668 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583e4f8-9297-4c24-b5ff-5088806d8404 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:52.070202 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583e4f8-9297-4c24-b5ff-5088806d8404 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:52.071163 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583e4f8-9297-4c24-b5ff-5088806d8404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:52.112098 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-e583e4f8-9297-4c24-b5ff-5088806d8404 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:52.113367 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-e583e4f8-9297-4c24-b5ff-5088806d8404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:52.219216 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 919/1835] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:50:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:50:52.235150 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829e5705-48e8-4581-bdd1-f49b570b2f25 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:52.237626 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-829e5705-48e8-4581-bdd1-f49b570b2f25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:52.256243 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e583e4f8-9297-4c24-b5ff-5088806d8404 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:52.258787 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-e583e4f8-9297-4c24-b5ff-5088806d8404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:52.286341 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e583e4f8-9297-4c24-b5ff-5088806d8404 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:52.302835 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adc19ec-45d4-42c5-8aa8-b61b556c6086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:52.303940 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc19ec-45d4-42c5-8aa8-b61b556c6086 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:52.304181 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc19ec-45d4-42c5-8aa8-b61b556c6086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:52.304604 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc19ec-45d4-42c5-8aa8-b61b556c6086 admin admin] PATH_INFO: `/v3/projects/382d5ae0e7ad4cf386b5b158fdb770a1` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:52.315644 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adc19ec-45d4-42c5-8aa8-b61b556c6086 admin admin] RBAC: Authorizing `identity:delete_project(project_id=382d5ae0e7ad4cf386b5b158fdb770a1)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:52.319867 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adc19ec-45d4-42c5-8aa8-b61b556c6086 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:52.419528 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829e5705-48e8-4581-bdd1-f49b570b2f25 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:52.428425 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cbb22b-4efa-4038-bb61-8b5a4cbc1a8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:52.430119 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cbb22b-4efa-4038-bb61-8b5a4cbc1a8f service neutron] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:52.430616 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cbb22b-4efa-4038-bb61-8b5a4cbc1a8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:52.431044 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cbb22b-4efa-4038-bb61-8b5a4cbc1a8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:52.444798 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cbb22b-4efa-4038-bb61-8b5a4cbc1a8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:52.446503 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cbb22b-4efa-4038-bb61-8b5a4cbc1a8f service neutron] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:52.463460 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 917/1836] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:50:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:50:52.519837 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-2adc19ec-45d4-42c5-8aa8-b61b556c6086 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '382d5ae0e7ad4cf386b5b158fdb770a1', 'request_id': 'req-2adc19ec-45d4-42c5-8aa8-b61b556c6086'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:52.575686 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-2adc19ec-45d4-42c5-8aa8-b61b556c6086 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '382d5ae0e7ad4cf386b5b158fdb770a1', 'request_id': 'req-2adc19ec-45d4-42c5-8aa8-b61b556c6086'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:52.583626 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-2adc19ec-45d4-42c5-8aa8-b61b556c6086 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '382d5ae0e7ad4cf386b5b158fdb770a1', 'request_id': 'req-2adc19ec-45d4-42c5-8aa8-b61b556c6086'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:52.601817 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-2adc19ec-45d4-42c5-8aa8-b61b556c6086 admin admin] The token cache is being invalidate because project 382d5ae0e7ad4cf386b5b158fdb770a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:50:52.602170 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-2adc19ec-45d4-42c5-8aa8-b61b556c6086 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:52.602972 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-2adc19ec-45d4-42c5-8aa8-b61b556c6086 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:52.614394 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 920/1837] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 16:50:52 2022] DELETE /identity/v3/projects/382d5ae0e7ad4cf386b5b158fdb770a1 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:50:52.614603 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cbb22b-4efa-4038-bb61-8b5a4cbc1a8f service neutron] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:52.621138 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cbb22b-4efa-4038-bb61-8b5a4cbc1a8f service neutron] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:52.691206 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3cc696-9b61-4165-bc32-c25ec83ae99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:52.692248 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3cc696-9b61-4165-bc32-c25ec83ae99d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:52.692536 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3cc696-9b61-4165-bc32-c25ec83ae99d admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:52.692816 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3cc696-9b61-4165-bc32-c25ec83ae99d admin admin] PATH_INFO: `/v3/users/7572d549b874498cab8f0c8ce079c7db` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:52.694113 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3cc696-9b61-4165-bc32-c25ec83ae99d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7572d549b874498cab8f0c8ce079c7db)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:52.696386 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3cc696-9b61-4165-bc32-c25ec83ae99d admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:53.016652 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-7b3cc696-9b61-4165-bc32-c25ec83ae99d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7572d549b874498cab8f0c8ce079c7db'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:53.034717 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-7b3cc696-9b61-4165-bc32-c25ec83ae99d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7572d549b874498cab8f0c8ce079c7db'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:53.035558 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-7b3cc696-9b61-4165-bc32-c25ec83ae99d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7572d549b874498cab8f0c8ce079c7db'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:53.045651 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-7b3cc696-9b61-4165-bc32-c25ec83ae99d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7572d549b874498cab8f0c8ce079c7db'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:53.172197 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-7b3cc696-9b61-4165-bc32-c25ec83ae99d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7572d549b874498cab8f0c8ce079c7db'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:53.180032 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 918/1838] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 16:50:52 2022] DELETE /identity/v3/users/7572d549b874498cab8f0c8ce079c7db => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:50:53.631464 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4efe9f-8b0e-4427-a62d-89c6debb70d3 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:53.632006 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4efe9f-8b0e-4427-a62d-89c6debb70d3 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:53.632853 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4efe9f-8b0e-4427-a62d-89c6debb70d3 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:53.633432 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 921/1839] 10.222.0.81 () {54 vars in 921 bytes} [Mon Jul 18 16:50:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:50:53.651392 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc82ef68-4f4f-44e1-add0-8ec46d805bc8 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:53.652368 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc82ef68-4f4f-44e1-add0-8ec46d805bc8 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:53.652801 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc82ef68-4f4f-44e1-add0-8ec46d805bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:53.695235 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-fc82ef68-4f4f-44e1-add0-8ec46d805bc8 None None] MFA Rules not processed for user `07f0c5bf1bee48a0bafdf7a9e4537c70`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:53.696933 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-fc82ef68-4f4f-44e1-add0-8ec46d805bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:53.830804 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 919/1840] 10.222.0.81 () {58 vars in 1018 bytes} [Mon Jul 18 16:50:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:50:53.849449 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4efe9f-8b0e-4427-a62d-89c6debb70d3 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:53.851412 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-bf4efe9f-8b0e-4427-a62d-89c6debb70d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:53.966046 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc82ef68-4f4f-44e1-add0-8ec46d805bc8 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:53.967465 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-fc82ef68-4f4f-44e1-add0-8ec46d805bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:53.974796 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4efe9f-8b0e-4427-a62d-89c6debb70d3 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:53.988918 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc6f095-1827-45ee-8ef2-3443ae65c5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:53.989900 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6f095-1827-45ee-8ef2-3443ae65c5fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:53.990248 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6f095-1827-45ee-8ef2-3443ae65c5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:53.990590 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6f095-1827-45ee-8ef2-3443ae65c5fc admin admin] PATH_INFO: `/v3/projects/4f1a1a20d4a8420eaa48d6d3b50dcd30` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:53.991919 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc6f095-1827-45ee-8ef2-3443ae65c5fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f1a1a20d4a8420eaa48d6d3b50dcd30)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:53.992071 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc82ef68-4f4f-44e1-add0-8ec46d805bc8 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:53.994468 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc6f095-1827-45ee-8ef2-3443ae65c5fc admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:53.998471 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b58a75-d8f4-4c4a-9f18-3f835428936f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07f0c5bf1bee48a0bafdf7a9e4537c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:53.999138 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b58a75-d8f4-4c4a-9f18-3f835428936f service nova] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:53.999420 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b58a75-d8f4-4c4a-9f18-3f835428936f service nova] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:53.999696 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b58a75-d8f4-4c4a-9f18-3f835428936f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:54.012823 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b58a75-d8f4-4c4a-9f18-3f835428936f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:54.015035 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b58a75-d8f4-4c4a-9f18-3f835428936f service nova] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:54.042433 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 920/1841] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:50:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:50:54.079327 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b58a75-d8f4-4c4a-9f18-3f835428936f service nova] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:54.080990 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-72b58a75-d8f4-4c4a-9f18-3f835428936f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:54.099918 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b58a75-d8f4-4c4a-9f18-3f835428936f service nova] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:54.109581 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f2f710-17b2-4799-8f48-f2fd626647d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:54.110557 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2f710-17b2-4799-8f48-f2fd626647d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:54.110912 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2f710-17b2-4799-8f48-f2fd626647d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:54.111259 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2f710-17b2-4799-8f48-f2fd626647d8 admin admin] PATH_INFO: `/v3/projects/4a7198a24afc40ea8c7126b05b16a80e` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:54.113682 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f2f710-17b2-4799-8f48-f2fd626647d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a7198a24afc40ea8c7126b05b16a80e)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:54.130429 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f2f710-17b2-4799-8f48-f2fd626647d8 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:54.161010 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-efc6f095-1827-45ee-8ef2-3443ae65c5fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f1a1a20d4a8420eaa48d6d3b50dcd30', 'request_id': 'req-efc6f095-1827-45ee-8ef2-3443ae65c5fc'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:54.249094 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-efc6f095-1827-45ee-8ef2-3443ae65c5fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f1a1a20d4a8420eaa48d6d3b50dcd30', 'request_id': 'req-efc6f095-1827-45ee-8ef2-3443ae65c5fc'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:54.257474 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-efc6f095-1827-45ee-8ef2-3443ae65c5fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f1a1a20d4a8420eaa48d6d3b50dcd30', 'request_id': 'req-efc6f095-1827-45ee-8ef2-3443ae65c5fc'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:54.271994 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-efc6f095-1827-45ee-8ef2-3443ae65c5fc admin admin] The token cache is being invalidate because project 4f1a1a20d4a8420eaa48d6d3b50dcd30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:50:54.272629 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-efc6f095-1827-45ee-8ef2-3443ae65c5fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:54.273519 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-efc6f095-1827-45ee-8ef2-3443ae65c5fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:54.276313 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 922/1842] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 16:50:53 2022] DELETE /identity/v3/projects/4f1a1a20d4a8420eaa48d6d3b50dcd30 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:50:54.279971 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc6f095-1827-45ee-8ef2-3443ae65c5fc admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:54.281842 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-efc6f095-1827-45ee-8ef2-3443ae65c5fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:54.331460 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-93f2f710-17b2-4799-8f48-f2fd626647d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a7198a24afc40ea8c7126b05b16a80e', 'request_id': 'req-93f2f710-17b2-4799-8f48-f2fd626647d8'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:54.348547 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-93f2f710-17b2-4799-8f48-f2fd626647d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a7198a24afc40ea8c7126b05b16a80e', 'request_id': 'req-93f2f710-17b2-4799-8f48-f2fd626647d8'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:54.355374 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-93f2f710-17b2-4799-8f48-f2fd626647d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a7198a24afc40ea8c7126b05b16a80e', 'request_id': 'req-93f2f710-17b2-4799-8f48-f2fd626647d8'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:54.364917 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc6f095-1827-45ee-8ef2-3443ae65c5fc admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:54.398638 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:54.430661 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f00e9f-3a94-4b66-bc48-91c7180f58ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:54.431571 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f00e9f-3a94-4b66-bc48-91c7180f58ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:54.431886 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f00e9f-3a94-4b66-bc48-91c7180f58ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:54.432164 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f00e9f-3a94-4b66-bc48-91c7180f58ec admin admin] PATH_INFO: `/v3/users/3188e9dd12cc4c7db9e3a6fe011c1a09` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:54.433375 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f00e9f-3a94-4b66-bc48-91c7180f58ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=3188e9dd12cc4c7db9e3a6fe011c1a09)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:54.435291 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f00e9f-3a94-4b66-bc48-91c7180f58ec admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:54.481406 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:54.486363 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-93f2f710-17b2-4799-8f48-f2fd626647d8 admin admin] The token cache is being invalidate because project 4a7198a24afc40ea8c7126b05b16a80e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:50:54.486655 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-93f2f710-17b2-4799-8f48-f2fd626647d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:54.487300 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-93f2f710-17b2-4799-8f48-f2fd626647d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:54.488983 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 921/1843] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 16:50:54 2022] DELETE /identity/v3/projects/4a7198a24afc40ea8c7126b05b16a80e => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:50:54.495211 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee7414-8b8b-4d69-b6b7-e0c8dde67262 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:54.495398 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee7414-8b8b-4d69-b6b7-e0c8dde67262 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:54.495674 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee7414-8b8b-4d69-b6b7-e0c8dde67262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:54.514016 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-38ee7414-8b8b-4d69-b6b7-e0c8dde67262 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:54.515207 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-38ee7414-8b8b-4d69-b6b7-e0c8dde67262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:54.533239 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 922/1844] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:50:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:50:54.539351 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db148e-1ab2-4f9b-90a2-cf98795cae7b None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:54.539639 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db148e-1ab2-4f9b-90a2-cf98795cae7b None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:54.539942 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db148e-1ab2-4f9b-90a2-cf98795cae7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:54.558216 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-b8db148e-1ab2-4f9b-90a2-cf98795cae7b None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:54.559435 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-b8db148e-1ab2-4f9b-90a2-cf98795cae7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:54.567339 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 923/1845] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:50:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:50:54.571249 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db148e-1ab2-4f9b-90a2-cf98795cae7b None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:54.580799 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db148e-1ab2-4f9b-90a2-cf98795cae7b None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:54.585444 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc0eb79-9bf5-43d5-b993-1a37a2ba9683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:54.586088 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0eb79-9bf5-43d5-b993-1a37a2ba9683 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:54.586378 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0eb79-9bf5-43d5-b993-1a37a2ba9683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:54.586661 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0eb79-9bf5-43d5-b993-1a37a2ba9683 admin admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:54.587385 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc0eb79-9bf5-43d5-b993-1a37a2ba9683 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:50:54.587766 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc0eb79-9bf5-43d5-b993-1a37a2ba9683 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:54.589310 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc0eb79-9bf5-43d5-b993-1a37a2ba9683 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:54.600650 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 924/1846] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Jul 18 16:50:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:50:54.606071 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc0eb79-9bf5-43d5-b993-1a37a2ba9683 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:54.616253 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc0eb79-9bf5-43d5-b993-1a37a2ba9683 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:54.621665 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4060b2-f59a-4276-a9bc-24e2e62c7b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:54.622358 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4060b2-f59a-4276-a9bc-24e2e62c7b3f admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:54.622650 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4060b2-f59a-4276-a9bc-24e2e62c7b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:54.622931 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4060b2-f59a-4276-a9bc-24e2e62c7b3f admin admin] PATH_INFO: `/v3/projects` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:54.623628 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4060b2-f59a-4276-a9bc-24e2e62c7b3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:54.625634 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4060b2-f59a-4276-a9bc-24e2e62c7b3f admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:54.686278 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-f9f00e9f-3a94-4b66-bc48-91c7180f58ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3188e9dd12cc4c7db9e3a6fe011c1a09'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:54.687036 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-f9f00e9f-3a94-4b66-bc48-91c7180f58ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3188e9dd12cc4c7db9e3a6fe011c1a09'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:54.702245 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-f9f00e9f-3a94-4b66-bc48-91c7180f58ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3188e9dd12cc4c7db9e3a6fe011c1a09'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:54.708046 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 925/1847] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:50:54 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:50:54.712177 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4060b2-f59a-4276-a9bc-24e2e62c7b3f admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:54.782285 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4060b2-f59a-4276-a9bc-24e2e62c7b3f admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:54.787145 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec58f11-80b9-4c7e-820e-28436b2a5131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:54.788206 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec58f11-80b9-4c7e-820e-28436b2a5131 admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:54.788497 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec58f11-80b9-4c7e-820e-28436b2a5131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:54.788780 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec58f11-80b9-4c7e-820e-28436b2a5131 admin admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:54.789621 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec58f11-80b9-4c7e-820e-28436b2a5131 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:54.790216 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-f9f00e9f-3a94-4b66-bc48-91c7180f58ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3188e9dd12cc4c7db9e3a6fe011c1a09'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:54.791585 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec58f11-80b9-4c7e-820e-28436b2a5131 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:54.810979 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-f9f00e9f-3a94-4b66-bc48-91c7180f58ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3188e9dd12cc4c7db9e3a6fe011c1a09'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:54.819542 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 923/1848] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 16:50:54 2022] DELETE /identity/v3/users/3188e9dd12cc4c7db9e3a6fe011c1a09 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:50:54.927374 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 926/1849] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 16:50:54 2022] POST /identity/v3/users => generated 293 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:50:54.931528 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f00e9f-3a94-4b66-bc48-91c7180f58ec admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:54.932958 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-f9f00e9f-3a94-4b66-bc48-91c7180f58ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:55.005704 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f00e9f-3a94-4b66-bc48-91c7180f58ec admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:55.010986 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef1f9ff-8a3a-42fd-8b2d-d12cfdff7bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:55.011606 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1f9ff-8a3a-42fd-8b2d-d12cfdff7bc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:55.011936 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1f9ff-8a3a-42fd-8b2d-d12cfdff7bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:55.012215 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1f9ff-8a3a-42fd-8b2d-d12cfdff7bc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:55.012948 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef1f9ff-8a3a-42fd-8b2d-d12cfdff7bc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:55.015338 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef1f9ff-8a3a-42fd-8b2d-d12cfdff7bc0 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:55.026847 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 924/1850] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:50:54 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 16:50:55.030965 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec58f11-80b9-4c7e-820e-28436b2a5131 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:55.041953 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec58f11-80b9-4c7e-820e-28436b2a5131 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:55.046677 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f215de-f377-4118-afb6-c19cb7ae0bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:55.047378 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f215de-f377-4118-afb6-c19cb7ae0bae admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:55.047660 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f215de-f377-4118-afb6-c19cb7ae0bae admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:55.047971 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f215de-f377-4118-afb6-c19cb7ae0bae admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:55.048704 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f215de-f377-4118-afb6-c19cb7ae0bae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:55.050552 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f215de-f377-4118-afb6-c19cb7ae0bae admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:55.068829 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 927/1851] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:50:55 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:50:55.074258 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef1f9ff-8a3a-42fd-8b2d-d12cfdff7bc0 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:55.088091 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef1f9ff-8a3a-42fd-8b2d-d12cfdff7bc0 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:55.094304 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b9a116-44f6-4ec6-9b92-07f0c641456a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:55.095410 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9a116-44f6-4ec6-9b92-07f0c641456a admin admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:55.095735 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9a116-44f6-4ec6-9b92-07f0c641456a admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:55.096065 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9a116-44f6-4ec6-9b92-07f0c641456a admin admin] PATH_INFO: `/v3/projects/c6d773e8c7e24d9682412fa86ac90c8a/users/b14e882dfd7b407f9a4b53cca9656cac/roles/ad3a2bc7b2094a4da1a95a143c8d9436` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:55.130252 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b9a116-44f6-4ec6-9b92-07f0c641456a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6d773e8c7e24d9682412fa86ac90c8a, user_id=b14e882dfd7b407f9a4b53cca9656cac, role_id=ad3a2bc7b2094a4da1a95a143c8d9436)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:55.133016 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b9a116-44f6-4ec6-9b92-07f0c641456a admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:55.240484 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 925/1852] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:50:55 2022] PUT /identity/v3/projects/c6d773e8c7e24d9682412fa86ac90c8a/users/b14e882dfd7b407f9a4b53cca9656cac/roles/ad3a2bc7b2094a4da1a95a143c8d9436 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:50:55.251756 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb2f3c-68b3-43ac-bfb6-6c0715509149 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:55.252299 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb2f3c-68b3-43ac-bfb6-6c0715509149 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:55.252629 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb2f3c-68b3-43ac-bfb6-6c0715509149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:55.282382 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-8afb2f3c-68b3-43ac-bfb6-6c0715509149 None None] MFA Rules not processed for user `b14e882dfd7b407f9a4b53cca9656cac`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:55.283584 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-8afb2f3c-68b3-43ac-bfb6-6c0715509149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:55.334185 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b9a116-44f6-4ec6-9b92-07f0c641456a admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:55.336247 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-80b9a116-44f6-4ec6-9b92-07f0c641456a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:55.381962 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 928/1853] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:50:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:50:55.387970 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afb2f3c-68b3-43ac-bfb6-6c0715509149 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:55.485382 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b9a116-44f6-4ec6-9b92-07f0c641456a admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:55.490147 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6134ad9-83b6-45a8-aac7-5c7b1c7fbb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:55.491014 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6134ad9-83b6-45a8-aac7-5c7b1c7fbb4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:55.491296 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6134ad9-83b6-45a8-aac7-5c7b1c7fbb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:55.491560 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6134ad9-83b6-45a8-aac7-5c7b1c7fbb4f admin admin] PATH_INFO: `/v3/projects/d8515b5ade7d4e289c576a4cd2a451a6` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:55.492861 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6134ad9-83b6-45a8-aac7-5c7b1c7fbb4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8515b5ade7d4e289c576a4cd2a451a6)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:55.495459 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6134ad9-83b6-45a8-aac7-5c7b1c7fbb4f admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:55.508967 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afb2f3c-68b3-43ac-bfb6-6c0715509149 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:55.519258 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f34690-89bb-49da-b0be-859b0b81f021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:55.520045 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f34690-89bb-49da-b0be-859b0b81f021 admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:55.520325 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f34690-89bb-49da-b0be-859b0b81f021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:55.520600 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f34690-89bb-49da-b0be-859b0b81f021 admin admin] PATH_INFO: `/v3/projects` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:55.521647 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f34690-89bb-49da-b0be-859b0b81f021 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:55.523773 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f34690-89bb-49da-b0be-859b0b81f021 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:55.639944 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-d6134ad9-83b6-45a8-aac7-5c7b1c7fbb4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8515b5ade7d4e289c576a4cd2a451a6', 'request_id': 'req-d6134ad9-83b6-45a8-aac7-5c7b1c7fbb4f'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:55.650001 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 929/1854] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:50:55 2022] POST /identity/v3/projects => generated 387 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:50:55.651679 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f34690-89bb-49da-b0be-859b0b81f021 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:55.721704 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f34690-89bb-49da-b0be-859b0b81f021 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:55.726380 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3fb186-1fa2-4e84-a490-f8f73d18b6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:55.727055 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3fb186-1fa2-4e84-a490-f8f73d18b6cd admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:55.727337 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3fb186-1fa2-4e84-a490-f8f73d18b6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:55.727607 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3fb186-1fa2-4e84-a490-f8f73d18b6cd admin admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:55.729011 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3fb186-1fa2-4e84-a490-f8f73d18b6cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:55.732915 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3fb186-1fa2-4e84-a490-f8f73d18b6cd admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:55.733554 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-d6134ad9-83b6-45a8-aac7-5c7b1c7fbb4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8515b5ade7d4e289c576a4cd2a451a6', 'request_id': 'req-d6134ad9-83b6-45a8-aac7-5c7b1c7fbb4f'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:55.741837 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-d6134ad9-83b6-45a8-aac7-5c7b1c7fbb4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8515b5ade7d4e289c576a4cd2a451a6', 'request_id': 'req-d6134ad9-83b6-45a8-aac7-5c7b1c7fbb4f'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:55.754834 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-d6134ad9-83b6-45a8-aac7-5c7b1c7fbb4f admin admin] The token cache is being invalidate because project d8515b5ade7d4e289c576a4cd2a451a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:50:55.755467 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-d6134ad9-83b6-45a8-aac7-5c7b1c7fbb4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:55.756206 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-d6134ad9-83b6-45a8-aac7-5c7b1c7fbb4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:55.761439 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 926/1855] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 16:50:55 2022] DELETE /identity/v3/projects/d8515b5ade7d4e289c576a4cd2a451a6 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:50:55.763452 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae81c4f-ff7a-47b9-8d7a-10975953dc9d None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:55.763920 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae81c4f-ff7a-47b9-8d7a-10975953dc9d None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:55.764335 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae81c4f-ff7a-47b9-8d7a-10975953dc9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:55.785636 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-8ae81c4f-ff7a-47b9-8d7a-10975953dc9d None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:55.789041 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-8ae81c4f-ff7a-47b9-8d7a-10975953dc9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:55.798949 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 927/1856] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:50:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:50:55.807283 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74caedd8-18c3-4188-ba49-67222cfa9db5 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:55.807579 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74caedd8-18c3-4188-ba49-67222cfa9db5 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:55.808090 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74caedd8-18c3-4188-ba49-67222cfa9db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:55.825749 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-74caedd8-18c3-4188-ba49-67222cfa9db5 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:55.826926 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-74caedd8-18c3-4188-ba49-67222cfa9db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:55.835248 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 928/1857] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:50:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:50:55.839483 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74caedd8-18c3-4188-ba49-67222cfa9db5 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:55.852521 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 930/1858] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 16:50:55 2022] POST /identity/v3/users => generated 300 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:50:55.852711 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74caedd8-18c3-4188-ba49-67222cfa9db5 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:55.854193 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3fb186-1fa2-4e84-a490-f8f73d18b6cd admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:55.855502 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb2a67-464d-4bf3-8b87-77cf852bbf14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:55.855783 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-0f3fb186-1fa2-4e84-a490-f8f73d18b6cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:55.856252 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb2a67-464d-4bf3-8b87-77cf852bbf14 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:55.856537 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb2a67-464d-4bf3-8b87-77cf852bbf14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:55.856816 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb2a67-464d-4bf3-8b87-77cf852bbf14 admin admin] PATH_INFO: `/v3/domains` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:55.857548 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efb2a67-464d-4bf3-8b87-77cf852bbf14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:50:55.857857 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efb2a67-464d-4bf3-8b87-77cf852bbf14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:55.859451 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efb2a67-464d-4bf3-8b87-77cf852bbf14 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:55.867972 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3fb186-1fa2-4e84-a490-f8f73d18b6cd admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:55.872149 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 929/1859] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Jul 18 16:50:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:50:55.876255 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb2a67-464d-4bf3-8b87-77cf852bbf14 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:55.877079 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c2aeef-6098-40eb-aa89-ca14648f41c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:55.877788 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c2aeef-6098-40eb-aa89-ca14648f41c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:55.878095 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c2aeef-6098-40eb-aa89-ca14648f41c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:55.878367 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c2aeef-6098-40eb-aa89-ca14648f41c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:55.879150 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c2aeef-6098-40eb-aa89-ca14648f41c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:55.884295 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c2aeef-6098-40eb-aa89-ca14648f41c5 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:55.889181 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb2a67-464d-4bf3-8b87-77cf852bbf14 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:55.893351 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 931/1860] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:50:55 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:50:55.894193 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de218e68-f4be-47ca-8e46-e385e4f133b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:55.894858 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de218e68-f4be-47ca-8e46-e385e4f133b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:55.895146 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de218e68-f4be-47ca-8e46-e385e4f133b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:55.895487 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de218e68-f4be-47ca-8e46-e385e4f133b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:55.896215 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de218e68-f4be-47ca-8e46-e385e4f133b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:55.897504 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c2aeef-6098-40eb-aa89-ca14648f41c5 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:55.898193 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de218e68-f4be-47ca-8e46-e385e4f133b7 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:55.914543 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c2aeef-6098-40eb-aa89-ca14648f41c5 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:55.917237 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f1fa6a-b4dc-4281-a1dc-5ec02a346a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:55.918974 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1fa6a-b4dc-4281-a1dc-5ec02a346a84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:55.919258 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1fa6a-b4dc-4281-a1dc-5ec02a346a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:55.919544 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1fa6a-b4dc-4281-a1dc-5ec02a346a84 admin admin] PATH_INFO: `/v3/projects/ecd029a98ffd463ebd1e4f2b3f9d036b/users/72490d726eb54cc2890fb210678b1c41/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:55.936714 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f1fa6a-b4dc-4281-a1dc-5ec02a346a84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecd029a98ffd463ebd1e4f2b3f9d036b, user_id=72490d726eb54cc2890fb210678b1c41, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:55.939692 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f1fa6a-b4dc-4281-a1dc-5ec02a346a84 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:55.977871 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:56.039043 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 930/1861] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:50:55 2022] POST /identity/v3/projects => generated 401 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:50:56.040041 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de218e68-f4be-47ca-8e46-e385e4f133b7 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:56.075938 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 932/1862] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:50:55 2022] PUT /identity/v3/projects/ecd029a98ffd463ebd1e4f2b3f9d036b/users/72490d726eb54cc2890fb210678b1c41/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:50:56.079490 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f1fa6a-b4dc-4281-a1dc-5ec02a346a84 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:56.176122 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de218e68-f4be-47ca-8e46-e385e4f133b7 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:56.199256 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f1fa6a-b4dc-4281-a1dc-5ec02a346a84 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:56.210546 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31846a9-b696-46cf-b65e-b1302df9f564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:56.214882 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31846a9-b696-46cf-b65e-b1302df9f564 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:56.215429 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31846a9-b696-46cf-b65e-b1302df9f564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:56.217969 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31846a9-b696-46cf-b65e-b1302df9f564 admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:56.219035 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31846a9-b696-46cf-b65e-b1302df9f564 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:56.224248 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31846a9-b696-46cf-b65e-b1302df9f564 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:56.241294 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 933/1863] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:50:56 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:50:56.242665 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31846a9-b696-46cf-b65e-b1302df9f564 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:56.257243 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31846a9-b696-46cf-b65e-b1302df9f564 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:56.267959 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda436cd-b04c-41e5-a7d4-254797288b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:56.268871 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda436cd-b04c-41e5-a7d4-254797288b81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:56.269154 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda436cd-b04c-41e5-a7d4-254797288b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:56.269432 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda436cd-b04c-41e5-a7d4-254797288b81 admin admin] PATH_INFO: `/v3/projects/ecd029a98ffd463ebd1e4f2b3f9d036b/users/72490d726eb54cc2890fb210678b1c41/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:56.274349 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda436cd-b04c-41e5-a7d4-254797288b81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecd029a98ffd463ebd1e4f2b3f9d036b, user_id=72490d726eb54cc2890fb210678b1c41, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:56.277624 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda436cd-b04c-41e5-a7d4-254797288b81 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:56.294435 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe1eac-3158-450f-9215-51150f6a6dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:56.296221 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe1eac-3158-450f-9215-51150f6a6dfb admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:56.296676 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe1eac-3158-450f-9215-51150f6a6dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:56.297101 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe1eac-3158-450f-9215-51150f6a6dfb admin admin] PATH_INFO: `/v3/users` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:56.300211 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbe1eac-3158-450f-9215-51150f6a6dfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:56.303014 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbe1eac-3158-450f-9215-51150f6a6dfb admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:56.324538 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 934/1864] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:50:56 2022] PUT /identity/v3/projects/ecd029a98ffd463ebd1e4f2b3f9d036b/users/72490d726eb54cc2890fb210678b1c41/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:50:56.326324 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef23cf0-cf24-4a31-a4d1-a99438889118 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:56.330889 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef23cf0-cf24-4a31-a4d1-a99438889118 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:56.330889 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef23cf0-cf24-4a31-a4d1-a99438889118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:56.372940 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-fef23cf0-cf24-4a31-a4d1-a99438889118 None None] MFA Rules not processed for user `72490d726eb54cc2890fb210678b1c41`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:56.376723 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-fef23cf0-cf24-4a31-a4d1-a99438889118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:56.378938 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 931/1865] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 16:50:56 2022] POST /identity/v3/users => generated 301 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:50:56.383458 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe1eac-3158-450f-9215-51150f6a6dfb admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:56.405085 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe1eac-3158-450f-9215-51150f6a6dfb admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:56.505979 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c47649-4d7d-415b-9bab-627fc7ed0cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:56.506668 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c47649-4d7d-415b-9bab-627fc7ed0cfd admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:56.506953 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c47649-4d7d-415b-9bab-627fc7ed0cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:56.507230 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c47649-4d7d-415b-9bab-627fc7ed0cfd admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:56.508609 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c47649-4d7d-415b-9bab-627fc7ed0cfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:56.510883 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c47649-4d7d-415b-9bab-627fc7ed0cfd admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:56.517074 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 935/1866] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:50:56 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:50:56.530551 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef23cf0-cf24-4a31-a4d1-a99438889118 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:56.532925 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-fef23cf0-cf24-4a31-a4d1-a99438889118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:56.535767 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 932/1867] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:50:56 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 16:50:56.539324 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c47649-4d7d-415b-9bab-627fc7ed0cfd admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:56.567046 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c47649-4d7d-415b-9bab-627fc7ed0cfd admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:56.581170 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6cc8b0-f794-4aa1-b3de-9f68d2cf5986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:56.582000 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6cc8b0-f794-4aa1-b3de-9f68d2cf5986 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:56.582405 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6cc8b0-f794-4aa1-b3de-9f68d2cf5986 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:56.582796 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6cc8b0-f794-4aa1-b3de-9f68d2cf5986 admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:56.584350 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6cc8b0-f794-4aa1-b3de-9f68d2cf5986 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:56.586174 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6cc8b0-f794-4aa1-b3de-9f68d2cf5986 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:56.606565 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 933/1868] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:50:56 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:50:56.608382 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6cc8b0-f794-4aa1-b3de-9f68d2cf5986 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:56.621099 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef23cf0-cf24-4a31-a4d1-a99438889118 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:56.623020 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6cc8b0-f794-4aa1-b3de-9f68d2cf5986 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:56.625157 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a84b76-a27b-4c5c-a4e8-49dfe4e9e917 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:56.626173 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a84b76-a27b-4c5c-a4e8-49dfe4e9e917 service cinder] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:56.626173 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a84b76-a27b-4c5c-a4e8-49dfe4e9e917 service cinder] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:56.626656 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a84b76-a27b-4c5c-a4e8-49dfe4e9e917 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:56.629136 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8307a6-0304-4ea3-a01d-95eeb8879ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:56.631800 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8307a6-0304-4ea3-a01d-95eeb8879ed0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:56.631800 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8307a6-0304-4ea3-a01d-95eeb8879ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:56.631800 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8307a6-0304-4ea3-a01d-95eeb8879ed0 admin admin] PATH_INFO: `/v3/projects/53d2d328aa374c489bf6173f2918b30c/users/899c0ca26b774dcd95d2b9b88600ffaf/roles/ad3a2bc7b2094a4da1a95a143c8d9436` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:56.641596 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a84b76-a27b-4c5c-a4e8-49dfe4e9e917 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:56.643792 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a84b76-a27b-4c5c-a4e8-49dfe4e9e917 service cinder] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:56.651260 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8307a6-0304-4ea3-a01d-95eeb8879ed0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53d2d328aa374c489bf6173f2918b30c, user_id=899c0ca26b774dcd95d2b9b88600ffaf, role_id=ad3a2bc7b2094a4da1a95a143c8d9436)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:56.654950 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8307a6-0304-4ea3-a01d-95eeb8879ed0 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:56.655598 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 936/1869] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:50:56 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:50:56.775929 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 934/1870] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:50:56 2022] PUT /identity/v3/projects/53d2d328aa374c489bf6173f2918b30c/users/899c0ca26b774dcd95d2b9b88600ffaf/roles/ad3a2bc7b2094a4da1a95a143c8d9436 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:50:56.791286 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842d857-ec45-4945-aa89-a8f2e32ff1ef None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:56.792045 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842d857-ec45-4945-aa89-a8f2e32ff1ef None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:56.792470 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842d857-ec45-4945-aa89-a8f2e32ff1ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:56.857321 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-c842d857-ec45-4945-aa89-a8f2e32ff1ef None None] MFA Rules not processed for user `899c0ca26b774dcd95d2b9b88600ffaf`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:56.858901 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-c842d857-ec45-4945-aa89-a8f2e32ff1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:56.965510 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 937/1871] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:50:56 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:50:56.968337 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8307a6-0304-4ea3-a01d-95eeb8879ed0 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:57.071182 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8307a6-0304-4ea3-a01d-95eeb8879ed0 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:57.085008 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b182e392-0d58-4b91-acf8-34827ec78556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:57.085867 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182e392-0d58-4b91-acf8-34827ec78556 admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:57.086331 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182e392-0d58-4b91-acf8-34827ec78556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:57.086723 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182e392-0d58-4b91-acf8-34827ec78556 admin admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:57.087356 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b182e392-0d58-4b91-acf8-34827ec78556 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:57.090753 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b182e392-0d58-4b91-acf8-34827ec78556 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:57.206356 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 935/1872] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:50:56 2022] POST /identity/v3/projects => generated 399 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:50:57.227517 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c842d857-ec45-4945-aa89-a8f2e32ff1ef None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:57.240964 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c842d857-ec45-4945-aa89-a8f2e32ff1ef None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:57.325906 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257af34c-55ad-488a-9f9b-61ec9047e5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:57.326607 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257af34c-55ad-488a-9f9b-61ec9047e5cb admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:57.327043 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257af34c-55ad-488a-9f9b-61ec9047e5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:57.327329 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257af34c-55ad-488a-9f9b-61ec9047e5cb admin admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:57.331182 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257af34c-55ad-488a-9f9b-61ec9047e5cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:57.331519 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257af34c-55ad-488a-9f9b-61ec9047e5cb admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:57.457987 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 938/1873] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 16:50:57 2022] POST /identity/v3/users => generated 306 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:50:57.461885 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b182e392-0d58-4b91-acf8-34827ec78556 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:57.505415 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b182e392-0d58-4b91-acf8-34827ec78556 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:57.523943 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b02b600-3736-45a5-a616-3a2cea1307db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:57.523943 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02b600-3736-45a5-a616-3a2cea1307db admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:57.523943 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02b600-3736-45a5-a616-3a2cea1307db admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:57.523943 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02b600-3736-45a5-a616-3a2cea1307db admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:57.524385 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b02b600-3736-45a5-a616-3a2cea1307db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:57.524385 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b02b600-3736-45a5-a616-3a2cea1307db admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:57.541732 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 936/1874] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:50:57 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:50:57.543029 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257af34c-55ad-488a-9f9b-61ec9047e5cb admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:57.553542 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257af34c-55ad-488a-9f9b-61ec9047e5cb admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:57.559773 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82af653-7c2c-43e8-b3a9-c874335cfcc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:57.560608 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82af653-7c2c-43e8-b3a9-c874335cfcc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:57.561051 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82af653-7c2c-43e8-b3a9-c874335cfcc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:57.561461 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82af653-7c2c-43e8-b3a9-c874335cfcc7 admin admin] PATH_INFO: `/v3/projects/670a70375c3d4b598e25d3d8f5d03cec/users/4febdf4d533047beb05d6d6e25f43a50/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:57.582057 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82af653-7c2c-43e8-b3a9-c874335cfcc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=670a70375c3d4b598e25d3d8f5d03cec, user_id=4febdf4d533047beb05d6d6e25f43a50, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:57.584795 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82af653-7c2c-43e8-b3a9-c874335cfcc7 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:57.705013 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b02b600-3736-45a5-a616-3a2cea1307db admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:57.706746 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-2b02b600-3736-45a5-a616-3a2cea1307db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:57.725048 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b02b600-3736-45a5-a616-3a2cea1307db admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:57.733858 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 939/1875] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:50:57 2022] PUT /identity/v3/projects/670a70375c3d4b598e25d3d8f5d03cec/users/4febdf4d533047beb05d6d6e25f43a50/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:50:57.733858 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82af653-7c2c-43e8-b3a9-c874335cfcc7 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:57.833461 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd35bbf5-8471-431e-b114-518c2bbd35e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:57.834493 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd35bbf5-8471-431e-b114-518c2bbd35e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:57.835361 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd35bbf5-8471-431e-b114-518c2bbd35e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:57.835361 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd35bbf5-8471-431e-b114-518c2bbd35e1 admin admin] PATH_INFO: `/v3/users/2b1331df61de4a29bc81357a62a31f70` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:57.836499 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd35bbf5-8471-431e-b114-518c2bbd35e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b1331df61de4a29bc81357a62a31f70)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:57.838974 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd35bbf5-8471-431e-b114-518c2bbd35e1 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:57.843400 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82af653-7c2c-43e8-b3a9-c874335cfcc7 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:57.849457 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5739f018-b5b1-4856-8853-999c61f4b528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:57.850133 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739f018-b5b1-4856-8853-999c61f4b528 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:57.850606 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739f018-b5b1-4856-8853-999c61f4b528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:57.850884 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739f018-b5b1-4856-8853-999c61f4b528 admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:57.851613 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5739f018-b5b1-4856-8853-999c61f4b528 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:57.853847 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5739f018-b5b1-4856-8853-999c61f4b528 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:57.864496 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 940/1876] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:50:57 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:50:57.868593 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5739f018-b5b1-4856-8853-999c61f4b528 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:57.879083 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5739f018-b5b1-4856-8853-999c61f4b528 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:57.883703 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb29a2f5-e137-4491-a343-cd57f59299ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:57.884666 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29a2f5-e137-4491-a343-cd57f59299ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:57.884945 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29a2f5-e137-4491-a343-cd57f59299ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:57.885219 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29a2f5-e137-4491-a343-cd57f59299ce admin admin] PATH_INFO: `/v3/projects/670a70375c3d4b598e25d3d8f5d03cec/users/4febdf4d533047beb05d6d6e25f43a50/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:57.887177 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb29a2f5-e137-4491-a343-cd57f59299ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=670a70375c3d4b598e25d3d8f5d03cec, user_id=4febdf4d533047beb05d6d6e25f43a50, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:57.889978 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb29a2f5-e137-4491-a343-cd57f59299ce admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:57.906362 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 941/1877] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:50:57 2022] PUT /identity/v3/projects/670a70375c3d4b598e25d3d8f5d03cec/users/4febdf4d533047beb05d6d6e25f43a50/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:50:57.912372 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b9c42-175d-4174-acf4-1d74443a254b None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:57.912705 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b9c42-175d-4174-acf4-1d74443a254b None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:57.912989 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b9c42-175d-4174-acf4-1d74443a254b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:57.940824 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-313b9c42-175d-4174-acf4-1d74443a254b None None] MFA Rules not processed for user `4febdf4d533047beb05d6d6e25f43a50`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:57.942054 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-313b9c42-175d-4174-acf4-1d74443a254b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:58.015420 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 942/1878] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:50:57 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:50:58.023265 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b9c42-175d-4174-acf4-1d74443a254b None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:58.082657 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b9c42-175d-4174-acf4-1d74443a254b None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:58.088581 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a23fbe8-3248-46a7-985c-3e8c6291b357 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:58.091099 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23fbe8-3248-46a7-985c-3e8c6291b357 service cinder] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:58.091553 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23fbe8-3248-46a7-985c-3e8c6291b357 service cinder] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:58.092016 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23fbe8-3248-46a7-985c-3e8c6291b357 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:58.104011 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a23fbe8-3248-46a7-985c-3e8c6291b357 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:58.105916 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a23fbe8-3248-46a7-985c-3e8c6291b357 service cinder] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:58.109630 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-cd35bbf5-8471-431e-b114-518c2bbd35e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b1331df61de4a29bc81357a62a31f70'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:58.112073 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-cd35bbf5-8471-431e-b114-518c2bbd35e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b1331df61de4a29bc81357a62a31f70'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:58.118077 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 943/1879] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:50:58 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 16:50:58.118812 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a23fbe8-3248-46a7-985c-3e8c6291b357 service cinder] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:58.138221 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-cd35bbf5-8471-431e-b114-518c2bbd35e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b1331df61de4a29bc81357a62a31f70'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:58.217028 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a23fbe8-3248-46a7-985c-3e8c6291b357 service cinder] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:58.218165 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f216a61-b43c-432a-9c30-c80255ec5361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:58.219172 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f216a61-b43c-432a-9c30-c80255ec5361 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:58.219454 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f216a61-b43c-432a-9c30-c80255ec5361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:58.219806 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f216a61-b43c-432a-9c30-c80255ec5361 admin admin] PATH_INFO: `/v3/users/b14e882dfd7b407f9a4b53cca9656cac` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:58.221619 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f216a61-b43c-432a-9c30-c80255ec5361 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b14e882dfd7b407f9a4b53cca9656cac)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:58.223095 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f216a61-b43c-432a-9c30-c80255ec5361 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:58.238249 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-cd35bbf5-8471-431e-b114-518c2bbd35e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b1331df61de4a29bc81357a62a31f70'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:58.247461 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-cd35bbf5-8471-431e-b114-518c2bbd35e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b1331df61de4a29bc81357a62a31f70'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:58.260141 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 937/1880] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 16:50:57 2022] DELETE /identity/v3/users/2b1331df61de4a29bc81357a62a31f70 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:50:58.266910 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbdf828-fe05-4245-ab68-2402c3dab162 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:58.268111 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbdf828-fe05-4245-ab68-2402c3dab162 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:58.268521 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbdf828-fe05-4245-ab68-2402c3dab162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:58.295762 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-abbdf828-fe05-4245-ab68-2402c3dab162 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:58.297158 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-abbdf828-fe05-4245-ab68-2402c3dab162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:58.376327 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 938/1881] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:50:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:50:58.377684 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbdf828-fe05-4245-ab68-2402c3dab162 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:58.378959 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-abbdf828-fe05-4245-ab68-2402c3dab162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:58.437777 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbdf828-fe05-4245-ab68-2402c3dab162 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:58.442255 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0876cf1d-bcd5-47bc-84de-a811ad8927aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:58.443057 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876cf1d-bcd5-47bc-84de-a811ad8927aa service cinder] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:58.445257 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876cf1d-bcd5-47bc-84de-a811ad8927aa service cinder] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:58.445257 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876cf1d-bcd5-47bc-84de-a811ad8927aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:58.445638 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-0876cf1d-bcd5-47bc-84de-a811ad8927aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:58.491437 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-1f216a61-b43c-432a-9c30-c80255ec5361 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b14e882dfd7b407f9a4b53cca9656cac'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:58.504016 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-1f216a61-b43c-432a-9c30-c80255ec5361 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b14e882dfd7b407f9a4b53cca9656cac'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:58.504828 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-1f216a61-b43c-432a-9c30-c80255ec5361 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b14e882dfd7b407f9a4b53cca9656cac'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:58.513055 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-1f216a61-b43c-432a-9c30-c80255ec5361 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b14e882dfd7b407f9a4b53cca9656cac'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:58.529971 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0876cf1d-bcd5-47bc-84de-a811ad8927aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:58.531440 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0876cf1d-bcd5-47bc-84de-a811ad8927aa service cinder] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:58.540226 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 939/1882] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:50:58 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:50:58.542453 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0876cf1d-bcd5-47bc-84de-a811ad8927aa service cinder] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:58.543126 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-0876cf1d-bcd5-47bc-84de-a811ad8927aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:58.589284 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-1f216a61-b43c-432a-9c30-c80255ec5361 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b14e882dfd7b407f9a4b53cca9656cac'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:50:58.596987 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 944/1883] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 16:50:58 2022] DELETE /identity/v3/users/b14e882dfd7b407f9a4b53cca9656cac => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:50:58.601328 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568fcf3e-f763-4aee-b33a-19ac21e63ba4 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:58.601844 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568fcf3e-f763-4aee-b33a-19ac21e63ba4 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:58.602273 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568fcf3e-f763-4aee-b33a-19ac21e63ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:58.636076 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-568fcf3e-f763-4aee-b33a-19ac21e63ba4 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:50:58.640834 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0876cf1d-bcd5-47bc-84de-a811ad8927aa service cinder] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:58.642147 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-568fcf3e-f763-4aee-b33a-19ac21e63ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:58.739434 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd43567-c2d2-42cc-8a50-d7e10240cd7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:58.740429 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd43567-c2d2-42cc-8a50-d7e10240cd7c service neutron] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:58.740757 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd43567-c2d2-42cc-8a50-d7e10240cd7c service neutron] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:58.741108 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd43567-c2d2-42cc-8a50-d7e10240cd7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:58.744366 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-5dd43567-c2d2-42cc-8a50-d7e10240cd7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:58.763816 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 945/1884] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:50:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:50:58.801633 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568fcf3e-f763-4aee-b33a-19ac21e63ba4 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:58.803551 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-568fcf3e-f763-4aee-b33a-19ac21e63ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:58.817710 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568fcf3e-f763-4aee-b33a-19ac21e63ba4 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:58.823091 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fedb5a-920a-4e9f-8072-b9bc74f32600 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:58.823866 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fedb5a-920a-4e9f-8072-b9bc74f32600 service neutron] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:58.824150 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fedb5a-920a-4e9f-8072-b9bc74f32600 service neutron] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:58.824460 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fedb5a-920a-4e9f-8072-b9bc74f32600 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:58.847194 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd43567-c2d2-42cc-8a50-d7e10240cd7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:58.849573 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd43567-c2d2-42cc-8a50-d7e10240cd7c service neutron] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:58.865056 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 940/1885] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:50:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:50:58.866118 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fedb5a-920a-4e9f-8072-b9bc74f32600 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:58.867596 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fedb5a-920a-4e9f-8072-b9bc74f32600 service neutron] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:50:58.881075 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 946/1886] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:50:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:50:59.178745 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:59.922177 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd43567-c2d2-42cc-8a50-d7e10240cd7c service neutron] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:50:59.923664 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-5dd43567-c2d2-42cc-8a50-d7e10240cd7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:50:59.936352 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd43567-c2d2-42cc-8a50-d7e10240cd7c service neutron] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:50:59.941265 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384f71f-3b28-478e-9d67-54441cff0cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:50:59.942141 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384f71f-3b28-478e-9d67-54441cff0cd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:50:59.942419 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384f71f-3b28-478e-9d67-54441cff0cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:50:59.942699 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384f71f-3b28-478e-9d67-54441cff0cd7 admin admin] PATH_INFO: `/v3/projects/947130dadeab48279a851c5741aa94c2` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:50:59.943982 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0384f71f-3b28-478e-9d67-54441cff0cd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=947130dadeab48279a851c5741aa94c2)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:50:59.945894 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0384f71f-3b28-478e-9d67-54441cff0cd7 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:00.045087 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fedb5a-920a-4e9f-8072-b9bc74f32600 service neutron] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:00.046594 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-a1fedb5a-920a-4e9f-8072-b9bc74f32600 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:00.063087 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fedb5a-920a-4e9f-8072-b9bc74f32600 service neutron] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:00.068663 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99adb5e-04cb-4a9d-a906-2d2334b1151c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:00.069716 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99adb5e-04cb-4a9d-a906-2d2334b1151c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:00.070008 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99adb5e-04cb-4a9d-a906-2d2334b1151c admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:00.070295 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99adb5e-04cb-4a9d-a906-2d2334b1151c admin admin] PATH_INFO: `/v3/projects/c6d773e8c7e24d9682412fa86ac90c8a` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:00.072290 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99adb5e-04cb-4a9d-a906-2d2334b1151c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6d773e8c7e24d9682412fa86ac90c8a)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:00.074904 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99adb5e-04cb-4a9d-a906-2d2334b1151c admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:00.177831 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-0384f71f-3b28-478e-9d67-54441cff0cd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '947130dadeab48279a851c5741aa94c2', 'request_id': 'req-0384f71f-3b28-478e-9d67-54441cff0cd7'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:00.227594 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-b99adb5e-04cb-4a9d-a906-2d2334b1151c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6d773e8c7e24d9682412fa86ac90c8a', 'request_id': 'req-b99adb5e-04cb-4a9d-a906-2d2334b1151c'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:00.234919 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-b99adb5e-04cb-4a9d-a906-2d2334b1151c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6d773e8c7e24d9682412fa86ac90c8a', 'request_id': 'req-b99adb5e-04cb-4a9d-a906-2d2334b1151c'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:00.241830 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-b99adb5e-04cb-4a9d-a906-2d2334b1151c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6d773e8c7e24d9682412fa86ac90c8a', 'request_id': 'req-b99adb5e-04cb-4a9d-a906-2d2334b1151c'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:00.303252 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-0384f71f-3b28-478e-9d67-54441cff0cd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '947130dadeab48279a851c5741aa94c2', 'request_id': 'req-0384f71f-3b28-478e-9d67-54441cff0cd7'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:00.310002 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-0384f71f-3b28-478e-9d67-54441cff0cd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '947130dadeab48279a851c5741aa94c2', 'request_id': 'req-0384f71f-3b28-478e-9d67-54441cff0cd7'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:00.322445 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-0384f71f-3b28-478e-9d67-54441cff0cd7 admin admin] The token cache is being invalidate because project 947130dadeab48279a851c5741aa94c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:51:00.325965 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-0384f71f-3b28-478e-9d67-54441cff0cd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:00.326705 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-0384f71f-3b28-478e-9d67-54441cff0cd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:00.329198 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 941/1887] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 16:50:59 2022] DELETE /identity/v3/projects/947130dadeab48279a851c5741aa94c2 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:00.332376 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384f71f-3b28-478e-9d67-54441cff0cd7 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:00.337560 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-0384f71f-3b28-478e-9d67-54441cff0cd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:00.401936 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-b99adb5e-04cb-4a9d-a906-2d2334b1151c admin admin] The token cache is being invalidate because project c6d773e8c7e24d9682412fa86ac90c8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:51:00.402248 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-b99adb5e-04cb-4a9d-a906-2d2334b1151c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:00.402931 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-b99adb5e-04cb-4a9d-a906-2d2334b1151c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:00.404637 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 947/1888] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 16:51:00 2022] DELETE /identity/v3/projects/c6d773e8c7e24d9682412fa86ac90c8a => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:51:00.408631 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99adb5e-04cb-4a9d-a906-2d2334b1151c admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:00.409981 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-b99adb5e-04cb-4a9d-a906-2d2334b1151c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:00.410998 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384f71f-3b28-478e-9d67-54441cff0cd7 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:00.473188 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ef3b0-c21c-481f-ad85-5b12f2850f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:00.474724 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ef3b0-c21c-481f-ad85-5b12f2850f57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:00.475016 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ef3b0-c21c-481f-ad85-5b12f2850f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:00.475634 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ef3b0-c21c-481f-ad85-5b12f2850f57 admin admin] PATH_INFO: `/v3/users/b25fd317acad49b0af3c0494400c9537` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:00.476593 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ef3b0-c21c-481f-ad85-5b12f2850f57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b25fd317acad49b0af3c0494400c9537)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:00.478494 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:00.478617 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ef3b0-c21c-481f-ad85-5b12f2850f57 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:00.505216 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99adb5e-04cb-4a9d-a906-2d2334b1151c admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:00.512858 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4c4616-9c98-4e7a-b560-21ff628ac84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:00.514021 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c4616-9c98-4e7a-b560-21ff628ac84e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:00.514303 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c4616-9c98-4e7a-b560-21ff628ac84e admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:00.514581 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c4616-9c98-4e7a-b560-21ff628ac84e admin admin] PATH_INFO: `/v3/users/72490d726eb54cc2890fb210678b1c41` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:00.515863 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4c4616-9c98-4e7a-b560-21ff628ac84e admin admin] RBAC: Authorizing `identity:delete_user(user_id=72490d726eb54cc2890fb210678b1c41)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:00.517801 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4c4616-9c98-4e7a-b560-21ff628ac84e admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:00.657966 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-c13ef3b0-c21c-481f-ad85-5b12f2850f57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b25fd317acad49b0af3c0494400c9537'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:00.658778 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-c13ef3b0-c21c-481f-ad85-5b12f2850f57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b25fd317acad49b0af3c0494400c9537'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:00.671592 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-c13ef3b0-c21c-481f-ad85-5b12f2850f57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b25fd317acad49b0af3c0494400c9537'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:00.692236 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-9a4c4616-9c98-4e7a-b560-21ff628ac84e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72490d726eb54cc2890fb210678b1c41'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:00.704639 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-9a4c4616-9c98-4e7a-b560-21ff628ac84e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72490d726eb54cc2890fb210678b1c41'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:00.705355 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-9a4c4616-9c98-4e7a-b560-21ff628ac84e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72490d726eb54cc2890fb210678b1c41'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:00.713758 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-9a4c4616-9c98-4e7a-b560-21ff628ac84e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72490d726eb54cc2890fb210678b1c41'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:00.832189 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-c13ef3b0-c21c-481f-ad85-5b12f2850f57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b25fd317acad49b0af3c0494400c9537'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:00.839972 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-c13ef3b0-c21c-481f-ad85-5b12f2850f57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b25fd317acad49b0af3c0494400c9537'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:00.846140 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 942/1889] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 16:51:00 2022] DELETE /identity/v3/users/b25fd317acad49b0af3c0494400c9537 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:51:00.929649 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-9a4c4616-9c98-4e7a-b560-21ff628ac84e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72490d726eb54cc2890fb210678b1c41'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:00.937542 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 948/1890] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 16:51:00 2022] DELETE /identity/v3/users/72490d726eb54cc2890fb210678b1c41 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:51:01.402470 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ef3b0-c21c-481f-ad85-5b12f2850f57 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:01.403977 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-c13ef3b0-c21c-481f-ad85-5b12f2850f57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:01.455176 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4c4616-9c98-4e7a-b560-21ff628ac84e admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:01.456888 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-9a4c4616-9c98-4e7a-b560-21ff628ac84e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:01.497671 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ef3b0-c21c-481f-ad85-5b12f2850f57 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:01.550063 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4c4616-9c98-4e7a-b560-21ff628ac84e admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:01.574152 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a8422d-c06e-4959-b203-709fd20e4fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:01.575177 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a8422d-c06e-4959-b203-709fd20e4fb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:01.575562 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a8422d-c06e-4959-b203-709fd20e4fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:01.575962 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a8422d-c06e-4959-b203-709fd20e4fb9 admin admin] PATH_INFO: `/v3/projects/e2ca84e4e7094367bdb06f11e82a80f9` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:01.577781 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a8422d-c06e-4959-b203-709fd20e4fb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2ca84e4e7094367bdb06f11e82a80f9)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:01.578958 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9774ce8-4759-490f-b35e-b2f082f7dc5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:01.580338 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a8422d-c06e-4959-b203-709fd20e4fb9 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:01.581361 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9774ce8-4759-490f-b35e-b2f082f7dc5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:01.582065 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9774ce8-4759-490f-b35e-b2f082f7dc5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:01.582865 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9774ce8-4759-490f-b35e-b2f082f7dc5f admin admin] PATH_INFO: `/v3/projects/ecd029a98ffd463ebd1e4f2b3f9d036b` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:01.585812 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9774ce8-4759-490f-b35e-b2f082f7dc5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecd029a98ffd463ebd1e4f2b3f9d036b)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:01.588925 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9774ce8-4759-490f-b35e-b2f082f7dc5f admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:01.617014 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:01.696460 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-81a8422d-c06e-4959-b203-709fd20e4fb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2ca84e4e7094367bdb06f11e82a80f9', 'request_id': 'req-81a8422d-c06e-4959-b203-709fd20e4fb9'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:01.781619 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-81a8422d-c06e-4959-b203-709fd20e4fb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2ca84e4e7094367bdb06f11e82a80f9', 'request_id': 'req-81a8422d-c06e-4959-b203-709fd20e4fb9'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:01.794217 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-81a8422d-c06e-4959-b203-709fd20e4fb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2ca84e4e7094367bdb06f11e82a80f9', 'request_id': 'req-81a8422d-c06e-4959-b203-709fd20e4fb9'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:01.801872 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-a9774ce8-4759-490f-b35e-b2f082f7dc5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecd029a98ffd463ebd1e4f2b3f9d036b', 'request_id': 'req-a9774ce8-4759-490f-b35e-b2f082f7dc5f'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:01.810178 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-a9774ce8-4759-490f-b35e-b2f082f7dc5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecd029a98ffd463ebd1e4f2b3f9d036b', 'request_id': 'req-a9774ce8-4759-490f-b35e-b2f082f7dc5f'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:01.810535 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-81a8422d-c06e-4959-b203-709fd20e4fb9 admin admin] The token cache is being invalidate because project e2ca84e4e7094367bdb06f11e82a80f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:51:01.812016 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-81a8422d-c06e-4959-b203-709fd20e4fb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:01.813131 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-81a8422d-c06e-4959-b203-709fd20e4fb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:01.816204 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 943/1891] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 16:51:01 2022] DELETE /identity/v3/projects/e2ca84e4e7094367bdb06f11e82a80f9 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:01.822764 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236fc1e0-61a6-42ab-af5e-b04a6f144f85 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:01.823054 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236fc1e0-61a6-42ab-af5e-b04a6f144f85 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:01.823335 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236fc1e0-61a6-42ab-af5e-b04a6f144f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:01.826222 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-a9774ce8-4759-490f-b35e-b2f082f7dc5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecd029a98ffd463ebd1e4f2b3f9d036b', 'request_id': 'req-a9774ce8-4759-490f-b35e-b2f082f7dc5f'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:01.848444 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-236fc1e0-61a6-42ab-af5e-b04a6f144f85 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:01.849695 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-236fc1e0-61a6-42ab-af5e-b04a6f144f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:01.931838 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-a9774ce8-4759-490f-b35e-b2f082f7dc5f admin admin] The token cache is being invalidate because project ecd029a98ffd463ebd1e4f2b3f9d036b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:51:01.932176 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-a9774ce8-4759-490f-b35e-b2f082f7dc5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:01.932824 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-a9774ce8-4759-490f-b35e-b2f082f7dc5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:01.938400 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 949/1892] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 16:51:01 2022] DELETE /identity/v3/projects/ecd029a98ffd463ebd1e4f2b3f9d036b => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:01.938690 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 944/1893] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:51:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:01.939924 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2918b-c6ae-421e-bb2d-0b6c09cd168d None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:01.940212 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2918b-c6ae-421e-bb2d-0b6c09cd168d None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:01.940352 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0b088-4b83-4fee-bffa-960e9f6b8f52 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:01.940997 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2918b-c6ae-421e-bb2d-0b6c09cd168d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:01.941104 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0b088-4b83-4fee-bffa-960e9f6b8f52 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:01.941104 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0b088-4b83-4fee-bffa-960e9f6b8f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:01.964092 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-aaf2918b-c6ae-421e-bb2d-0b6c09cd168d None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:01.965797 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-aaf2918b-c6ae-421e-bb2d-0b6c09cd168d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:01.967090 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-71f0b088-4b83-4fee-bffa-960e9f6b8f52 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:01.968411 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-71f0b088-4b83-4fee-bffa-960e9f6b8f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:01.982450 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 950/1894] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:51:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:01.983984 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977c866-9b3b-4ee9-b90d-b65a12031466 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:01.984127 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 945/1895] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:51:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:01.984298 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977c866-9b3b-4ee9-b90d-b65a12031466 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:01.984541 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977c866-9b3b-4ee9-b90d-b65a12031466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:01.989269 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f0b088-4b83-4fee-bffa-960e9f6b8f52 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:02.005562 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f0b088-4b83-4fee-bffa-960e9f6b8f52 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:02.007888 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-9977c866-9b3b-4ee9-b90d-b65a12031466 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:02.009683 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-9977c866-9b3b-4ee9-b90d-b65a12031466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:02.011814 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d9a24e-46dc-47ce-90c4-5d4e2a000a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:02.012721 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d9a24e-46dc-47ce-90c4-5d4e2a000a00 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:02.013017 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d9a24e-46dc-47ce-90c4-5d4e2a000a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:02.013412 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d9a24e-46dc-47ce-90c4-5d4e2a000a00 admin admin] PATH_INFO: `/v3/domains` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:02.014258 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d9a24e-46dc-47ce-90c4-5d4e2a000a00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:51:02.014569 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d9a24e-46dc-47ce-90c4-5d4e2a000a00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:02.016228 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d9a24e-46dc-47ce-90c4-5d4e2a000a00 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:02.021803 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 951/1896] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:51:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:02.024064 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9977c866-9b3b-4ee9-b90d-b65a12031466 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:02.044638 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9977c866-9b3b-4ee9-b90d-b65a12031466 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:02.046642 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 946/1897] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Jul 18 16:51:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:51:02.053997 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d9a24e-46dc-47ce-90c4-5d4e2a000a00 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:02.059529 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b6a94c-468a-465b-86e1-6b96318e9eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:02.061851 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6a94c-468a-465b-86e1-6b96318e9eda admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:02.063904 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6a94c-468a-465b-86e1-6b96318e9eda admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:02.064240 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6a94c-468a-465b-86e1-6b96318e9eda admin admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:02.065033 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b6a94c-468a-465b-86e1-6b96318e9eda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:51:02.065354 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b6a94c-468a-465b-86e1-6b96318e9eda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:02.069439 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b6a94c-468a-465b-86e1-6b96318e9eda admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:02.074088 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d9a24e-46dc-47ce-90c4-5d4e2a000a00 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:02.081087 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c12615d-a9e7-4ced-a4e5-3ec788a93922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:02.082144 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12615d-a9e7-4ced-a4e5-3ec788a93922 admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:02.082144 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12615d-a9e7-4ced-a4e5-3ec788a93922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:02.082329 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12615d-a9e7-4ced-a4e5-3ec788a93922 admin admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:02.083006 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c12615d-a9e7-4ced-a4e5-3ec788a93922 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:02.086188 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c12615d-a9e7-4ced-a4e5-3ec788a93922 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:02.094858 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 952/1898] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Jul 18 16:51:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:51:02.099490 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b6a94c-468a-465b-86e1-6b96318e9eda admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:02.111025 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b6a94c-468a-465b-86e1-6b96318e9eda admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:02.121713 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee9352f-8722-406c-816d-a0e8f433074d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:02.122410 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9352f-8722-406c-816d-a0e8f433074d admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:02.122696 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9352f-8722-406c-816d-a0e8f433074d admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:02.122978 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9352f-8722-406c-816d-a0e8f433074d admin admin] PATH_INFO: `/v3/projects` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:02.123763 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee9352f-8722-406c-816d-a0e8f433074d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:02.125720 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee9352f-8722-406c-816d-a0e8f433074d admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:02.256651 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 947/1899] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:51:02 2022] POST /identity/v3/projects => generated 381 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:02.258321 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 953/1900] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:51:02 2022] POST /identity/v3/projects => generated 383 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:51:02.262900 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee9352f-8722-406c-816d-a0e8f433074d admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:02.263166 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c12615d-a9e7-4ced-a4e5-3ec788a93922 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:02.358581 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c12615d-a9e7-4ced-a4e5-3ec788a93922 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:02.382202 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee9352f-8722-406c-816d-a0e8f433074d admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:02.384946 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c57775-970d-47f5-a10f-c0af064fd994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:02.385649 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c57775-970d-47f5-a10f-c0af064fd994 admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:02.385933 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c57775-970d-47f5-a10f-c0af064fd994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:02.386747 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c57775-970d-47f5-a10f-c0af064fd994 admin admin] PATH_INFO: `/v3/users` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:02.386949 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c57775-970d-47f5-a10f-c0af064fd994 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:02.389681 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c57775-970d-47f5-a10f-c0af064fd994 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:02.396626 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30dee33-1e34-4495-b55b-cd8b5c24bd92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:02.398343 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30dee33-1e34-4495-b55b-cd8b5c24bd92 admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:02.398773 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30dee33-1e34-4495-b55b-cd8b5c24bd92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:02.399063 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30dee33-1e34-4495-b55b-cd8b5c24bd92 admin admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:02.399844 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30dee33-1e34-4495-b55b-cd8b5c24bd92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:02.401898 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30dee33-1e34-4495-b55b-cd8b5c24bd92 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:02.530623 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 948/1901] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 16:51:02 2022] POST /identity/v3/users => generated 292 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:02.534508 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c57775-970d-47f5-a10f-c0af064fd994 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:02.545211 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c57775-970d-47f5-a10f-c0af064fd994 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:02.550032 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b88446e-31ac-4ab9-94a7-70def10176f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:02.550699 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88446e-31ac-4ab9-94a7-70def10176f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:02.551165 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88446e-31ac-4ab9-94a7-70def10176f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:02.551444 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88446e-31ac-4ab9-94a7-70def10176f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:02.552507 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b88446e-31ac-4ab9-94a7-70def10176f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:02.554042 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b88446e-31ac-4ab9-94a7-70def10176f1 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:02.570472 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 954/1902] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 16:51:02 2022] POST /identity/v3/users => generated 291 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:02.574914 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30dee33-1e34-4495-b55b-cd8b5c24bd92 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:02.575539 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 949/1903] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:02 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 16:51:02.579375 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b88446e-31ac-4ab9-94a7-70def10176f1 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:02.587275 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30dee33-1e34-4495-b55b-cd8b5c24bd92 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:02.590600 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b88446e-31ac-4ab9-94a7-70def10176f1 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:02.593471 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fbd0a8-23db-4182-9288-a9a86689920d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:02.594221 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fbd0a8-23db-4182-9288-a9a86689920d admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:02.594514 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fbd0a8-23db-4182-9288-a9a86689920d admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:02.594998 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fbd0a8-23db-4182-9288-a9a86689920d admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:02.595774 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fbd0a8-23db-4182-9288-a9a86689920d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:02.596421 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eb5b10-43e4-4abd-a5cd-e303c801ac45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:02.597163 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb5b10-43e4-4abd-a5cd-e303c801ac45 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:02.597642 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb5b10-43e4-4abd-a5cd-e303c801ac45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:02.597734 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fbd0a8-23db-4182-9288-a9a86689920d admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:02.598043 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb5b10-43e4-4abd-a5cd-e303c801ac45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:02.598882 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eb5b10-43e4-4abd-a5cd-e303c801ac45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:02.600609 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eb5b10-43e4-4abd-a5cd-e303c801ac45 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:02.609751 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 955/1904] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:02.613428 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 950/1905] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:02.613739 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fbd0a8-23db-4182-9288-a9a86689920d admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:02.617404 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eb5b10-43e4-4abd-a5cd-e303c801ac45 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:02.625315 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fbd0a8-23db-4182-9288-a9a86689920d admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:02.629451 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eb5b10-43e4-4abd-a5cd-e303c801ac45 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:02.631155 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750c09f-aeef-4e43-a9f8-e8b3f620c407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:02.631867 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750c09f-aeef-4e43-a9f8-e8b3f620c407 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:02.634140 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750c09f-aeef-4e43-a9f8-e8b3f620c407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:02.634140 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750c09f-aeef-4e43-a9f8-e8b3f620c407 admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:02.634140 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3750c09f-aeef-4e43-a9f8-e8b3f620c407 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:02.635426 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3750c09f-aeef-4e43-a9f8-e8b3f620c407 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:02.637534 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a44db8-9767-48df-9e19-160f83f9abb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:02.638724 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a44db8-9767-48df-9e19-160f83f9abb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:02.639186 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a44db8-9767-48df-9e19-160f83f9abb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:02.639644 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a44db8-9767-48df-9e19-160f83f9abb6 admin admin] PATH_INFO: `/v3/projects/50f328b28751440c911ac7ed5f2c7ce1/users/497c2e822a744171885c59b987da7d42/roles/ad3a2bc7b2094a4da1a95a143c8d9436` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:02.650668 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 956/1906] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 16:51:02.652013 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750c09f-aeef-4e43-a9f8-e8b3f620c407 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:02.662843 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750c09f-aeef-4e43-a9f8-e8b3f620c407 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:02.667271 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a44db8-9767-48df-9e19-160f83f9abb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50f328b28751440c911ac7ed5f2c7ce1, user_id=497c2e822a744171885c59b987da7d42, role_id=ad3a2bc7b2094a4da1a95a143c8d9436)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:02.671566 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a44db8-9767-48df-9e19-160f83f9abb6 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:02.678148 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b23ea-524e-487d-9d9e-852a7433b596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:02.679126 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b23ea-524e-487d-9d9e-852a7433b596 admin admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:02.679787 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b23ea-524e-487d-9d9e-852a7433b596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:02.679787 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b23ea-524e-487d-9d9e-852a7433b596 admin admin] PATH_INFO: `/v3/projects/a3fd0d132c104be09f199eabf146fa56/users/0f9f8fd90fc448feac20254342d8698f/roles/ad3a2bc7b2094a4da1a95a143c8d9436` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:02.699233 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b23ea-524e-487d-9d9e-852a7433b596 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3fd0d132c104be09f199eabf146fa56, user_id=0f9f8fd90fc448feac20254342d8698f, role_id=ad3a2bc7b2094a4da1a95a143c8d9436)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:02.702246 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b23ea-524e-487d-9d9e-852a7433b596 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:02.754643 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 951/1907] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:51:02 2022] PUT /identity/v3/projects/50f328b28751440c911ac7ed5f2c7ce1/users/497c2e822a744171885c59b987da7d42/roles/ad3a2bc7b2094a4da1a95a143c8d9436 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:51:02.762196 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00d630-d784-452e-8cab-a2d6bbe3acc0 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:02.768514 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00d630-d784-452e-8cab-a2d6bbe3acc0 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:02.768514 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00d630-d784-452e-8cab-a2d6bbe3acc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:02.794205 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 957/1908] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:51:02 2022] PUT /identity/v3/projects/a3fd0d132c104be09f199eabf146fa56/users/0f9f8fd90fc448feac20254342d8698f/roles/ad3a2bc7b2094a4da1a95a143c8d9436 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:02.810395 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738b30b-6783-4855-af9b-53394d21bd65 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:02.810985 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738b30b-6783-4855-af9b-53394d21bd65 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:02.812251 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738b30b-6783-4855-af9b-53394d21bd65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:02.823931 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-0a00d630-d784-452e-8cab-a2d6bbe3acc0 None None] MFA Rules not processed for user `497c2e822a744171885c59b987da7d42`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:02.827164 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-0a00d630-d784-452e-8cab-a2d6bbe3acc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:02.868111 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-f738b30b-6783-4855-af9b-53394d21bd65 None None] MFA Rules not processed for user `0f9f8fd90fc448feac20254342d8698f`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:02.870421 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-f738b30b-6783-4855-af9b-53394d21bd65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:02.920196 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 952/1909] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:51:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:51:02.925743 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a00d630-d784-452e-8cab-a2d6bbe3acc0 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:02.957868 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 958/1910] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:51:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:02.962538 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f738b30b-6783-4855-af9b-53394d21bd65 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:03.027758 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a00d630-d784-452e-8cab-a2d6bbe3acc0 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:03.032805 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f30a8f1-f95b-40ac-8071-77c4bfd05fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:03.033515 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30a8f1-f95b-40ac-8071-77c4bfd05fd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:03.033800 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30a8f1-f95b-40ac-8071-77c4bfd05fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:03.034075 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30a8f1-f95b-40ac-8071-77c4bfd05fd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:03.034773 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f30a8f1-f95b-40ac-8071-77c4bfd05fd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:03.036741 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f30a8f1-f95b-40ac-8071-77c4bfd05fd6 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:03.055212 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f738b30b-6783-4855-af9b-53394d21bd65 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:03.061423 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c882b-24f8-401d-a615-39f9222c4e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:03.062098 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c882b-24f8-401d-a615-39f9222c4e5e admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:03.063875 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c882b-24f8-401d-a615-39f9222c4e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:03.063875 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c882b-24f8-401d-a615-39f9222c4e5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:03.063875 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c882b-24f8-401d-a615-39f9222c4e5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:03.065348 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c882b-24f8-401d-a615-39f9222c4e5e admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:03.131465 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 953/1911] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:51:02 2022] POST /identity/v3/projects => generated 383 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:51:03.135785 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f30a8f1-f95b-40ac-8071-77c4bfd05fd6 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:03.197941 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f30a8f1-f95b-40ac-8071-77c4bfd05fd6 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:03.200246 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:03.203304 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d391ee-5a78-4187-9cb4-f9d4badbc145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:03.204004 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d391ee-5a78-4187-9cb4-f9d4badbc145 admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:03.204328 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d391ee-5a78-4187-9cb4-f9d4badbc145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:03.204652 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d391ee-5a78-4187-9cb4-f9d4badbc145 admin admin] PATH_INFO: `/v3/users` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:03.207117 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d391ee-5a78-4187-9cb4-f9d4badbc145 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:03.207321 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d391ee-5a78-4187-9cb4-f9d4badbc145 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:03.207420 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 959/1912] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:51:02 2022] POST /identity/v3/projects => generated 381 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:51:03.211595 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c882b-24f8-401d-a615-39f9222c4e5e admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:03.281154 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c882b-24f8-401d-a615-39f9222c4e5e admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:03.285940 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df48f52-8a6c-4bc0-b946-30ab715fd60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:03.286623 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df48f52-8a6c-4bc0-b946-30ab715fd60e admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:03.286912 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df48f52-8a6c-4bc0-b946-30ab715fd60e admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:03.287234 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df48f52-8a6c-4bc0-b946-30ab715fd60e admin admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:03.287946 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df48f52-8a6c-4bc0-b946-30ab715fd60e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:03.289884 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df48f52-8a6c-4bc0-b946-30ab715fd60e admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:03.309553 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:03.348520 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 954/1913] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 16:51:03 2022] POST /identity/v3/users => generated 298 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:03.352372 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d391ee-5a78-4187-9cb4-f9d4badbc145 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:03.366722 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d391ee-5a78-4187-9cb4-f9d4badbc145 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:03.372526 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378364ec-065b-4ead-87b9-129aa5781c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:03.373574 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378364ec-065b-4ead-87b9-129aa5781c46 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:03.378203 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378364ec-065b-4ead-87b9-129aa5781c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:03.378203 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378364ec-065b-4ead-87b9-129aa5781c46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:03.378203 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378364ec-065b-4ead-87b9-129aa5781c46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:03.378952 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 960/1914] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 16:51:03 2022] POST /identity/v3/users => generated 297 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:51:03.382085 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378364ec-065b-4ead-87b9-129aa5781c46 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:03.385821 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df48f52-8a6c-4bc0-b946-30ab715fd60e admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:03.394978 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 955/1915] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:03 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:03.398129 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df48f52-8a6c-4bc0-b946-30ab715fd60e admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:03.398509 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378364ec-065b-4ead-87b9-129aa5781c46 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:03.406821 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a765420-e1ee-494e-af00-7c9201625114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:03.407788 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a765420-e1ee-494e-af00-7c9201625114 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:03.408149 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a765420-e1ee-494e-af00-7c9201625114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:03.408488 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a765420-e1ee-494e-af00-7c9201625114 admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:03.409237 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a765420-e1ee-494e-af00-7c9201625114 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:03.411088 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a765420-e1ee-494e-af00-7c9201625114 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:03.414695 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378364ec-065b-4ead-87b9-129aa5781c46 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:03.421671 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e3cd36-0a6a-4f7d-8b7c-19defd657511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:03.422767 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3cd36-0a6a-4f7d-8b7c-19defd657511 admin admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:03.423194 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3cd36-0a6a-4f7d-8b7c-19defd657511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:03.423569 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3cd36-0a6a-4f7d-8b7c-19defd657511 admin admin] PATH_INFO: `/v3/projects/dd1d5c574b62444fa229a8d2308a579c/users/0ac21ecc85dd41f38dce1393df6715c9/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:03.426348 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 961/1916] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:03 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:03.438698 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a765420-e1ee-494e-af00-7c9201625114 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:03.441447 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e3cd36-0a6a-4f7d-8b7c-19defd657511 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd1d5c574b62444fa229a8d2308a579c, user_id=0ac21ecc85dd41f38dce1393df6715c9, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:03.444298 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e3cd36-0a6a-4f7d-8b7c-19defd657511 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:03.449246 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a765420-e1ee-494e-af00-7c9201625114 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:03.455014 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd026f-35d2-43a1-acba-0d6ac3b0c9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:03.455919 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd026f-35d2-43a1-acba-0d6ac3b0c9cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:03.456610 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd026f-35d2-43a1-acba-0d6ac3b0c9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:03.462067 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd026f-35d2-43a1-acba-0d6ac3b0c9cf admin admin] PATH_INFO: `/v3/projects/ce6a799339314e049a5e050a4741db3f/users/d497e6e36e284ff88343e78a90796786/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:03.476712 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fd026f-35d2-43a1-acba-0d6ac3b0c9cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce6a799339314e049a5e050a4741db3f, user_id=d497e6e36e284ff88343e78a90796786, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:03.477126 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fd026f-35d2-43a1-acba-0d6ac3b0c9cf admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:03.527549 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 956/1917] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:51:03 2022] PUT /identity/v3/projects/dd1d5c574b62444fa229a8d2308a579c/users/0ac21ecc85dd41f38dce1393df6715c9/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:03.531337 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e3cd36-0a6a-4f7d-8b7c-19defd657511 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:03.604654 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e3cd36-0a6a-4f7d-8b7c-19defd657511 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:03.609581 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a7979-fbb0-47a9-866e-f9baeef34fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:03.610250 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a7979-fbb0-47a9-866e-f9baeef34fb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:03.610533 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a7979-fbb0-47a9-866e-f9baeef34fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:03.610845 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a7979-fbb0-47a9-866e-f9baeef34fb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:03.611523 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38a7979-fbb0-47a9-866e-f9baeef34fb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:03.613169 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38a7979-fbb0-47a9-866e-f9baeef34fb4 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:03.628908 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 957/1918] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:03 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 16:51:03.632989 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a7979-fbb0-47a9-866e-f9baeef34fb4 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:03.646067 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a7979-fbb0-47a9-866e-f9baeef34fb4 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:03.652513 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83da4883-f58c-44e4-bc25-867e4175e910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:03.653411 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da4883-f58c-44e4-bc25-867e4175e910 admin admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:03.653688 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da4883-f58c-44e4-bc25-867e4175e910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:03.653961 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da4883-f58c-44e4-bc25-867e4175e910 admin admin] PATH_INFO: `/v3/projects/dd1d5c574b62444fa229a8d2308a579c/users/0ac21ecc85dd41f38dce1393df6715c9/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:03.656644 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83da4883-f58c-44e4-bc25-867e4175e910 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd1d5c574b62444fa229a8d2308a579c, user_id=0ac21ecc85dd41f38dce1393df6715c9, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:03.659327 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83da4883-f58c-44e4-bc25-867e4175e910 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:03.684488 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 958/1919] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:51:03 2022] PUT /identity/v3/projects/dd1d5c574b62444fa229a8d2308a579c/users/0ac21ecc85dd41f38dce1393df6715c9/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:03.686471 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11799c22-0d44-42c5-9a60-5813ee5d0d8b None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:03.687322 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11799c22-0d44-42c5-9a60-5813ee5d0d8b None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:03.687322 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11799c22-0d44-42c5-9a60-5813ee5d0d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:03.695160 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 962/1920] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:51:03 2022] PUT /identity/v3/projects/ce6a799339314e049a5e050a4741db3f/users/d497e6e36e284ff88343e78a90796786/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:51:03.699637 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd026f-35d2-43a1-acba-0d6ac3b0c9cf admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:03.721827 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-11799c22-0d44-42c5-9a60-5813ee5d0d8b None None] MFA Rules not processed for user `0ac21ecc85dd41f38dce1393df6715c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:03.723093 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-11799c22-0d44-42c5-9a60-5813ee5d0d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:03.765736 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd026f-35d2-43a1-acba-0d6ac3b0c9cf admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:03.770975 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e337a-089a-4324-8504-43f553474bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:03.772391 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e337a-089a-4324-8504-43f553474bd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:03.772615 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e337a-089a-4324-8504-43f553474bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:03.772840 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e337a-089a-4324-8504-43f553474bd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:03.773986 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7e337a-089a-4324-8504-43f553474bd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:03.776801 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7e337a-089a-4324-8504-43f553474bd5 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:03.788492 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 963/1921] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:03 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 16:51:03.793101 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e337a-089a-4324-8504-43f553474bd5 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:03.795832 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 959/1922] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:51:03 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:03.806931 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11799c22-0d44-42c5-9a60-5813ee5d0d8b None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:03.808448 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-11799c22-0d44-42c5-9a60-5813ee5d0d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:03.810040 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e337a-089a-4324-8504-43f553474bd5 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:03.814812 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16394660-c111-4265-9a6c-5b1c2bea56e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:03.815703 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16394660-c111-4265-9a6c-5b1c2bea56e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:03.816006 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16394660-c111-4265-9a6c-5b1c2bea56e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:03.816278 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16394660-c111-4265-9a6c-5b1c2bea56e3 admin admin] PATH_INFO: `/v3/projects/ce6a799339314e049a5e050a4741db3f/users/d497e6e36e284ff88343e78a90796786/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:03.818283 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16394660-c111-4265-9a6c-5b1c2bea56e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce6a799339314e049a5e050a4741db3f, user_id=d497e6e36e284ff88343e78a90796786, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:03.820971 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16394660-c111-4265-9a6c-5b1c2bea56e3 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:03.831507 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 964/1923] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:51:03 2022] PUT /identity/v3/projects/ce6a799339314e049a5e050a4741db3f/users/d497e6e36e284ff88343e78a90796786/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:51:03.843736 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a7576-4e3d-4997-903a-735bf0322425 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:03.844050 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a7576-4e3d-4997-903a-735bf0322425 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:03.844319 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a7576-4e3d-4997-903a-735bf0322425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:03.870769 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11799c22-0d44-42c5-9a60-5813ee5d0d8b None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:03.873142 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-255a7576-4e3d-4997-903a-735bf0322425 None None] MFA Rules not processed for user `d497e6e36e284ff88343e78a90796786`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:03.874455 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-255a7576-4e3d-4997-903a-735bf0322425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:03.959571 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c739b1f-0693-49fb-a285-8fec06e26bf6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:03.961648 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 965/1924] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:51:03 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:03.962280 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c739b1f-0693-49fb-a285-8fec06e26bf6 service cinder] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:03.963090 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c739b1f-0693-49fb-a285-8fec06e26bf6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:03.963368 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c739b1f-0693-49fb-a285-8fec06e26bf6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:04.019922 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255a7576-4e3d-4997-903a-735bf0322425 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:04.021164 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-255a7576-4e3d-4997-903a-735bf0322425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:04.050048 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255a7576-4e3d-4997-903a-735bf0322425 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:04.063240 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c739b1f-0693-49fb-a285-8fec06e26bf6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:04.064930 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc1465-2aff-4ab8-afa4-e84d5c6b9424 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:04.065409 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c739b1f-0693-49fb-a285-8fec06e26bf6 service cinder] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:04.065800 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc1465-2aff-4ab8-afa4-e84d5c6b9424 service cinder] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:04.066176 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc1465-2aff-4ab8-afa4-e84d5c6b9424 service cinder] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:04.066530 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc1465-2aff-4ab8-afa4-e84d5c6b9424 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:04.080451 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 960/1925] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:03 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:51:04.097163 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bc1465-2aff-4ab8-afa4-e84d5c6b9424 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:04.099351 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bc1465-2aff-4ab8-afa4-e84d5c6b9424 service cinder] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:04.111755 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 966/1926] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:04 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 16:51:04.338550 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c739b1f-0693-49fb-a285-8fec06e26bf6 service cinder] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:04.347569 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c739b1f-0693-49fb-a285-8fec06e26bf6 service cinder] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:04.352013 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db578c6-a158-4e6f-a5d5-cfdc1a31419c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:04.353226 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db578c6-a158-4e6f-a5d5-cfdc1a31419c service cinder] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:04.353630 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db578c6-a158-4e6f-a5d5-cfdc1a31419c service cinder] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:04.354007 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db578c6-a158-4e6f-a5d5-cfdc1a31419c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:04.421294 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db578c6-a158-4e6f-a5d5-cfdc1a31419c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:04.422978 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db578c6-a158-4e6f-a5d5-cfdc1a31419c service cinder] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:04.435607 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 961/1927] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:51:04.717486 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc1465-2aff-4ab8-afa4-e84d5c6b9424 service cinder] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:04.786989 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc1465-2aff-4ab8-afa4-e84d5c6b9424 service cinder] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:04.793181 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b52894-26ad-4042-a2a4-d9c473bd4977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:04.794127 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b52894-26ad-4042-a2a4-d9c473bd4977 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:04.794409 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b52894-26ad-4042-a2a4-d9c473bd4977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:04.794709 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b52894-26ad-4042-a2a4-d9c473bd4977 admin admin] PATH_INFO: `/v3/users/0f9f8fd90fc448feac20254342d8698f` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:04.795966 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b52894-26ad-4042-a2a4-d9c473bd4977 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f9f8fd90fc448feac20254342d8698f)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:04.798532 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b52894-26ad-4042-a2a4-d9c473bd4977 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:05.094687 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-96b52894-26ad-4042-a2a4-d9c473bd4977 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f9f8fd90fc448feac20254342d8698f'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:05.106902 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-96b52894-26ad-4042-a2a4-d9c473bd4977 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f9f8fd90fc448feac20254342d8698f'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:05.107679 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-96b52894-26ad-4042-a2a4-d9c473bd4977 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f9f8fd90fc448feac20254342d8698f'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:05.114739 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-96b52894-26ad-4042-a2a4-d9c473bd4977 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f9f8fd90fc448feac20254342d8698f'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:05.141427 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db578c6-a158-4e6f-a5d5-cfdc1a31419c service cinder] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:05.152600 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db578c6-a158-4e6f-a5d5-cfdc1a31419c service cinder] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:05.157195 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c86c4-1fb1-4cfd-803e-434373975c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:05.158061 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c86c4-1fb1-4cfd-803e-434373975c0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:05.158342 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c86c4-1fb1-4cfd-803e-434373975c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:05.158620 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c86c4-1fb1-4cfd-803e-434373975c0f admin admin] PATH_INFO: `/v3/users/497c2e822a744171885c59b987da7d42` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:05.159830 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53c86c4-1fb1-4cfd-803e-434373975c0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=497c2e822a744171885c59b987da7d42)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:05.161755 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53c86c4-1fb1-4cfd-803e-434373975c0f admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:05.340477 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-96b52894-26ad-4042-a2a4-d9c473bd4977 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f9f8fd90fc448feac20254342d8698f'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:05.353554 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 967/1928] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 16:51:04 2022] DELETE /identity/v3/users/0f9f8fd90fc448feac20254342d8698f => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:05.353554 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56854b51-9f6e-40ae-a416-9e839f38e115 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:05.353554 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56854b51-9f6e-40ae-a416-9e839f38e115 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:05.354000 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56854b51-9f6e-40ae-a416-9e839f38e115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:05.372069 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-56854b51-9f6e-40ae-a416-9e839f38e115 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:05.373356 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-56854b51-9f6e-40ae-a416-9e839f38e115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:05.449094 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 968/1929] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:51:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:51:05.459631 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56854b51-9f6e-40ae-a416-9e839f38e115 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:05.466299 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-56854b51-9f6e-40ae-a416-9e839f38e115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:05.473564 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-f53c86c4-1fb1-4cfd-803e-434373975c0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '497c2e822a744171885c59b987da7d42'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:05.474550 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-f53c86c4-1fb1-4cfd-803e-434373975c0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '497c2e822a744171885c59b987da7d42'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:05.489040 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-f53c86c4-1fb1-4cfd-803e-434373975c0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '497c2e822a744171885c59b987da7d42'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:05.533454 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56854b51-9f6e-40ae-a416-9e839f38e115 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:05.539322 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c68e9a-4860-4568-8666-2cb4a60aad73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:05.540307 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c68e9a-4860-4568-8666-2cb4a60aad73 service neutron] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:05.540907 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c68e9a-4860-4568-8666-2cb4a60aad73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:05.541320 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c68e9a-4860-4568-8666-2cb4a60aad73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:05.552904 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c68e9a-4860-4568-8666-2cb4a60aad73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:05.554661 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c68e9a-4860-4568-8666-2cb4a60aad73 service neutron] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:05.573902 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 969/1930] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 16:51:05.574755 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c68e9a-4860-4568-8666-2cb4a60aad73 service neutron] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:05.576226 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-b7c68e9a-4860-4568-8666-2cb4a60aad73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:05.589419 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c68e9a-4860-4568-8666-2cb4a60aad73 service neutron] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:05.594446 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa98ab7-877e-4ccc-86c3-f11cda20d06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:05.595193 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-f53c86c4-1fb1-4cfd-803e-434373975c0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '497c2e822a744171885c59b987da7d42'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:05.595568 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa98ab7-877e-4ccc-86c3-f11cda20d06c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:05.595892 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa98ab7-877e-4ccc-86c3-f11cda20d06c admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:05.596172 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa98ab7-877e-4ccc-86c3-f11cda20d06c admin admin] PATH_INFO: `/v3/users/899c0ca26b774dcd95d2b9b88600ffaf` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:05.597581 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa98ab7-877e-4ccc-86c3-f11cda20d06c admin admin] RBAC: Authorizing `identity:delete_user(user_id=899c0ca26b774dcd95d2b9b88600ffaf)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:05.599692 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa98ab7-877e-4ccc-86c3-f11cda20d06c admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:05.605281 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-f53c86c4-1fb1-4cfd-803e-434373975c0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '497c2e822a744171885c59b987da7d42'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:05.612329 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 962/1931] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 16:51:05 2022] DELETE /identity/v3/users/497c2e822a744171885c59b987da7d42 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:51:05.619951 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f1c33-0412-466c-970e-85278b5a0356 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:05.620463 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f1c33-0412-466c-970e-85278b5a0356 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:05.621363 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f1c33-0412-466c-970e-85278b5a0356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:05.641477 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-1e6f1c33-0412-466c-970e-85278b5a0356 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:05.642824 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-1e6f1c33-0412-466c-970e-85278b5a0356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:05.708823 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 963/1932] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:51:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:05.727365 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6f1c33-0412-466c-970e-85278b5a0356 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:05.729467 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-1e6f1c33-0412-466c-970e-85278b5a0356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:05.787491 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6f1c33-0412-466c-970e-85278b5a0356 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:05.791731 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc067e4a-2e9d-400c-a391-ba9f2acae5a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:05.792393 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc067e4a-2e9d-400c-a391-ba9f2acae5a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:05.792679 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc067e4a-2e9d-400c-a391-ba9f2acae5a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:05.792952 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc067e4a-2e9d-400c-a391-ba9f2acae5a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:05.802698 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc067e4a-2e9d-400c-a391-ba9f2acae5a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:05.804519 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc067e4a-2e9d-400c-a391-ba9f2acae5a6 service neutron] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:05.817745 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 964/1933] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 16:51:05.918619 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-baa98ab7-877e-4ccc-86c3-f11cda20d06c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '899c0ca26b774dcd95d2b9b88600ffaf'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:05.935244 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-baa98ab7-877e-4ccc-86c3-f11cda20d06c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '899c0ca26b774dcd95d2b9b88600ffaf'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:05.936170 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-baa98ab7-877e-4ccc-86c3-f11cda20d06c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '899c0ca26b774dcd95d2b9b88600ffaf'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:05.945159 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-baa98ab7-877e-4ccc-86c3-f11cda20d06c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '899c0ca26b774dcd95d2b9b88600ffaf'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:06.077833 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-baa98ab7-877e-4ccc-86c3-f11cda20d06c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '899c0ca26b774dcd95d2b9b88600ffaf'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:06.085968 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 970/1934] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 16:51:05 2022] DELETE /identity/v3/users/899c0ca26b774dcd95d2b9b88600ffaf => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:06.091182 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e48a85-4a78-432d-a90d-fd3fd92507b9 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:06.091658 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e48a85-4a78-432d-a90d-fd3fd92507b9 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:06.092191 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e48a85-4a78-432d-a90d-fd3fd92507b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:06.122088 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-80e48a85-4a78-432d-a90d-fd3fd92507b9 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:06.122280 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa98ab7-877e-4ccc-86c3-f11cda20d06c admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:06.122397 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-80e48a85-4a78-432d-a90d-fd3fd92507b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:06.123611 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-baa98ab7-877e-4ccc-86c3-f11cda20d06c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:06.193681 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 965/1935] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:51:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:06.202133 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa98ab7-877e-4ccc-86c3-f11cda20d06c admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:06.204439 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e48a85-4a78-432d-a90d-fd3fd92507b9 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:06.205873 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-80e48a85-4a78-432d-a90d-fd3fd92507b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:06.209442 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0224d955-c6d7-41d3-a3f9-9a17ccc7e2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:06.210461 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224d955-c6d7-41d3-a3f9-9a17ccc7e2fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:06.210848 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224d955-c6d7-41d3-a3f9-9a17ccc7e2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:06.211191 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224d955-c6d7-41d3-a3f9-9a17ccc7e2fb admin admin] PATH_INFO: `/v3/projects/a3fd0d132c104be09f199eabf146fa56` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:06.212547 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0224d955-c6d7-41d3-a3f9-9a17ccc7e2fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3fd0d132c104be09f199eabf146fa56)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:06.214552 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0224d955-c6d7-41d3-a3f9-9a17ccc7e2fb admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:06.263468 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e48a85-4a78-432d-a90d-fd3fd92507b9 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:06.267172 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99963691-cb18-4dda-8171-72d97aac88ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:06.267854 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99963691-cb18-4dda-8171-72d97aac88ab service neutron] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:06.268140 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99963691-cb18-4dda-8171-72d97aac88ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:06.268420 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99963691-cb18-4dda-8171-72d97aac88ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:06.277352 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99963691-cb18-4dda-8171-72d97aac88ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:06.278785 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99963691-cb18-4dda-8171-72d97aac88ab service neutron] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:06.288656 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 966/1936] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 16:51:06.325732 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99963691-cb18-4dda-8171-72d97aac88ab service neutron] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:06.327137 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-99963691-cb18-4dda-8171-72d97aac88ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:06.341771 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99963691-cb18-4dda-8171-72d97aac88ab service neutron] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:06.347624 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:06.348141 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258ccd06-d934-4e2a-a0bf-f914ce9817b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:06.348980 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ccd06-d934-4e2a-a0bf-f914ce9817b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:06.349264 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ccd06-d934-4e2a-a0bf-f914ce9817b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:06.349537 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ccd06-d934-4e2a-a0bf-f914ce9817b3 admin admin] PATH_INFO: `/v3/projects/50f328b28751440c911ac7ed5f2c7ce1` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:06.350791 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258ccd06-d934-4e2a-a0bf-f914ce9817b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50f328b28751440c911ac7ed5f2c7ce1)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:06.354244 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258ccd06-d934-4e2a-a0bf-f914ce9817b3 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:06.375025 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-0224d955-c6d7-41d3-a3f9-9a17ccc7e2fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3fd0d132c104be09f199eabf146fa56', 'request_id': 'req-0224d955-c6d7-41d3-a3f9-9a17ccc7e2fb'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:06.381349 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-0224d955-c6d7-41d3-a3f9-9a17ccc7e2fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3fd0d132c104be09f199eabf146fa56', 'request_id': 'req-0224d955-c6d7-41d3-a3f9-9a17ccc7e2fb'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:06.387939 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-0224d955-c6d7-41d3-a3f9-9a17ccc7e2fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3fd0d132c104be09f199eabf146fa56', 'request_id': 'req-0224d955-c6d7-41d3-a3f9-9a17ccc7e2fb'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:06.469705 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:06.520625 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-0224d955-c6d7-41d3-a3f9-9a17ccc7e2fb admin admin] The token cache is being invalidate because project a3fd0d132c104be09f199eabf146fa56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:51:06.521036 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-0224d955-c6d7-41d3-a3f9-9a17ccc7e2fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:06.521646 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-0224d955-c6d7-41d3-a3f9-9a17ccc7e2fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:06.523488 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 971/1937] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 16:51:06 2022] DELETE /identity/v3/projects/a3fd0d132c104be09f199eabf146fa56 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:51:06.528030 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0224d955-c6d7-41d3-a3f9-9a17ccc7e2fb admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:06.529451 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-0224d955-c6d7-41d3-a3f9-9a17ccc7e2fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:06.537981 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-258ccd06-d934-4e2a-a0bf-f914ce9817b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50f328b28751440c911ac7ed5f2c7ce1', 'request_id': 'req-258ccd06-d934-4e2a-a0bf-f914ce9817b3'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:06.608791 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0224d955-c6d7-41d3-a3f9-9a17ccc7e2fb admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:06.649017 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-258ccd06-d934-4e2a-a0bf-f914ce9817b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50f328b28751440c911ac7ed5f2c7ce1', 'request_id': 'req-258ccd06-d934-4e2a-a0bf-f914ce9817b3'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:06.657044 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-258ccd06-d934-4e2a-a0bf-f914ce9817b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50f328b28751440c911ac7ed5f2c7ce1', 'request_id': 'req-258ccd06-d934-4e2a-a0bf-f914ce9817b3'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:06.672506 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-258ccd06-d934-4e2a-a0bf-f914ce9817b3 admin admin] The token cache is being invalidate because project 50f328b28751440c911ac7ed5f2c7ce1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:51:06.673029 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-258ccd06-d934-4e2a-a0bf-f914ce9817b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:06.674027 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-258ccd06-d934-4e2a-a0bf-f914ce9817b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:06.676003 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 967/1938] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 16:51:06 2022] DELETE /identity/v3/projects/50f328b28751440c911ac7ed5f2c7ce1 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:51:06.680044 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258ccd06-d934-4e2a-a0bf-f914ce9817b3 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:06.682265 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-258ccd06-d934-4e2a-a0bf-f914ce9817b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:06.700141 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8201a61-688a-4a33-82e4-22f7e8c6cc82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:06.701177 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8201a61-688a-4a33-82e4-22f7e8c6cc82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:06.701756 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8201a61-688a-4a33-82e4-22f7e8c6cc82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:06.701904 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8201a61-688a-4a33-82e4-22f7e8c6cc82 admin admin] PATH_INFO: `/v3/users/d497e6e36e284ff88343e78a90796786` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:06.706086 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8201a61-688a-4a33-82e4-22f7e8c6cc82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d497e6e36e284ff88343e78a90796786)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:06.708115 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8201a61-688a-4a33-82e4-22f7e8c6cc82 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:06.755202 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258ccd06-d934-4e2a-a0bf-f914ce9817b3 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:06.760896 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faa3b6a-a121-4464-b8f1-de38f3499c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:06.762059 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa3b6a-a121-4464-b8f1-de38f3499c2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:06.762532 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa3b6a-a121-4464-b8f1-de38f3499c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:06.763036 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa3b6a-a121-4464-b8f1-de38f3499c2e admin admin] PATH_INFO: `/v3/users/0ac21ecc85dd41f38dce1393df6715c9` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:06.764519 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faa3b6a-a121-4464-b8f1-de38f3499c2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ac21ecc85dd41f38dce1393df6715c9)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:06.766802 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faa3b6a-a121-4464-b8f1-de38f3499c2e admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:07.023685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-e8201a61-688a-4a33-82e4-22f7e8c6cc82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd497e6e36e284ff88343e78a90796786'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:07.025140 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-8faa3b6a-a121-4464-b8f1-de38f3499c2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ac21ecc85dd41f38dce1393df6715c9'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:07.026062 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-8faa3b6a-a121-4464-b8f1-de38f3499c2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ac21ecc85dd41f38dce1393df6715c9'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:07.046621 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-8faa3b6a-a121-4464-b8f1-de38f3499c2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ac21ecc85dd41f38dce1393df6715c9'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:07.055991 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-e8201a61-688a-4a33-82e4-22f7e8c6cc82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd497e6e36e284ff88343e78a90796786'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:07.057354 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-e8201a61-688a-4a33-82e4-22f7e8c6cc82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd497e6e36e284ff88343e78a90796786'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:07.065671 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-e8201a61-688a-4a33-82e4-22f7e8c6cc82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd497e6e36e284ff88343e78a90796786'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:07.154616 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-8faa3b6a-a121-4464-b8f1-de38f3499c2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ac21ecc85dd41f38dce1393df6715c9'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:07.163013 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-8faa3b6a-a121-4464-b8f1-de38f3499c2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ac21ecc85dd41f38dce1393df6715c9'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:07.170456 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 968/1939] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 16:51:06 2022] DELETE /identity/v3/users/0ac21ecc85dd41f38dce1393df6715c9 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:07.171473 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faa3b6a-a121-4464-b8f1-de38f3499c2e admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:07.172946 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-8faa3b6a-a121-4464-b8f1-de38f3499c2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:07.220873 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-e8201a61-688a-4a33-82e4-22f7e8c6cc82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd497e6e36e284ff88343e78a90796786'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:07.229626 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 972/1940] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 16:51:06 2022] DELETE /identity/v3/users/d497e6e36e284ff88343e78a90796786 => generated 0 bytes in 702 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:51:07.240552 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faa3b6a-a121-4464-b8f1-de38f3499c2e admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:07.308609 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0973b3-d365-47d2-8e1a-15cee37e386d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:07.309489 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0973b3-d365-47d2-8e1a-15cee37e386d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:07.309777 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0973b3-d365-47d2-8e1a-15cee37e386d admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:07.310053 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0973b3-d365-47d2-8e1a-15cee37e386d admin admin] PATH_INFO: `/v3/projects/53d2d328aa374c489bf6173f2918b30c` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:07.311275 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0973b3-d365-47d2-8e1a-15cee37e386d admin admin] RBAC: Authorizing `identity:delete_project(project_id=53d2d328aa374c489bf6173f2918b30c)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:07.313314 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0973b3-d365-47d2-8e1a-15cee37e386d admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:07.452731 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-0f0973b3-d365-47d2-8e1a-15cee37e386d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53d2d328aa374c489bf6173f2918b30c', 'request_id': 'req-0f0973b3-d365-47d2-8e1a-15cee37e386d'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:07.575399 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-0f0973b3-d365-47d2-8e1a-15cee37e386d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53d2d328aa374c489bf6173f2918b30c', 'request_id': 'req-0f0973b3-d365-47d2-8e1a-15cee37e386d'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:07.583067 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-0f0973b3-d365-47d2-8e1a-15cee37e386d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53d2d328aa374c489bf6173f2918b30c', 'request_id': 'req-0f0973b3-d365-47d2-8e1a-15cee37e386d'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:07.594535 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-0f0973b3-d365-47d2-8e1a-15cee37e386d admin admin] The token cache is being invalidate because project 53d2d328aa374c489bf6173f2918b30c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:51:07.594919 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-0f0973b3-d365-47d2-8e1a-15cee37e386d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:07.596162 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-0f0973b3-d365-47d2-8e1a-15cee37e386d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:07.597301 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 969/1941] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 16:51:07 2022] DELETE /identity/v3/projects/53d2d328aa374c489bf6173f2918b30c => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:07.601214 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8201a61-688a-4a33-82e4-22f7e8c6cc82 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:07.603004 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-e8201a61-688a-4a33-82e4-22f7e8c6cc82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:07.619617 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8201a61-688a-4a33-82e4-22f7e8c6cc82 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:07.680278 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa647353-c801-4073-a0bb-99176a04bff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:07.681614 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa647353-c801-4073-a0bb-99176a04bff0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:07.681896 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa647353-c801-4073-a0bb-99176a04bff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:07.682175 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa647353-c801-4073-a0bb-99176a04bff0 admin admin] PATH_INFO: `/v3/users/4febdf4d533047beb05d6d6e25f43a50` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:07.683418 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa647353-c801-4073-a0bb-99176a04bff0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4febdf4d533047beb05d6d6e25f43a50)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:07.685401 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa647353-c801-4073-a0bb-99176a04bff0 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:07.818594 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0973b3-d365-47d2-8e1a-15cee37e386d admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:07.819740 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-0f0973b3-d365-47d2-8e1a-15cee37e386d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:07.854117 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0973b3-d365-47d2-8e1a-15cee37e386d admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:07.859012 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21780c94-3ecb-4695-bc0a-2561cded3bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:07.859958 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21780c94-3ecb-4695-bc0a-2561cded3bc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:07.860241 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21780c94-3ecb-4695-bc0a-2561cded3bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:07.860655 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21780c94-3ecb-4695-bc0a-2561cded3bc6 admin admin] PATH_INFO: `/v3/projects/ce6a799339314e049a5e050a4741db3f` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:07.862649 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21780c94-3ecb-4695-bc0a-2561cded3bc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce6a799339314e049a5e050a4741db3f)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:07.865213 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21780c94-3ecb-4695-bc0a-2561cded3bc6 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:08.024814 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-aa647353-c801-4073-a0bb-99176a04bff0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4febdf4d533047beb05d6d6e25f43a50'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:08.033139 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-21780c94-3ecb-4695-bc0a-2561cded3bc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce6a799339314e049a5e050a4741db3f', 'request_id': 'req-21780c94-3ecb-4695-bc0a-2561cded3bc6'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:08.038530 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-aa647353-c801-4073-a0bb-99176a04bff0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4febdf4d533047beb05d6d6e25f43a50'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:08.039263 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-aa647353-c801-4073-a0bb-99176a04bff0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4febdf4d533047beb05d6d6e25f43a50'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:08.048183 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-aa647353-c801-4073-a0bb-99176a04bff0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4febdf4d533047beb05d6d6e25f43a50'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:08.140221 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-21780c94-3ecb-4695-bc0a-2561cded3bc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce6a799339314e049a5e050a4741db3f', 'request_id': 'req-21780c94-3ecb-4695-bc0a-2561cded3bc6'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:08.146761 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-21780c94-3ecb-4695-bc0a-2561cded3bc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce6a799339314e049a5e050a4741db3f', 'request_id': 'req-21780c94-3ecb-4695-bc0a-2561cded3bc6'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:08.159504 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-21780c94-3ecb-4695-bc0a-2561cded3bc6 admin admin] The token cache is being invalidate because project ce6a799339314e049a5e050a4741db3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:51:08.159843 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-21780c94-3ecb-4695-bc0a-2561cded3bc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:08.160562 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-21780c94-3ecb-4695-bc0a-2561cded3bc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:08.162229 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 970/1942] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 16:51:07 2022] DELETE /identity/v3/projects/ce6a799339314e049a5e050a4741db3f => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:08.163064 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21780c94-3ecb-4695-bc0a-2561cded3bc6 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:08.164394 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-21780c94-3ecb-4695-bc0a-2561cded3bc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:08.240584 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21780c94-3ecb-4695-bc0a-2561cded3bc6 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:08.246105 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d08130-5184-4bf0-a081-65f753c85a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:08.247067 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d08130-5184-4bf0-a081-65f753c85a56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:08.247356 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d08130-5184-4bf0-a081-65f753c85a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:08.247643 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d08130-5184-4bf0-a081-65f753c85a56 admin admin] PATH_INFO: `/v3/projects/dd1d5c574b62444fa229a8d2308a579c` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:08.248991 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d08130-5184-4bf0-a081-65f753c85a56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd1d5c574b62444fa229a8d2308a579c)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:08.250928 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d08130-5184-4bf0-a081-65f753c85a56 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:08.267939 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-aa647353-c801-4073-a0bb-99176a04bff0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4febdf4d533047beb05d6d6e25f43a50'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:08.277527 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 973/1943] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 16:51:07 2022] DELETE /identity/v3/users/4febdf4d533047beb05d6d6e25f43a50 => generated 0 bytes in 677 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:08.279242 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5602e963-fe1a-4a0d-a3e2-4f4965b6de87 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:08.279538 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5602e963-fe1a-4a0d-a3e2-4f4965b6de87 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:08.280298 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5602e963-fe1a-4a0d-a3e2-4f4965b6de87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:08.306377 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-5602e963-fe1a-4a0d-a3e2-4f4965b6de87 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:08.307603 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-5602e963-fe1a-4a0d-a3e2-4f4965b6de87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:08.395144 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 974/1944] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:51:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:08.403930 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c446032-24c2-445f-8f01-96325ddf3623 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:08.404295 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c446032-24c2-445f-8f01-96325ddf3623 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:08.404647 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c446032-24c2-445f-8f01-96325ddf3623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:08.428003 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-1c446032-24c2-445f-8f01-96325ddf3623 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:08.428003 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-1c446032-24c2-445f-8f01-96325ddf3623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:08.435798 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 975/1945] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:51:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:51:08.440321 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c446032-24c2-445f-8f01-96325ddf3623 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:08.450463 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c446032-24c2-445f-8f01-96325ddf3623 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:08.455257 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f32ca-512d-478b-a1de-746141e0e3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:08.455943 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f32ca-512d-478b-a1de-746141e0e3b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:08.456225 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f32ca-512d-478b-a1de-746141e0e3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:08.456525 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f32ca-512d-478b-a1de-746141e0e3b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:08.457254 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921f32ca-512d-478b-a1de-746141e0e3b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:51:08.457561 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921f32ca-512d-478b-a1de-746141e0e3b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:08.459200 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921f32ca-512d-478b-a1de-746141e0e3b4 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:08.483863 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 976/1946] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Jul 18 16:51:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:51:08.485555 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f32ca-512d-478b-a1de-746141e0e3b4 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:08.485791 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-82d08130-5184-4bf0-a081-65f753c85a56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd1d5c574b62444fa229a8d2308a579c', 'request_id': 'req-82d08130-5184-4bf0-a081-65f753c85a56'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:08.497029 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f32ca-512d-478b-a1de-746141e0e3b4 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:08.569879 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383e4858-f69c-45e7-8d06-6e63c2c6c9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:08.570586 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e4858-f69c-45e7-8d06-6e63c2c6c9c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:08.570871 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e4858-f69c-45e7-8d06-6e63c2c6c9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:08.571224 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e4858-f69c-45e7-8d06-6e63c2c6c9c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:08.572019 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383e4858-f69c-45e7-8d06-6e63c2c6c9c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:08.573938 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383e4858-f69c-45e7-8d06-6e63c2c6c9c2 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:08.592096 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-82d08130-5184-4bf0-a081-65f753c85a56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd1d5c574b62444fa229a8d2308a579c', 'request_id': 'req-82d08130-5184-4bf0-a081-65f753c85a56'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:08.598222 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-82d08130-5184-4bf0-a081-65f753c85a56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd1d5c574b62444fa229a8d2308a579c', 'request_id': 'req-82d08130-5184-4bf0-a081-65f753c85a56'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:08.609903 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-82d08130-5184-4bf0-a081-65f753c85a56 admin admin] The token cache is being invalidate because project dd1d5c574b62444fa229a8d2308a579c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:51:08.610179 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-82d08130-5184-4bf0-a081-65f753c85a56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:08.610823 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-82d08130-5184-4bf0-a081-65f753c85a56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:08.612432 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 971/1947] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 16:51:08 2022] DELETE /identity/v3/projects/dd1d5c574b62444fa229a8d2308a579c => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:08.617000 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eac21a-d22d-4f80-90b5-bc069516740a None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:08.617285 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eac21a-d22d-4f80-90b5-bc069516740a None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:08.617565 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eac21a-d22d-4f80-90b5-bc069516740a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:08.637270 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-a2eac21a-d22d-4f80-90b5-bc069516740a None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:08.638498 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-a2eac21a-d22d-4f80-90b5-bc069516740a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:08.647250 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 972/1948] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:51:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:51:08.654973 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed25032-b33e-46fc-a764-ad087e95366c None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:08.655259 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed25032-b33e-46fc-a764-ad087e95366c None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:08.655535 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed25032-b33e-46fc-a764-ad087e95366c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:08.673703 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-aed25032-b33e-46fc-a764-ad087e95366c None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:08.675783 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-aed25032-b33e-46fc-a764-ad087e95366c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:08.684766 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 973/1949] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:51:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:51:08.691176 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed25032-b33e-46fc-a764-ad087e95366c None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:08.700159 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed25032-b33e-46fc-a764-ad087e95366c None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:08.705217 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7716ecb-7335-43e7-8406-7208ad7c88e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:08.705865 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7716ecb-7335-43e7-8406-7208ad7c88e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:08.706144 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7716ecb-7335-43e7-8406-7208ad7c88e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:08.706415 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7716ecb-7335-43e7-8406-7208ad7c88e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:08.707131 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7716ecb-7335-43e7-8406-7208ad7c88e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:51:08.707431 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7716ecb-7335-43e7-8406-7208ad7c88e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:08.709114 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7716ecb-7335-43e7-8406-7208ad7c88e5 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:08.721001 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 974/1950] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Jul 18 16:51:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:51:08.729033 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 977/1951] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:51:08 2022] POST /identity/v3/projects => generated 385 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:08.732042 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7716ecb-7335-43e7-8406-7208ad7c88e5 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:08.733246 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383e4858-f69c-45e7-8d06-6e63c2c6c9c2 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:08.735552 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-383e4858-f69c-45e7-8d06-6e63c2c6c9c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:08.742651 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7716ecb-7335-43e7-8406-7208ad7c88e5 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:08.812574 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004d342b-9bae-43ce-9092-cf3703e13a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:08.813507 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d342b-9bae-43ce-9092-cf3703e13a5a admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:08.813932 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d342b-9bae-43ce-9092-cf3703e13a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:08.814360 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d342b-9bae-43ce-9092-cf3703e13a5a admin admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:08.815638 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004d342b-9bae-43ce-9092-cf3703e13a5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:08.816105 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383e4858-f69c-45e7-8d06-6e63c2c6c9c2 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:08.818001 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004d342b-9bae-43ce-9092-cf3703e13a5a admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:08.821169 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d929a7-134f-45c5-ac02-35de98d1f438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:08.821929 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d929a7-134f-45c5-ac02-35de98d1f438 admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:08.822309 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d929a7-134f-45c5-ac02-35de98d1f438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:08.822677 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d929a7-134f-45c5-ac02-35de98d1f438 admin admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:08.823476 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d929a7-134f-45c5-ac02-35de98d1f438 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:08.826619 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d929a7-134f-45c5-ac02-35de98d1f438 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:09.031447 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 975/1952] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:51:08 2022] POST /identity/v3/projects => generated 373 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:09.032242 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004d342b-9bae-43ce-9092-cf3703e13a5a admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:09.033755 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-004d342b-9bae-43ce-9092-cf3703e13a5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:09.063486 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 978/1953] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 16:51:08 2022] POST /identity/v3/users => generated 293 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:09.063486 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d929a7-134f-45c5-ac02-35de98d1f438 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:09.072520 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d929a7-134f-45c5-ac02-35de98d1f438 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:09.102254 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004d342b-9bae-43ce-9092-cf3703e13a5a admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:09.107875 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa80933d-33f8-4983-858d-467780271206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:09.108749 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80933d-33f8-4983-858d-467780271206 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:09.109031 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80933d-33f8-4983-858d-467780271206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:09.109324 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80933d-33f8-4983-858d-467780271206 admin admin] PATH_INFO: `/v3/projects/670a70375c3d4b598e25d3d8f5d03cec` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:09.110546 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa80933d-33f8-4983-858d-467780271206 admin admin] RBAC: Authorizing `identity:delete_project(project_id=670a70375c3d4b598e25d3d8f5d03cec)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:09.112533 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa80933d-33f8-4983-858d-467780271206 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:09.130497 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea5fae-6068-481b-9969-b3e4673cec1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:09.131240 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea5fae-6068-481b-9969-b3e4673cec1e admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:09.131526 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea5fae-6068-481b-9969-b3e4673cec1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:09.131831 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea5fae-6068-481b-9969-b3e4673cec1e admin admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:09.132544 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea5fae-6068-481b-9969-b3e4673cec1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:09.134632 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea5fae-6068-481b-9969-b3e4673cec1e admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:09.234133 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-fa80933d-33f8-4983-858d-467780271206 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '670a70375c3d4b598e25d3d8f5d03cec', 'request_id': 'req-fa80933d-33f8-4983-858d-467780271206'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:09.261601 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 979/1954] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 16:51:09 2022] POST /identity/v3/users => generated 287 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:09.261601 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea5fae-6068-481b-9969-b3e4673cec1e admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:09.269884 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea5fae-6068-481b-9969-b3e4673cec1e admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:09.328403 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b038a8-aeed-40a0-9314-0a799ad14ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:09.329083 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b038a8-aeed-40a0-9314-0a799ad14ff7 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:09.329370 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b038a8-aeed-40a0-9314-0a799ad14ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:09.329647 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b038a8-aeed-40a0-9314-0a799ad14ff7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:09.330375 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b038a8-aeed-40a0-9314-0a799ad14ff7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:09.332007 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b038a8-aeed-40a0-9314-0a799ad14ff7 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:09.340211 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-fa80933d-33f8-4983-858d-467780271206 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '670a70375c3d4b598e25d3d8f5d03cec', 'request_id': 'req-fa80933d-33f8-4983-858d-467780271206'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:09.343934 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 980/1955] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:09 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:09.344943 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b038a8-aeed-40a0-9314-0a799ad14ff7 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:09.350097 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-fa80933d-33f8-4983-858d-467780271206 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '670a70375c3d4b598e25d3d8f5d03cec', 'request_id': 'req-fa80933d-33f8-4983-858d-467780271206'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:09.361818 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b038a8-aeed-40a0-9314-0a799ad14ff7 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:09.385254 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1499698-9f6c-4f19-ace6-43fb0addff7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:09.385254 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1499698-9f6c-4f19-ace6-43fb0addff7e admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:09.385254 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1499698-9f6c-4f19-ace6-43fb0addff7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:09.385254 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1499698-9f6c-4f19-ace6-43fb0addff7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:09.385635 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1499698-9f6c-4f19-ace6-43fb0addff7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:09.385705 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-fa80933d-33f8-4983-858d-467780271206 admin admin] The token cache is being invalidate because project 670a70375c3d4b598e25d3d8f5d03cec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:51:09.385705 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-fa80933d-33f8-4983-858d-467780271206 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:09.385833 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1499698-9f6c-4f19-ace6-43fb0addff7e admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:09.385910 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-fa80933d-33f8-4983-858d-467780271206 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:09.385910 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 976/1956] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 16:51:09 2022] DELETE /identity/v3/projects/670a70375c3d4b598e25d3d8f5d03cec => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:09.386310 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa80933d-33f8-4983-858d-467780271206 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:09.388990 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-fa80933d-33f8-4983-858d-467780271206 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:09.399048 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 981/1957] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:09 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:09.401302 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f83080-6761-40cc-aaa9-35d84e732c38 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:09.401704 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f83080-6761-40cc-aaa9-35d84e732c38 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:09.402006 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f83080-6761-40cc-aaa9-35d84e732c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:09.409384 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa80933d-33f8-4983-858d-467780271206 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:09.420143 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedb746d-debe-4ab2-bdb5-e2856f8084ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:09.421016 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb746d-debe-4ab2-bdb5-e2856f8084ef admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:09.421265 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-d1f83080-6761-40cc-aaa9-35d84e732c38 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:09.421455 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb746d-debe-4ab2-bdb5-e2856f8084ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:09.421734 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb746d-debe-4ab2-bdb5-e2856f8084ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:09.422463 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedb746d-debe-4ab2-bdb5-e2856f8084ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:09.422553 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-d1f83080-6761-40cc-aaa9-35d84e732c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:09.424268 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedb746d-debe-4ab2-bdb5-e2856f8084ef admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:09.435803 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 982/1958] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:51:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:09.436829 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f83080-6761-40cc-aaa9-35d84e732c38 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:09.442723 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-d1f83080-6761-40cc-aaa9-35d84e732c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:09.445271 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 977/1959] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:09 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:09.450477 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e76a46-2019-44eb-915a-0f5b6010461a None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:09.450477 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e76a46-2019-44eb-915a-0f5b6010461a None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:09.450477 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e76a46-2019-44eb-915a-0f5b6010461a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:09.459839 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f83080-6761-40cc-aaa9-35d84e732c38 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:09.476348 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee1a64-5c34-47ed-a3d7-3b3c28656714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:09.477120 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee1a64-5c34-47ed-a3d7-3b3c28656714 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:09.477615 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee1a64-5c34-47ed-a3d7-3b3c28656714 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:09.477986 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee1a64-5c34-47ed-a3d7-3b3c28656714 admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:09.478782 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee1a64-5c34-47ed-a3d7-3b3c28656714 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:09.480499 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee1a64-5c34-47ed-a3d7-3b3c28656714 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:09.481786 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-d0e76a46-2019-44eb-915a-0f5b6010461a None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:09.485046 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-d0e76a46-2019-44eb-915a-0f5b6010461a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:09.492963 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 978/1960] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:51:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:09.493889 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e76a46-2019-44eb-915a-0f5b6010461a None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:09.499662 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 983/1961] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:09 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:09.499662 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee1a64-5c34-47ed-a3d7-3b3c28656714 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:09.504665 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e76a46-2019-44eb-915a-0f5b6010461a None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:09.511694 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d21f8-8440-4188-9db0-e22c3da238f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:09.512389 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee1a64-5c34-47ed-a3d7-3b3c28656714 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:09.512887 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d21f8-8440-4188-9db0-e22c3da238f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:09.513314 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d21f8-8440-4188-9db0-e22c3da238f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:09.513392 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d21f8-8440-4188-9db0-e22c3da238f8 admin admin] PATH_INFO: `/v3/projects/4d8fa60080a848798bfb952359c5fa49/users/0dae7055217b40cbb744620fac5d75f3/roles/ad3a2bc7b2094a4da1a95a143c8d9436` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:09.518854 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e884459e-ba8a-4bde-9031-43bcea8c5af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:09.519534 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e884459e-ba8a-4bde-9031-43bcea8c5af6 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:09.519873 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e884459e-ba8a-4bde-9031-43bcea8c5af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:09.520143 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e884459e-ba8a-4bde-9031-43bcea8c5af6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:09.520887 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e884459e-ba8a-4bde-9031-43bcea8c5af6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:51:09.521197 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e884459e-ba8a-4bde-9031-43bcea8c5af6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:09.522802 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e884459e-ba8a-4bde-9031-43bcea8c5af6 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:09.528538 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:09.530343 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437d21f8-8440-4188-9db0-e22c3da238f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d8fa60080a848798bfb952359c5fa49, user_id=0dae7055217b40cbb744620fac5d75f3, role_id=ad3a2bc7b2094a4da1a95a143c8d9436)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:09.533186 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437d21f8-8440-4188-9db0-e22c3da238f8 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:09.539300 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 984/1962] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Jul 18 16:51:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:51:09.541069 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e884459e-ba8a-4bde-9031-43bcea8c5af6 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:09.551856 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e884459e-ba8a-4bde-9031-43bcea8c5af6 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:09.558471 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8ece00-5c76-4f77-b768-4edd611291ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:09.559499 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ece00-5c76-4f77-b768-4edd611291ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:09.560660 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ece00-5c76-4f77-b768-4edd611291ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:09.560660 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ece00-5c76-4f77-b768-4edd611291ea admin admin] PATH_INFO: `/v3/projects/39faf8793bef41dca428af9e1c5daab3/users/42b46c68ebb54db98486579baefbea7d/roles/ad3a2bc7b2094a4da1a95a143c8d9436` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:09.578546 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8ece00-5c76-4f77-b768-4edd611291ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=39faf8793bef41dca428af9e1c5daab3, user_id=42b46c68ebb54db98486579baefbea7d, role_id=ad3a2bc7b2094a4da1a95a143c8d9436)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:09.582372 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8ece00-5c76-4f77-b768-4edd611291ea admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:09.643365 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 979/1963] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:51:09 2022] PUT /identity/v3/projects/4d8fa60080a848798bfb952359c5fa49/users/0dae7055217b40cbb744620fac5d75f3/roles/ad3a2bc7b2094a4da1a95a143c8d9436 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:09.644471 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d21f8-8440-4188-9db0-e22c3da238f8 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:09.693243 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 985/1964] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:51:09 2022] PUT /identity/v3/projects/39faf8793bef41dca428af9e1c5daab3/users/42b46c68ebb54db98486579baefbea7d/roles/ad3a2bc7b2094a4da1a95a143c8d9436 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:09.694944 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce02a9c-dddf-4340-820d-9a1210e1e23e None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:09.695314 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce02a9c-dddf-4340-820d-9a1210e1e23e None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:09.695744 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce02a9c-dddf-4340-820d-9a1210e1e23e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:09.728381 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-8ce02a9c-dddf-4340-820d-9a1210e1e23e None None] MFA Rules not processed for user `0dae7055217b40cbb744620fac5d75f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:09.729987 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-8ce02a9c-dddf-4340-820d-9a1210e1e23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:09.743542 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d21f8-8440-4188-9db0-e22c3da238f8 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:09.804218 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 986/1965] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:51:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:09.805862 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2545d6f-6db6-4a51-88f8-be9994664e12 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:09.806305 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2545d6f-6db6-4a51-88f8-be9994664e12 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:09.806748 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2545d6f-6db6-4a51-88f8-be9994664e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:09.810532 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f41e1c-d9ab-4394-9d25-85790a7fff62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:09.811347 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f41e1c-d9ab-4394-9d25-85790a7fff62 admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:09.811778 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f41e1c-d9ab-4394-9d25-85790a7fff62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:09.812062 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f41e1c-d9ab-4394-9d25-85790a7fff62 admin admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:09.812776 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f41e1c-d9ab-4394-9d25-85790a7fff62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:09.814701 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f41e1c-d9ab-4394-9d25-85790a7fff62 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:09.843318 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-a2545d6f-6db6-4a51-88f8-be9994664e12 None None] MFA Rules not processed for user `42b46c68ebb54db98486579baefbea7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:09.844579 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-a2545d6f-6db6-4a51-88f8-be9994664e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:09.918098 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 987/1966] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:51:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:09.919150 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2545d6f-6db6-4a51-88f8-be9994664e12 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:09.931543 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 980/1967] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:51:09 2022] POST /identity/v3/projects => generated 381 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:09.932827 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f41e1c-d9ab-4394-9d25-85790a7fff62 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:09.933454 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2545d6f-6db6-4a51-88f8-be9994664e12 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:09.934663 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-73f41e1c-d9ab-4394-9d25-85790a7fff62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:09.959216 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:09.997559 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a75896-96b1-47d2-89d7-9a57e3e53c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:09.998362 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a75896-96b1-47d2-89d7-9a57e3e53c7a admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:09.998548 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a75896-96b1-47d2-89d7-9a57e3e53c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:09.998892 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a75896-96b1-47d2-89d7-9a57e3e53c7a admin admin] PATH_INFO: `/v3/projects` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:09.999564 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a75896-96b1-47d2-89d7-9a57e3e53c7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:10.000257 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f41e1c-d9ab-4394-9d25-85790a7fff62 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:10.001526 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a75896-96b1-47d2-89d7-9a57e3e53c7a admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:10.004088 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283dc04e-1213-4ff9-b555-7e697b4e9542 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:10.004728 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283dc04e-1213-4ff9-b555-7e697b4e9542 service cinder] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:10.005007 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283dc04e-1213-4ff9-b555-7e697b4e9542 service cinder] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:10.005278 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283dc04e-1213-4ff9-b555-7e697b4e9542 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:10.062901 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283dc04e-1213-4ff9-b555-7e697b4e9542 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:10.062901 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283dc04e-1213-4ff9-b555-7e697b4e9542 service cinder] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:10.072665 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 981/1968] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:09 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:51:10.073511 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283dc04e-1213-4ff9-b555-7e697b4e9542 service cinder] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:10.083950 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283dc04e-1213-4ff9-b555-7e697b4e9542 service cinder] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:10.089759 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ded3d5-8ff0-474c-9c94-67edb7b37331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:10.090418 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ded3d5-8ff0-474c-9c94-67edb7b37331 admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:10.091168 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ded3d5-8ff0-474c-9c94-67edb7b37331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:10.091457 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ded3d5-8ff0-474c-9c94-67edb7b37331 admin admin] PATH_INFO: `/v3/users` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:10.092201 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ded3d5-8ff0-474c-9c94-67edb7b37331 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:10.094166 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ded3d5-8ff0-474c-9c94-67edb7b37331 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:10.137354 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 988/1969] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:51:09 2022] POST /identity/v3/projects => generated 385 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:10.141595 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a75896-96b1-47d2-89d7-9a57e3e53c7a admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:10.207448 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a75896-96b1-47d2-89d7-9a57e3e53c7a admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:10.212757 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db77743e-0f5f-4f67-8dc8-92d46890c56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:10.213634 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db77743e-0f5f-4f67-8dc8-92d46890c56e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:10.216179 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db77743e-0f5f-4f67-8dc8-92d46890c56e admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:10.216179 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db77743e-0f5f-4f67-8dc8-92d46890c56e admin admin] PATH_INFO: `/v3/users/42b46c68ebb54db98486579baefbea7d` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:10.216179 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db77743e-0f5f-4f67-8dc8-92d46890c56e admin admin] RBAC: Authorizing `identity:delete_user(user_id=42b46c68ebb54db98486579baefbea7d)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:10.217481 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db77743e-0f5f-4f67-8dc8-92d46890c56e admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:10.251119 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 982/1970] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 16:51:10 2022] POST /identity/v3/users => generated 291 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:10.251119 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ded3d5-8ff0-474c-9c94-67edb7b37331 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:10.261404 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ded3d5-8ff0-474c-9c94-67edb7b37331 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:10.266128 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359cd0ec-4e8a-41a4-bd39-23256494ef4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:10.266778 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359cd0ec-4e8a-41a4-bd39-23256494ef4f admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:10.267061 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359cd0ec-4e8a-41a4-bd39-23256494ef4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:10.267359 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359cd0ec-4e8a-41a4-bd39-23256494ef4f admin admin] PATH_INFO: `/v3/users` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:10.268141 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359cd0ec-4e8a-41a4-bd39-23256494ef4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:10.270060 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359cd0ec-4e8a-41a4-bd39-23256494ef4f admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:10.427562 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 983/1971] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 16:51:10 2022] POST /identity/v3/users => generated 299 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:10.428628 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359cd0ec-4e8a-41a4-bd39-23256494ef4f admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:10.451587 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359cd0ec-4e8a-41a4-bd39-23256494ef4f admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:10.457407 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4420a406-c494-41cc-bec7-54974c7d88d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:10.457912 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420a406-c494-41cc-bec7-54974c7d88d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:10.458200 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420a406-c494-41cc-bec7-54974c7d88d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:10.458479 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420a406-c494-41cc-bec7-54974c7d88d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:10.474661 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-db77743e-0f5f-4f67-8dc8-92d46890c56e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42b46c68ebb54db98486579baefbea7d'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:10.477403 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4420a406-c494-41cc-bec7-54974c7d88d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:10.479098 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4420a406-c494-41cc-bec7-54974c7d88d1 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:10.491979 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 984/1972] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:10.494955 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4420a406-c494-41cc-bec7-54974c7d88d1 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:10.498702 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-db77743e-0f5f-4f67-8dc8-92d46890c56e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42b46c68ebb54db98486579baefbea7d'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:10.499634 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-db77743e-0f5f-4f67-8dc8-92d46890c56e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42b46c68ebb54db98486579baefbea7d'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:10.512712 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-db77743e-0f5f-4f67-8dc8-92d46890c56e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42b46c68ebb54db98486579baefbea7d'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:10.516846 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4420a406-c494-41cc-bec7-54974c7d88d1 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:10.522158 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e45efa1-0f1f-4711-928f-ea13c9367245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:10.522848 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e45efa1-0f1f-4711-928f-ea13c9367245 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:10.523132 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e45efa1-0f1f-4711-928f-ea13c9367245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:10.524138 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e45efa1-0f1f-4711-928f-ea13c9367245 admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:10.524138 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e45efa1-0f1f-4711-928f-ea13c9367245 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:10.530029 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e45efa1-0f1f-4711-928f-ea13c9367245 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:10.537917 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 985/1973] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:10.539555 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e45efa1-0f1f-4711-928f-ea13c9367245 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:10.552914 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e45efa1-0f1f-4711-928f-ea13c9367245 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:10.558757 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82adfee8-87cc-46fc-8f40-b9d998eab8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:10.560731 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82adfee8-87cc-46fc-8f40-b9d998eab8d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:10.560731 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82adfee8-87cc-46fc-8f40-b9d998eab8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:10.560731 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82adfee8-87cc-46fc-8f40-b9d998eab8d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:10.561143 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82adfee8-87cc-46fc-8f40-b9d998eab8d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:10.562477 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82adfee8-87cc-46fc-8f40-b9d998eab8d9 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:10.574304 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 986/1974] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:10.575132 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82adfee8-87cc-46fc-8f40-b9d998eab8d9 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:10.580773 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-db77743e-0f5f-4f67-8dc8-92d46890c56e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42b46c68ebb54db98486579baefbea7d'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:10.588663 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82adfee8-87cc-46fc-8f40-b9d998eab8d9 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:10.589770 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 989/1975] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 16:51:10 2022] DELETE /identity/v3/users/42b46c68ebb54db98486579baefbea7d => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:10.590441 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db77743e-0f5f-4f67-8dc8-92d46890c56e admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:10.591824 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-db77743e-0f5f-4f67-8dc8-92d46890c56e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:10.667590 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b338992a-5782-4d3b-b02f-d411a6dc943e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:10.667590 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b338992a-5782-4d3b-b02f-d411a6dc943e admin admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:10.667590 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b338992a-5782-4d3b-b02f-d411a6dc943e admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:10.667590 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b338992a-5782-4d3b-b02f-d411a6dc943e admin admin] PATH_INFO: `/v3/projects/fb9a2d3de3324f22bb8989f781d7fa4d/users/746aadc6a15941cc9a65d278160a34df/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:10.677612 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db77743e-0f5f-4f67-8dc8-92d46890c56e admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:10.682907 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c6e84-7e58-4fc2-b572-88d0ae61835d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:10.683835 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c6e84-7e58-4fc2-b572-88d0ae61835d admin admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:10.684122 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c6e84-7e58-4fc2-b572-88d0ae61835d admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:10.684397 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c6e84-7e58-4fc2-b572-88d0ae61835d admin admin] PATH_INFO: `/v3/projects/21076e4195a8408e85fec61ad05b1888/users/6d78fd6f9eae4f5582c138be1e8125d2/roles/ad3a2bc7b2094a4da1a95a143c8d9436` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:10.685233 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b338992a-5782-4d3b-b02f-d411a6dc943e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb9a2d3de3324f22bb8989f781d7fa4d, user_id=746aadc6a15941cc9a65d278160a34df, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:10.688135 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b338992a-5782-4d3b-b02f-d411a6dc943e admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:10.699846 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3c6e84-7e58-4fc2-b572-88d0ae61835d admin admin] RBAC: Authorizing `identity:create_grant(project_id=21076e4195a8408e85fec61ad05b1888, user_id=6d78fd6f9eae4f5582c138be1e8125d2, role_id=ad3a2bc7b2094a4da1a95a143c8d9436)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:10.702493 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3c6e84-7e58-4fc2-b572-88d0ae61835d admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:10.776179 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 987/1976] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:51:10 2022] PUT /identity/v3/projects/fb9a2d3de3324f22bb8989f781d7fa4d/users/746aadc6a15941cc9a65d278160a34df/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:10.777712 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e673db-7797-48da-a48f-bfa3201c9cfe None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:10.777997 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e673db-7797-48da-a48f-bfa3201c9cfe None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:10.778314 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e673db-7797-48da-a48f-bfa3201c9cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:10.798550 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-03e673db-7797-48da-a48f-bfa3201c9cfe None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:10.799962 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-03e673db-7797-48da-a48f-bfa3201c9cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:10.804334 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 990/1977] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:51:10 2022] PUT /identity/v3/projects/21076e4195a8408e85fec61ad05b1888/users/6d78fd6f9eae4f5582c138be1e8125d2/roles/ad3a2bc7b2094a4da1a95a143c8d9436 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:10.805125 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c6e84-7e58-4fc2-b572-88d0ae61835d admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:10.817772 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-6f3c6e84-7e58-4fc2-b572-88d0ae61835d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:10.863358 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 988/1978] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:51:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:10.865297 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14543914-7e22-40b4-b247-dc17f33ea395 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:10.865575 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14543914-7e22-40b4-b247-dc17f33ea395 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:10.865850 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14543914-7e22-40b4-b247-dc17f33ea395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:10.897522 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-14543914-7e22-40b4-b247-dc17f33ea395 None None] MFA Rules not processed for user `6d78fd6f9eae4f5582c138be1e8125d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:10.897982 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c6e84-7e58-4fc2-b572-88d0ae61835d admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:10.899120 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-14543914-7e22-40b4-b247-dc17f33ea395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:10.910258 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1c5f64-904b-4b55-b304-85d052e0b158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:10.911040 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c5f64-904b-4b55-b304-85d052e0b158 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:10.911429 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c5f64-904b-4b55-b304-85d052e0b158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:10.911603 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c5f64-904b-4b55-b304-85d052e0b158 admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:10.912377 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1c5f64-904b-4b55-b304-85d052e0b158 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:10.914003 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1c5f64-904b-4b55-b304-85d052e0b158 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:10.925540 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 991/1979] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:10.926759 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1c5f64-904b-4b55-b304-85d052e0b158 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:10.929567 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-ce1c5f64-904b-4b55-b304-85d052e0b158 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:10.977179 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 989/1980] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:51:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:10.980186 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14543914-7e22-40b4-b247-dc17f33ea395 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:10.992947 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14543914-7e22-40b4-b247-dc17f33ea395 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:10.997643 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f6d0a8-d277-42de-ad2d-3c880fec5b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:10.998564 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f6d0a8-d277-42de-ad2d-3c880fec5b32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:10.998849 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f6d0a8-d277-42de-ad2d-3c880fec5b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:10.999127 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f6d0a8-d277-42de-ad2d-3c880fec5b32 admin admin] PATH_INFO: `/v3/projects/fb9a2d3de3324f22bb8989f781d7fa4d/users/746aadc6a15941cc9a65d278160a34df/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:11.001206 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f6d0a8-d277-42de-ad2d-3c880fec5b32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb9a2d3de3324f22bb8989f781d7fa4d, user_id=746aadc6a15941cc9a65d278160a34df, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:11.004069 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f6d0a8-d277-42de-ad2d-3c880fec5b32 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:11.015105 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1c5f64-904b-4b55-b304-85d052e0b158 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:11.016578 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 990/1981] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:51:10 2022] PUT /identity/v3/projects/fb9a2d3de3324f22bb8989f781d7fa4d/users/746aadc6a15941cc9a65d278160a34df/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:11.017426 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f6d0a8-d277-42de-ad2d-3c880fec5b32 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:11.089311 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d59b8f8-6cec-4716-a75d-26aa5470ef52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:11.089962 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59b8f8-6cec-4716-a75d-26aa5470ef52 service neutron] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:11.090251 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59b8f8-6cec-4716-a75d-26aa5470ef52 service neutron] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:11.090528 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59b8f8-6cec-4716-a75d-26aa5470ef52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:11.111329 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f6d0a8-d277-42de-ad2d-3c880fec5b32 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:11.116489 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439cc5bc-e051-4ee1-b1c3-06ab79aff3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:11.117153 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439cc5bc-e051-4ee1-b1c3-06ab79aff3a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:11.117360 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439cc5bc-e051-4ee1-b1c3-06ab79aff3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:11.117637 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439cc5bc-e051-4ee1-b1c3-06ab79aff3a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:11.118874 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439cc5bc-e051-4ee1-b1c3-06ab79aff3a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:11.120916 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439cc5bc-e051-4ee1-b1c3-06ab79aff3a4 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:11.154192 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d59b8f8-6cec-4716-a75d-26aa5470ef52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:11.155787 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d59b8f8-6cec-4716-a75d-26aa5470ef52 service neutron] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:11.165538 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 992/1982] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:51:11.166807 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204871ed-c293-42f2-86e6-585e4bb9a6a8 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:11.167091 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204871ed-c293-42f2-86e6-585e4bb9a6a8 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:11.167363 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204871ed-c293-42f2-86e6-585e4bb9a6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:11.188931 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:11.210892 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-204871ed-c293-42f2-86e6-585e4bb9a6a8 None None] MFA Rules not processed for user `746aadc6a15941cc9a65d278160a34df`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:11.210892 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-204871ed-c293-42f2-86e6-585e4bb9a6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:11.277637 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 993/1983] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:51:11 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:11.288534 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204871ed-c293-42f2-86e6-585e4bb9a6a8 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:11.289960 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-204871ed-c293-42f2-86e6-585e4bb9a6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:11.298567 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 991/1984] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:51:11 2022] POST /identity/v3/projects => generated 383 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:11.304255 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439cc5bc-e051-4ee1-b1c3-06ab79aff3a4 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:11.350200 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204871ed-c293-42f2-86e6-585e4bb9a6a8 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:11.366040 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439cc5bc-e051-4ee1-b1c3-06ab79aff3a4 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:11.370826 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049efa9b-35f8-496c-9d1d-24ae31929417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:11.371461 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049efa9b-35f8-496c-9d1d-24ae31929417 admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:11.371775 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049efa9b-35f8-496c-9d1d-24ae31929417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:11.372059 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049efa9b-35f8-496c-9d1d-24ae31929417 admin admin] PATH_INFO: `/v3/users` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:11.372760 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049efa9b-35f8-496c-9d1d-24ae31929417 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:11.374690 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049efa9b-35f8-496c-9d1d-24ae31929417 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:11.404008 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e10659e-71e4-4871-8cc1-4b63885eb2da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:11.404822 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10659e-71e4-4871-8cc1-4b63885eb2da service cinder] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:11.405204 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10659e-71e4-4871-8cc1-4b63885eb2da service cinder] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:11.405725 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10659e-71e4-4871-8cc1-4b63885eb2da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:11.407296 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-7e10659e-71e4-4871-8cc1-4b63885eb2da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:11.479790 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e10659e-71e4-4871-8cc1-4b63885eb2da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:11.483020 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e10659e-71e4-4871-8cc1-4b63885eb2da service cinder] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:11.490793 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 994/1985] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 16:51:11.511836 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 992/1986] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 16:51:11 2022] POST /identity/v3/users => generated 298 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:51:11.515651 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e10659e-71e4-4871-8cc1-4b63885eb2da service cinder] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:11.526788 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e10659e-71e4-4871-8cc1-4b63885eb2da service cinder] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:11.532063 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157144fd-3862-4c19-80c8-06484a5a39ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:11.532832 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157144fd-3862-4c19-80c8-06484a5a39ad admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:11.534616 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157144fd-3862-4c19-80c8-06484a5a39ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:11.534616 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157144fd-3862-4c19-80c8-06484a5a39ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:11.534616 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157144fd-3862-4c19-80c8-06484a5a39ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:11.536096 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157144fd-3862-4c19-80c8-06484a5a39ad admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:11.551070 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 995/1987] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:11.561111 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049efa9b-35f8-496c-9d1d-24ae31929417 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:11.572352 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049efa9b-35f8-496c-9d1d-24ae31929417 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:11.577488 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b05636-0d7f-40b9-adf8-6b035ade03dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:11.578475 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b05636-0d7f-40b9-adf8-6b035ade03dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:11.578874 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b05636-0d7f-40b9-adf8-6b035ade03dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:11.579258 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b05636-0d7f-40b9-adf8-6b035ade03dc admin admin] PATH_INFO: `/v3/projects/fc24227f0e51407690aedc4e88a8e88e/users/3601f6827faa46b6b3a88322a279ce5e/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:11.596760 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b05636-0d7f-40b9-adf8-6b035ade03dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc24227f0e51407690aedc4e88a8e88e, user_id=3601f6827faa46b6b3a88322a279ce5e, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:11.600090 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b05636-0d7f-40b9-adf8-6b035ade03dc admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:11.682673 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157144fd-3862-4c19-80c8-06484a5a39ad admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:11.682673 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-157144fd-3862-4c19-80c8-06484a5a39ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:11.696552 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157144fd-3862-4c19-80c8-06484a5a39ad admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:11.704059 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3641422-1b87-4550-93c1-c6e8dc91c2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:11.705974 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3641422-1b87-4550-93c1-c6e8dc91c2a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:11.706434 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3641422-1b87-4550-93c1-c6e8dc91c2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:11.706823 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3641422-1b87-4550-93c1-c6e8dc91c2a5 admin admin] PATH_INFO: `/v3/projects/39faf8793bef41dca428af9e1c5daab3` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:11.720788 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 993/1988] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:51:11 2022] PUT /identity/v3/projects/fc24227f0e51407690aedc4e88a8e88e/users/3601f6827faa46b6b3a88322a279ce5e/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:11.724109 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3641422-1b87-4550-93c1-c6e8dc91c2a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39faf8793bef41dca428af9e1c5daab3)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:11.725127 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b05636-0d7f-40b9-adf8-6b035ade03dc admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:11.727394 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3641422-1b87-4550-93c1-c6e8dc91c2a5 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:11.809808 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b05636-0d7f-40b9-adf8-6b035ade03dc admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:11.814968 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988726b2-2dfb-4161-a8e5-3bce9f3e5c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:11.815665 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988726b2-2dfb-4161-a8e5-3bce9f3e5c8f admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:11.815972 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988726b2-2dfb-4161-a8e5-3bce9f3e5c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:11.816256 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988726b2-2dfb-4161-a8e5-3bce9f3e5c8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:11.816997 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988726b2-2dfb-4161-a8e5-3bce9f3e5c8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:11.818606 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988726b2-2dfb-4161-a8e5-3bce9f3e5c8f admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:11.829023 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 994/1989] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:11 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:11.833140 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988726b2-2dfb-4161-a8e5-3bce9f3e5c8f admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:11.844260 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988726b2-2dfb-4161-a8e5-3bce9f3e5c8f admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:11.849391 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfae30c-bd83-46db-bc54-bc7ce9223f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:11.850358 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfae30c-bd83-46db-bc54-bc7ce9223f8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:11.850643 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfae30c-bd83-46db-bc54-bc7ce9223f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:11.850920 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfae30c-bd83-46db-bc54-bc7ce9223f8e admin admin] PATH_INFO: `/v3/projects/fc24227f0e51407690aedc4e88a8e88e/users/3601f6827faa46b6b3a88322a279ce5e/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:11.853568 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfae30c-bd83-46db-bc54-bc7ce9223f8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc24227f0e51407690aedc4e88a8e88e, user_id=3601f6827faa46b6b3a88322a279ce5e, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:11.856338 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfae30c-bd83-46db-bc54-bc7ce9223f8e admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:11.867702 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 995/1990] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:51:11 2022] PUT /identity/v3/projects/fc24227f0e51407690aedc4e88a8e88e/users/3601f6827faa46b6b3a88322a279ce5e/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:51:11.880751 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb860ec-10ec-4584-8277-9835144b0a72 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:11.880992 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb860ec-10ec-4584-8277-9835144b0a72 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:11.881304 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb860ec-10ec-4584-8277-9835144b0a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:11.905026 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-d3641422-1b87-4550-93c1-c6e8dc91c2a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39faf8793bef41dca428af9e1c5daab3', 'request_id': 'req-d3641422-1b87-4550-93c1-c6e8dc91c2a5'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:11.911439 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-d3641422-1b87-4550-93c1-c6e8dc91c2a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39faf8793bef41dca428af9e1c5daab3', 'request_id': 'req-d3641422-1b87-4550-93c1-c6e8dc91c2a5'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:11.917390 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-dfb860ec-10ec-4584-8277-9835144b0a72 None None] MFA Rules not processed for user `3601f6827faa46b6b3a88322a279ce5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:11.918633 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-dfb860ec-10ec-4584-8277-9835144b0a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:11.920036 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-d3641422-1b87-4550-93c1-c6e8dc91c2a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39faf8793bef41dca428af9e1c5daab3', 'request_id': 'req-d3641422-1b87-4550-93c1-c6e8dc91c2a5'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:11.992641 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 996/1991] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:51:11 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jul 18 16:51:12.033240 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-d3641422-1b87-4550-93c1-c6e8dc91c2a5 admin admin] The token cache is being invalidate because project 39faf8793bef41dca428af9e1c5daab3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:51:12.033535 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-d3641422-1b87-4550-93c1-c6e8dc91c2a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:12.036688 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-d3641422-1b87-4550-93c1-c6e8dc91c2a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:12.042815 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 996/1992] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 16:51:11 2022] DELETE /identity/v3/projects/39faf8793bef41dca428af9e1c5daab3 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:12.042989 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95fa31-842d-43bd-8d59-1a663fbaf9b5 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:12.042989 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95fa31-842d-43bd-8d59-1a663fbaf9b5 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:12.042989 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95fa31-842d-43bd-8d59-1a663fbaf9b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:12.056026 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:12.073308 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-7e95fa31-842d-43bd-8d59-1a663fbaf9b5 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:12.074881 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-7e95fa31-842d-43bd-8d59-1a663fbaf9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:12.144535 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 997/1993] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:51:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:51:12.153827 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a5e3c-b42b-4126-b72f-e35aa9cfef57 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:12.154263 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a5e3c-b42b-4126-b72f-e35aa9cfef57 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:12.154804 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a5e3c-b42b-4126-b72f-e35aa9cfef57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:12.179035 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-218a5e3c-b42b-4126-b72f-e35aa9cfef57 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:12.180299 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-218a5e3c-b42b-4126-b72f-e35aa9cfef57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:12.184830 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e95fa31-842d-43bd-8d59-1a663fbaf9b5 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:12.186419 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-7e95fa31-842d-43bd-8d59-1a663fbaf9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:12.192758 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 997/1994] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:51:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:12.197706 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218a5e3c-b42b-4126-b72f-e35aa9cfef57 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:12.208765 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218a5e3c-b42b-4126-b72f-e35aa9cfef57 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:12.214808 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e34a06a-087e-422f-b5f7-d4f71b21f1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:12.214808 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e34a06a-087e-422f-b5f7-d4f71b21f1d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:12.214808 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e34a06a-087e-422f-b5f7-d4f71b21f1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:12.215214 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e34a06a-087e-422f-b5f7-d4f71b21f1d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:12.216854 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e34a06a-087e-422f-b5f7-d4f71b21f1d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:51:12.217169 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e34a06a-087e-422f-b5f7-d4f71b21f1d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:12.218777 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e34a06a-087e-422f-b5f7-d4f71b21f1d8 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:12.235879 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 998/1995] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Jul 18 16:51:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:51:12.241499 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e34a06a-087e-422f-b5f7-d4f71b21f1d8 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:12.261554 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e34a06a-087e-422f-b5f7-d4f71b21f1d8 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:12.266521 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261662ba-9706-4f8b-bd17-f5c7e7393995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:12.267241 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261662ba-9706-4f8b-bd17-f5c7e7393995 admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:12.267538 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261662ba-9706-4f8b-bd17-f5c7e7393995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:12.267873 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261662ba-9706-4f8b-bd17-f5c7e7393995 admin admin] PATH_INFO: `/v3/projects` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:12.268583 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261662ba-9706-4f8b-bd17-f5c7e7393995 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:12.268691 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e95fa31-842d-43bd-8d59-1a663fbaf9b5 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:12.270787 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261662ba-9706-4f8b-bd17-f5c7e7393995 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:12.287950 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519cceb7-b42b-4db1-aebe-f20292c25e97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:12.291686 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519cceb7-b42b-4db1-aebe-f20292c25e97 service cinder] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:12.292120 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519cceb7-b42b-4db1-aebe-f20292c25e97 service cinder] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:12.292545 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519cceb7-b42b-4db1-aebe-f20292c25e97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:12.303177 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-519cceb7-b42b-4db1-aebe-f20292c25e97 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:12.318105 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519cceb7-b42b-4db1-aebe-f20292c25e97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:12.320001 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519cceb7-b42b-4db1-aebe-f20292c25e97 service cinder] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:12.342149 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 998/1996] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:12 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:51:12.459186 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 999/1997] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:51:12 2022] POST /identity/v3/projects => generated 385 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:12.466405 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519cceb7-b42b-4db1-aebe-f20292c25e97 service cinder] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:12.483322 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519cceb7-b42b-4db1-aebe-f20292c25e97 service cinder] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:12.498343 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261662ba-9706-4f8b-bd17-f5c7e7393995 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:12.500137 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-261662ba-9706-4f8b-bd17-f5c7e7393995 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:12.608858 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a8614-fb24-440c-8c90-733bcfff1dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:12.609557 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a8614-fb24-440c-8c90-733bcfff1dd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:12.609842 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a8614-fb24-440c-8c90-733bcfff1dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:12.610116 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a8614-fb24-440c-8c90-733bcfff1dd4 admin admin] PATH_INFO: `/v3/users` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:12.610812 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31a8614-fb24-440c-8c90-733bcfff1dd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:12.612811 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31a8614-fb24-440c-8c90-733bcfff1dd4 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:12.628405 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261662ba-9706-4f8b-bd17-f5c7e7393995 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:12.633009 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d7602-91c1-4dea-98d7-280dd3ced8cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:12.633851 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d7602-91c1-4dea-98d7-280dd3ced8cb service cinder] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:12.634148 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d7602-91c1-4dea-98d7-280dd3ced8cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:12.634427 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d7602-91c1-4dea-98d7-280dd3ced8cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:12.636431 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-567d7602-91c1-4dea-98d7-280dd3ced8cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:12.702585 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567d7602-91c1-4dea-98d7-280dd3ced8cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:12.704187 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567d7602-91c1-4dea-98d7-280dd3ced8cb service cinder] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:12.710929 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 999/1998] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 16:51:12 2022] POST /identity/v3/users => generated 293 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:12.715839 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a8614-fb24-440c-8c90-733bcfff1dd4 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:12.716045 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1000/1999] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:12 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 16:51:12.723945 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:12.733775 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a8614-fb24-440c-8c90-733bcfff1dd4 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:12.739517 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e13ae2-a278-46f2-a679-84a35e9d8259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:12.740244 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e13ae2-a278-46f2-a679-84a35e9d8259 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:12.740576 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e13ae2-a278-46f2-a679-84a35e9d8259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:12.740797 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e13ae2-a278-46f2-a679-84a35e9d8259 admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:12.741527 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e13ae2-a278-46f2-a679-84a35e9d8259 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:12.743773 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e13ae2-a278-46f2-a679-84a35e9d8259 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:12.755825 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1000/2000] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:12 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 16:51:12.761126 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d7602-91c1-4dea-98d7-280dd3ced8cb service cinder] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:12.772491 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d7602-91c1-4dea-98d7-280dd3ced8cb service cinder] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:12.778201 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6407503-e14e-43d1-8577-263056e2b178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:12.778935 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6407503-e14e-43d1-8577-263056e2b178 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:12.779234 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6407503-e14e-43d1-8577-263056e2b178 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:12.779507 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6407503-e14e-43d1-8577-263056e2b178 admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:12.780710 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6407503-e14e-43d1-8577-263056e2b178 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:12.781957 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6407503-e14e-43d1-8577-263056e2b178 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:12.802305 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1001/2001] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:12.805178 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e13ae2-a278-46f2-a679-84a35e9d8259 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:12.825942 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e13ae2-a278-46f2-a679-84a35e9d8259 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:12.835219 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed21b3-8412-4ea8-94a8-799d1a167851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:12.836955 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed21b3-8412-4ea8-94a8-799d1a167851 admin admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:12.838322 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed21b3-8412-4ea8-94a8-799d1a167851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:12.838472 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed21b3-8412-4ea8-94a8-799d1a167851 admin admin] PATH_INFO: `/v3/projects/3c2271562d6a4232bb3dc6ed9bc33bde/users/ee0824c301ef4dfd89cbf51e9c36a913/roles/ad3a2bc7b2094a4da1a95a143c8d9436` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:12.869748 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ed21b3-8412-4ea8-94a8-799d1a167851 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c2271562d6a4232bb3dc6ed9bc33bde, user_id=ee0824c301ef4dfd89cbf51e9c36a913, role_id=ad3a2bc7b2094a4da1a95a143c8d9436)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:12.875904 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ed21b3-8412-4ea8-94a8-799d1a167851 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:13.014416 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1001/2002] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:51:12 2022] PUT /identity/v3/projects/3c2271562d6a4232bb3dc6ed9bc33bde/users/ee0824c301ef4dfd89cbf51e9c36a913/roles/ad3a2bc7b2094a4da1a95a143c8d9436 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:13.020908 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df04f49-eae8-44ec-aa61-a452f34c3e34 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:13.021198 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df04f49-eae8-44ec-aa61-a452f34c3e34 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:13.021805 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df04f49-eae8-44ec-aa61-a452f34c3e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:13.054546 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-6df04f49-eae8-44ec-aa61-a452f34c3e34 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:13.056411 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-6df04f49-eae8-44ec-aa61-a452f34c3e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:13.147764 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1002/2003] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:51:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:13.161862 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed21b3-8412-4ea8-94a8-799d1a167851 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:13.163636 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-e9ed21b3-8412-4ea8-94a8-799d1a167851 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:13.228781 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed21b3-8412-4ea8-94a8-799d1a167851 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:13.232695 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0585eaef-5464-461c-91c0-3c781fc41290 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:13.233855 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0585eaef-5464-461c-91c0-3c781fc41290 service neutron] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:13.233855 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0585eaef-5464-461c-91c0-3c781fc41290 service neutron] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:13.234069 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0585eaef-5464-461c-91c0-3c781fc41290 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:13.244452 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0585eaef-5464-461c-91c0-3c781fc41290 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:13.245937 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0585eaef-5464-461c-91c0-3c781fc41290 service neutron] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:13.256798 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1002/2004] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:51:14.525531 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:14.656708 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:17.081481 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:17.417071 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df04f49-eae8-44ec-aa61-a452f34c3e34 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:17.418878 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-6df04f49-eae8-44ec-aa61-a452f34c3e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:17.433837 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df04f49-eae8-44ec-aa61-a452f34c3e34 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:17.439950 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47da168c-933a-4844-8cec-8a8964328aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:17.440733 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da168c-933a-4844-8cec-8a8964328aa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:17.441016 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da168c-933a-4844-8cec-8a8964328aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:17.441290 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da168c-933a-4844-8cec-8a8964328aa1 admin admin] PATH_INFO: `/v3/users/6d78fd6f9eae4f5582c138be1e8125d2` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:17.442567 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47da168c-933a-4844-8cec-8a8964328aa1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d78fd6f9eae4f5582c138be1e8125d2)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:17.444610 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47da168c-933a-4844-8cec-8a8964328aa1 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:17.734277 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-47da168c-933a-4844-8cec-8a8964328aa1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d78fd6f9eae4f5582c138be1e8125d2'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:17.747500 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-47da168c-933a-4844-8cec-8a8964328aa1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d78fd6f9eae4f5582c138be1e8125d2'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:17.748366 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-47da168c-933a-4844-8cec-8a8964328aa1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d78fd6f9eae4f5582c138be1e8125d2'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:17.758191 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-47da168c-933a-4844-8cec-8a8964328aa1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d78fd6f9eae4f5582c138be1e8125d2'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:17.839360 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-47da168c-933a-4844-8cec-8a8964328aa1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d78fd6f9eae4f5582c138be1e8125d2'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:17.859969 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1003/2005] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 16:51:17 2022] DELETE /identity/v3/users/6d78fd6f9eae4f5582c138be1e8125d2 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:17.861662 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89795ac8-a78a-4dba-92a9-81ef8a7c558b None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:17.862173 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89795ac8-a78a-4dba-92a9-81ef8a7c558b None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:17.862173 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89795ac8-a78a-4dba-92a9-81ef8a7c558b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:17.887794 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-89795ac8-a78a-4dba-92a9-81ef8a7c558b None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:17.889212 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-89795ac8-a78a-4dba-92a9-81ef8a7c558b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:17.999163 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1003/2006] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:51:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:18.013084 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47da168c-933a-4844-8cec-8a8964328aa1 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:18.014999 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-47da168c-933a-4844-8cec-8a8964328aa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:18.096723 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:18.110010 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47da168c-933a-4844-8cec-8a8964328aa1 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:18.113158 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e3a24-659c-479a-90ca-fedc4765d6f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:18.114073 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e3a24-659c-479a-90ca-fedc4765d6f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:18.114461 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e3a24-659c-479a-90ca-fedc4765d6f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:18.114847 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e3a24-659c-479a-90ca-fedc4765d6f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:18.127825 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167e3a24-659c-479a-90ca-fedc4765d6f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:18.129529 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167e3a24-659c-479a-90ca-fedc4765d6f0 service neutron] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:18.153836 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1004/2007] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:51:18.823573 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89795ac8-a78a-4dba-92a9-81ef8a7c558b None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:18.825328 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-89795ac8-a78a-4dba-92a9-81ef8a7c558b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:18.850588 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89795ac8-a78a-4dba-92a9-81ef8a7c558b None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:18.857543 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f5176b-6001-4308-893b-cb6175418975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:18.858528 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5176b-6001-4308-893b-cb6175418975 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:18.858882 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5176b-6001-4308-893b-cb6175418975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:18.859213 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5176b-6001-4308-893b-cb6175418975 admin admin] PATH_INFO: `/v3/projects/21076e4195a8408e85fec61ad05b1888` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:18.860631 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f5176b-6001-4308-893b-cb6175418975 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21076e4195a8408e85fec61ad05b1888)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:18.869820 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f5176b-6001-4308-893b-cb6175418975 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:19.043447 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-b2f5176b-6001-4308-893b-cb6175418975 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21076e4195a8408e85fec61ad05b1888', 'request_id': 'req-b2f5176b-6001-4308-893b-cb6175418975'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:19.196014 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-b2f5176b-6001-4308-893b-cb6175418975 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21076e4195a8408e85fec61ad05b1888', 'request_id': 'req-b2f5176b-6001-4308-893b-cb6175418975'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:19.204523 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-b2f5176b-6001-4308-893b-cb6175418975 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21076e4195a8408e85fec61ad05b1888', 'request_id': 'req-b2f5176b-6001-4308-893b-cb6175418975'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:19.228300 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-b2f5176b-6001-4308-893b-cb6175418975 admin admin] The token cache is being invalidate because project 21076e4195a8408e85fec61ad05b1888 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:51:19.228704 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-b2f5176b-6001-4308-893b-cb6175418975 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:19.229480 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-b2f5176b-6001-4308-893b-cb6175418975 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:19.239178 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e3a24-659c-479a-90ca-fedc4765d6f0 service neutron] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:19.239602 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1004/2008] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 16:51:18 2022] DELETE /identity/v3/projects/21076e4195a8408e85fec61ad05b1888 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:19.248131 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e3a24-659c-479a-90ca-fedc4765d6f0 service neutron] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:19.340334 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b85c638-bec1-4aea-913f-8d8e92cc8709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:19.343507 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85c638-bec1-4aea-913f-8d8e92cc8709 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:19.343507 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85c638-bec1-4aea-913f-8d8e92cc8709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:19.343507 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85c638-bec1-4aea-913f-8d8e92cc8709 admin admin] PATH_INFO: `/v3/users/3601f6827faa46b6b3a88322a279ce5e` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:19.343798 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b85c638-bec1-4aea-913f-8d8e92cc8709 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3601f6827faa46b6b3a88322a279ce5e)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:19.346105 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b85c638-bec1-4aea-913f-8d8e92cc8709 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:19.597508 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-0b85c638-bec1-4aea-913f-8d8e92cc8709 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3601f6827faa46b6b3a88322a279ce5e'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:19.628417 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-0b85c638-bec1-4aea-913f-8d8e92cc8709 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3601f6827faa46b6b3a88322a279ce5e'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:19.630772 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-0b85c638-bec1-4aea-913f-8d8e92cc8709 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3601f6827faa46b6b3a88322a279ce5e'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:19.651739 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-0b85c638-bec1-4aea-913f-8d8e92cc8709 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3601f6827faa46b6b3a88322a279ce5e'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:19.769857 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-0b85c638-bec1-4aea-913f-8d8e92cc8709 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3601f6827faa46b6b3a88322a279ce5e'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:19.783053 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1005/2009] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 16:51:19 2022] DELETE /identity/v3/users/3601f6827faa46b6b3a88322a279ce5e => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:20.242946 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:20.441469 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:20.494850 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f5176b-6001-4308-893b-cb6175418975 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:20.496831 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-b2f5176b-6001-4308-893b-cb6175418975 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:20.522879 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f5176b-6001-4308-893b-cb6175418975 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:20.611492 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990fa894-a625-4cd4-887a-b4a903e006de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:20.612439 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990fa894-a625-4cd4-887a-b4a903e006de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:20.612720 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990fa894-a625-4cd4-887a-b4a903e006de admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:20.612993 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990fa894-a625-4cd4-887a-b4a903e006de admin admin] PATH_INFO: `/v3/projects/fc24227f0e51407690aedc4e88a8e88e` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:20.614648 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990fa894-a625-4cd4-887a-b4a903e006de admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc24227f0e51407690aedc4e88a8e88e)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:20.619431 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990fa894-a625-4cd4-887a-b4a903e006de admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:20.827320 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-990fa894-a625-4cd4-887a-b4a903e006de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc24227f0e51407690aedc4e88a8e88e', 'request_id': 'req-990fa894-a625-4cd4-887a-b4a903e006de'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:20.937705 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-990fa894-a625-4cd4-887a-b4a903e006de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc24227f0e51407690aedc4e88a8e88e', 'request_id': 'req-990fa894-a625-4cd4-887a-b4a903e006de'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:20.947864 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-990fa894-a625-4cd4-887a-b4a903e006de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc24227f0e51407690aedc4e88a8e88e', 'request_id': 'req-990fa894-a625-4cd4-887a-b4a903e006de'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:20.960393 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-990fa894-a625-4cd4-887a-b4a903e006de admin admin] The token cache is being invalidate because project fc24227f0e51407690aedc4e88a8e88e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:51:20.960686 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-990fa894-a625-4cd4-887a-b4a903e006de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:20.961545 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-990fa894-a625-4cd4-887a-b4a903e006de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:20.963653 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1005/2010] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 16:51:20 2022] DELETE /identity/v3/projects/fc24227f0e51407690aedc4e88a8e88e => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:20.978312 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa2ed4-63ce-4565-8855-fe8c8840b2c8 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:20.978755 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa2ed4-63ce-4565-8855-fe8c8840b2c8 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:20.979187 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa2ed4-63ce-4565-8855-fe8c8840b2c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:21.012513 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-35aa2ed4-63ce-4565-8855-fe8c8840b2c8 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:21.013894 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-35aa2ed4-63ce-4565-8855-fe8c8840b2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:21.118585 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1006/2011] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:51:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:51:21.119301 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249408a7-9b90-4d60-879f-d474b4483863 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:21.119702 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249408a7-9b90-4d60-879f-d474b4483863 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:21.120106 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249408a7-9b90-4d60-879f-d474b4483863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:21.146646 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa2ed4-63ce-4565-8855-fe8c8840b2c8 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:21.148449 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-35aa2ed4-63ce-4565-8855-fe8c8840b2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:21.170237 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-249408a7-9b90-4d60-879f-d474b4483863 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:21.178105 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-249408a7-9b90-4d60-879f-d474b4483863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:21.203144 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1006/2012] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:51:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:51:21.209906 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249408a7-9b90-4d60-879f-d474b4483863 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:21.223870 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249408a7-9b90-4d60-879f-d474b4483863 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:21.239145 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2c25ad-9dc9-4282-b0b0-0595c4297ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:21.240137 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c25ad-9dc9-4282-b0b0-0595c4297ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:21.240849 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c25ad-9dc9-4282-b0b0-0595c4297ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:21.241607 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c25ad-9dc9-4282-b0b0-0595c4297ff1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:21.242712 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2c25ad-9dc9-4282-b0b0-0595c4297ff1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:51:21.243283 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2c25ad-9dc9-4282-b0b0-0595c4297ff1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:21.245698 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2c25ad-9dc9-4282-b0b0-0595c4297ff1 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:21.294477 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1007/2013] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Jul 18 16:51:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:51:21.300178 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2c25ad-9dc9-4282-b0b0-0595c4297ff1 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:21.303862 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-4f2c25ad-9dc9-4282-b0b0-0595c4297ff1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:21.311950 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa2ed4-63ce-4565-8855-fe8c8840b2c8 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:21.317154 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70356ca6-3e86-4601-b789-23068ef75c4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:21.317987 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70356ca6-3e86-4601-b789-23068ef75c4e service cinder] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:21.318382 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70356ca6-3e86-4601-b789-23068ef75c4e service cinder] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:21.318774 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70356ca6-3e86-4601-b789-23068ef75c4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:21.321033 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-70356ca6-3e86-4601-b789-23068ef75c4e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:21.322302 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2c25ad-9dc9-4282-b0b0-0595c4297ff1 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:21.327095 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e7ade2-3e73-4eb7-876c-ac707a7889e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:21.335984 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e7ade2-3e73-4eb7-876c-ac707a7889e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:21.336629 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e7ade2-3e73-4eb7-876c-ac707a7889e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:21.337671 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e7ade2-3e73-4eb7-876c-ac707a7889e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:21.340722 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-11e7ade2-3e73-4eb7-876c-ac707a7889e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:21.434031 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70356ca6-3e86-4601-b789-23068ef75c4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:21.435896 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70356ca6-3e86-4601-b789-23068ef75c4e service cinder] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:21.469677 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1007/2014] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:21 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 16:51:21.469677 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70356ca6-3e86-4601-b789-23068ef75c4e service cinder] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:21.490730 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70356ca6-3e86-4601-b789-23068ef75c4e service cinder] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:21.495032 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e7ade2-3e73-4eb7-876c-ac707a7889e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:21.496654 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e7ade2-3e73-4eb7-876c-ac707a7889e6 service cinder] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:21.499256 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da9b39-46c3-41e1-b809-f834355b9290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:21.500064 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da9b39-46c3-41e1-b809-f834355b9290 admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:21.500476 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da9b39-46c3-41e1-b809-f834355b9290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:21.500744 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da9b39-46c3-41e1-b809-f834355b9290 admin admin] PATH_INFO: `/v3/projects` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:21.504159 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62da9b39-46c3-41e1-b809-f834355b9290 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:21.504159 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62da9b39-46c3-41e1-b809-f834355b9290 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:21.523597 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1008/2015] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:21 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:51:21.614280 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1008/2016] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:51:21 2022] POST /identity/v3/projects => generated 373 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:21.620199 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e7ade2-3e73-4eb7-876c-ac707a7889e6 service cinder] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:21.640930 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e7ade2-3e73-4eb7-876c-ac707a7889e6 service cinder] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:21.800900 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9343e3-14e8-4b2a-b39a-dd1644b1f569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:21.802168 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9343e3-14e8-4b2a-b39a-dd1644b1f569 admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:21.812474 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9343e3-14e8-4b2a-b39a-dd1644b1f569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:21.815649 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9343e3-14e8-4b2a-b39a-dd1644b1f569 admin admin] PATH_INFO: `/v3/users` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:21.816512 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9343e3-14e8-4b2a-b39a-dd1644b1f569 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:21.828155 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9343e3-14e8-4b2a-b39a-dd1644b1f569 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:21.965486 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1009/2017] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 16:51:21 2022] POST /identity/v3/users => generated 287 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:21.970112 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da9b39-46c3-41e1-b809-f834355b9290 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:21.985074 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da9b39-46c3-41e1-b809-f834355b9290 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:21.987483 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbec2d9-5c97-44e4-b7e0-c71af18cb74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:21.988289 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbec2d9-5c97-44e4-b7e0-c71af18cb74f admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:21.988665 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbec2d9-5c97-44e4-b7e0-c71af18cb74f admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:21.989598 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d8d54-693e-4154-be45-be8508f4e8e1 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:21.990174 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d8d54-693e-4154-be45-be8508f4e8e1 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:21.990785 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d8d54-693e-4154-be45-be8508f4e8e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:21.998755 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbec2d9-5c97-44e4-b7e0-c71af18cb74f admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:22.001196 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbec2d9-5c97-44e4-b7e0-c71af18cb74f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:22.012824 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbec2d9-5c97-44e4-b7e0-c71af18cb74f admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:22.043831 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-321d8d54-693e-4154-be45-be8508f4e8e1 None None] MFA Rules not processed for user `ee0824c301ef4dfd89cbf51e9c36a913`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:22.046082 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-321d8d54-693e-4154-be45-be8508f4e8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:22.051010 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1009/2018] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:21 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:22.051824 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbec2d9-5c97-44e4-b7e0-c71af18cb74f admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:22.068198 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbec2d9-5c97-44e4-b7e0-c71af18cb74f admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:22.084089 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec76e5-5c0c-4605-a4f0-4e5d5acbdf22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:22.084806 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec76e5-5c0c-4605-a4f0-4e5d5acbdf22 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:22.085078 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec76e5-5c0c-4605-a4f0-4e5d5acbdf22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:22.085541 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec76e5-5c0c-4605-a4f0-4e5d5acbdf22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:22.086459 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec76e5-5c0c-4605-a4f0-4e5d5acbdf22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:22.088425 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec76e5-5c0c-4605-a4f0-4e5d5acbdf22 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:22.104055 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1010/2019] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:22 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:22.107977 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec76e5-5c0c-4605-a4f0-4e5d5acbdf22 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:22.128744 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec76e5-5c0c-4605-a4f0-4e5d5acbdf22 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:22.133249 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0211f1e-a123-42a1-ba92-7a2e048b1e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:22.134308 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0211f1e-a123-42a1-ba92-7a2e048b1e6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:22.134588 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0211f1e-a123-42a1-ba92-7a2e048b1e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:22.134907 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0211f1e-a123-42a1-ba92-7a2e048b1e6a admin admin] PATH_INFO: `/v3/projects/d72ba77241474f368e6532be66e7696f/users/9a06826ec14d4c9591e1fc3b3286238b/roles/ad3a2bc7b2094a4da1a95a143c8d9436` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:22.152388 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1010/2020] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:51:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:22.156442 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0211f1e-a123-42a1-ba92-7a2e048b1e6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d72ba77241474f368e6532be66e7696f, user_id=9a06826ec14d4c9591e1fc3b3286238b, role_id=ad3a2bc7b2094a4da1a95a143c8d9436)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:22.160669 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d8d54-693e-4154-be45-be8508f4e8e1 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:22.160669 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-321d8d54-693e-4154-be45-be8508f4e8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:22.160939 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0211f1e-a123-42a1-ba92-7a2e048b1e6a admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:22.174491 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d8d54-693e-4154-be45-be8508f4e8e1 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:22.180005 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5756a3-dc71-406b-b151-db88460fe0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:22.181301 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5756a3-dc71-406b-b151-db88460fe0f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:22.181910 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5756a3-dc71-406b-b151-db88460fe0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:22.182428 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5756a3-dc71-406b-b151-db88460fe0f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:22.183215 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5756a3-dc71-406b-b151-db88460fe0f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:22.193795 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5756a3-dc71-406b-b151-db88460fe0f2 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:22.279939 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1011/2021] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:51:22 2022] PUT /identity/v3/projects/d72ba77241474f368e6532be66e7696f/users/9a06826ec14d4c9591e1fc3b3286238b/roles/ad3a2bc7b2094a4da1a95a143c8d9436 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:22.290479 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f33730-b459-4f10-a2e4-4ae6c60c8f49 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:22.290768 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f33730-b459-4f10-a2e4-4ae6c60c8f49 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:22.291047 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f33730-b459-4f10-a2e4-4ae6c60c8f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:22.314196 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1011/2022] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:51:22 2022] POST /identity/v3/projects => generated 385 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:22.315188 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5756a3-dc71-406b-b151-db88460fe0f2 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:22.327766 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-c1f33730-b459-4f10-a2e4-4ae6c60c8f49 None None] MFA Rules not processed for user `9a06826ec14d4c9591e1fc3b3286238b`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:22.329033 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-c1f33730-b459-4f10-a2e4-4ae6c60c8f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:22.398060 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5756a3-dc71-406b-b151-db88460fe0f2 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:22.404409 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1012/2023] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:51:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:51:22.405123 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11484a9-1512-4871-938b-74b58509eb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:22.405823 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11484a9-1512-4871-938b-74b58509eb63 admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:22.406105 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11484a9-1512-4871-938b-74b58509eb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:22.406381 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11484a9-1512-4871-938b-74b58509eb63 admin admin] PATH_INFO: `/v3/users` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:22.407113 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11484a9-1512-4871-938b-74b58509eb63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:22.408252 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f33730-b459-4f10-a2e4-4ae6c60c8f49 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:22.409171 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11484a9-1512-4871-938b-74b58509eb63 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:22.419819 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f33730-b459-4f10-a2e4-4ae6c60c8f49 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:22.425055 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f46bd1-0483-4fb1-bead-0cc0a17d8563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:22.425673 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f46bd1-0483-4fb1-bead-0cc0a17d8563 admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:22.425958 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f46bd1-0483-4fb1-bead-0cc0a17d8563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:22.426232 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f46bd1-0483-4fb1-bead-0cc0a17d8563 admin admin] PATH_INFO: `/v3/projects` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:22.426946 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f46bd1-0483-4fb1-bead-0cc0a17d8563 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:22.428911 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f46bd1-0483-4fb1-bead-0cc0a17d8563 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:22.531338 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1013/2024] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:51:22 2022] POST /identity/v3/projects => generated 375 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:51:22.537705 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f46bd1-0483-4fb1-bead-0cc0a17d8563 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:22.545582 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1012/2025] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 16:51:22 2022] POST /identity/v3/users => generated 299 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:22.548176 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11484a9-1512-4871-938b-74b58509eb63 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:22.573223 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11484a9-1512-4871-938b-74b58509eb63 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:22.641388 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f46bd1-0483-4fb1-bead-0cc0a17d8563 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:22.653738 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabffc50-31cc-4aad-bc54-31d6e27b5e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:22.653738 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabffc50-31cc-4aad-bc54-31d6e27b5e27 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:22.653738 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabffc50-31cc-4aad-bc54-31d6e27b5e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:22.653738 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabffc50-31cc-4aad-bc54-31d6e27b5e27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:22.654283 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabffc50-31cc-4aad-bc54-31d6e27b5e27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:22.654381 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0e1dc-c981-4be3-a465-2a8d360fa233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:22.654381 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0e1dc-c981-4be3-a465-2a8d360fa233 admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:22.654684 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabffc50-31cc-4aad-bc54-31d6e27b5e27 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:22.654944 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0e1dc-c981-4be3-a465-2a8d360fa233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:22.655384 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0e1dc-c981-4be3-a465-2a8d360fa233 admin admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:22.656277 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea0e1dc-c981-4be3-a465-2a8d360fa233 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:22.658418 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea0e1dc-c981-4be3-a465-2a8d360fa233 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:22.669458 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1013/2026] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:22 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:22.670915 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabffc50-31cc-4aad-bc54-31d6e27b5e27 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:22.686127 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabffc50-31cc-4aad-bc54-31d6e27b5e27 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:22.692244 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ed8aa-b94a-4b11-8c4d-07d16fe6601f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:22.693497 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ed8aa-b94a-4b11-8c4d-07d16fe6601f admin admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:22.693740 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ed8aa-b94a-4b11-8c4d-07d16fe6601f admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:22.694149 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ed8aa-b94a-4b11-8c4d-07d16fe6601f admin admin] PATH_INFO: `/v3/projects/e96690eabf4c4ea887e866541d6d4f50/users/47beed36a8644c5f80186734ab3fd865/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:22.714648 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8ed8aa-b94a-4b11-8c4d-07d16fe6601f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e96690eabf4c4ea887e866541d6d4f50, user_id=47beed36a8644c5f80186734ab3fd865, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:22.717812 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8ed8aa-b94a-4b11-8c4d-07d16fe6601f admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:22.806601 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:22.813059 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1014/2027] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 16:51:22 2022] POST /identity/v3/users => generated 294 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:51:22.817685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0e1dc-c981-4be3-a465-2a8d360fa233 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:22.837939 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0e1dc-c981-4be3-a465-2a8d360fa233 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:22.860439 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7978d3f4-0d10-4542-b4b9-cba53c9367ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:22.861370 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978d3f4-0d10-4542-b4b9-cba53c9367ec admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:22.861769 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978d3f4-0d10-4542-b4b9-cba53c9367ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:22.862169 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978d3f4-0d10-4542-b4b9-cba53c9367ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:22.866071 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7978d3f4-0d10-4542-b4b9-cba53c9367ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:22.869398 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7978d3f4-0d10-4542-b4b9-cba53c9367ec admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:22.894419 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1015/2028] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:22 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:22.895611 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1014/2029] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:51:22 2022] PUT /identity/v3/projects/e96690eabf4c4ea887e866541d6d4f50/users/47beed36a8644c5f80186734ab3fd865/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:22.896105 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7978d3f4-0d10-4542-b4b9-cba53c9367ec admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:22.899200 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ed8aa-b94a-4b11-8c4d-07d16fe6601f admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:22.921836 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7978d3f4-0d10-4542-b4b9-cba53c9367ec admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:22.983085 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ed8aa-b94a-4b11-8c4d-07d16fe6601f admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:22.988756 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e56fe1-c444-4316-a0d7-b264f7a79e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:22.989497 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e56fe1-c444-4316-a0d7-b264f7a79e5a admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:22.989787 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e56fe1-c444-4316-a0d7-b264f7a79e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:22.990068 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e56fe1-c444-4316-a0d7-b264f7a79e5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:22.990834 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e56fe1-c444-4316-a0d7-b264f7a79e5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:22.992794 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e56fe1-c444-4316-a0d7-b264f7a79e5a admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:23.001431 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bfc20b-42a3-4074-8c38-34040ca23daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:23.002762 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bfc20b-42a3-4074-8c38-34040ca23daa admin admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:23.003049 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bfc20b-42a3-4074-8c38-34040ca23daa admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:23.003328 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bfc20b-42a3-4074-8c38-34040ca23daa admin admin] PATH_INFO: `/v3/projects/ea6639d7316a4ac9b857a0798bb5b474/users/0e580c48851f42358b51e53e31babfff/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:23.007240 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1015/2030] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:22 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:23.009753 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e56fe1-c444-4316-a0d7-b264f7a79e5a admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:23.021994 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bfc20b-42a3-4074-8c38-34040ca23daa admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea6639d7316a4ac9b857a0798bb5b474, user_id=0e580c48851f42358b51e53e31babfff, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:23.025678 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bfc20b-42a3-4074-8c38-34040ca23daa admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:23.027176 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e56fe1-c444-4316-a0d7-b264f7a79e5a admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:23.032436 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76845155-3a6a-404c-85d8-97bcca583e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:23.033420 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76845155-3a6a-404c-85d8-97bcca583e81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:23.033708 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76845155-3a6a-404c-85d8-97bcca583e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:23.033987 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76845155-3a6a-404c-85d8-97bcca583e81 admin admin] PATH_INFO: `/v3/projects/e96690eabf4c4ea887e866541d6d4f50/users/47beed36a8644c5f80186734ab3fd865/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:23.037328 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76845155-3a6a-404c-85d8-97bcca583e81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e96690eabf4c4ea887e866541d6d4f50, user_id=47beed36a8644c5f80186734ab3fd865, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:23.040214 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76845155-3a6a-404c-85d8-97bcca583e81 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:23.055339 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1016/2031] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:51:23 2022] PUT /identity/v3/projects/e96690eabf4c4ea887e866541d6d4f50/users/47beed36a8644c5f80186734ab3fd865/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:23.055339 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:23.142114 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1016/2032] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:51:22 2022] PUT /identity/v3/projects/ea6639d7316a4ac9b857a0798bb5b474/users/0e580c48851f42358b51e53e31babfff/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:23.143198 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76845155-3a6a-404c-85d8-97bcca583e81 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:23.261464 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76845155-3a6a-404c-85d8-97bcca583e81 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:23.355257 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9d519a-9b80-42a3-9c61-88a5547f47b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:23.356522 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d519a-9b80-42a3-9c61-88a5547f47b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:23.357017 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d519a-9b80-42a3-9c61-88a5547f47b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:23.357536 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d519a-9b80-42a3-9c61-88a5547f47b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:23.358548 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9d519a-9b80-42a3-9c61-88a5547f47b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:23.360370 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9d519a-9b80-42a3-9c61-88a5547f47b6 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:23.374057 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1017/2033] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:23 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 16:51:23.378698 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bfc20b-42a3-4074-8c38-34040ca23daa admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:23.390182 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bfc20b-42a3-4074-8c38-34040ca23daa admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:23.395367 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2f2595-fda9-4f50-8a12-8c7db39dde11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:23.396247 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f2595-fda9-4f50-8a12-8c7db39dde11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:23.396444 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f2595-fda9-4f50-8a12-8c7db39dde11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:23.396713 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f2595-fda9-4f50-8a12-8c7db39dde11 admin admin] PATH_INFO: `/v3/projects/ea6639d7316a4ac9b857a0798bb5b474/users/0e580c48851f42358b51e53e31babfff/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:23.398819 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2f2595-fda9-4f50-8a12-8c7db39dde11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea6639d7316a4ac9b857a0798bb5b474, user_id=0e580c48851f42358b51e53e31babfff, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:23.402684 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2f2595-fda9-4f50-8a12-8c7db39dde11 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:23.423993 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1017/2034] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:51:23 2022] PUT /identity/v3/projects/ea6639d7316a4ac9b857a0798bb5b474/users/0e580c48851f42358b51e53e31babfff/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:23.426001 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249bc621-908b-45d5-941a-a1b5b487b610 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:23.426290 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249bc621-908b-45d5-941a-a1b5b487b610 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:23.427052 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249bc621-908b-45d5-941a-a1b5b487b610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:23.472155 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-249bc621-908b-45d5-941a-a1b5b487b610 None None] MFA Rules not processed for user `0e580c48851f42358b51e53e31babfff`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:23.473860 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-249bc621-908b-45d5-941a-a1b5b487b610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:23.587224 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1018/2035] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:51:23 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:23.604117 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2f2595-fda9-4f50-8a12-8c7db39dde11 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:23.766392 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2f2595-fda9-4f50-8a12-8c7db39dde11 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:23.780798 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bae211-94ea-4ddf-9e5d-20af3b7da0cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:23.781542 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bae211-94ea-4ddf-9e5d-20af3b7da0cd service cinder] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:23.781832 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bae211-94ea-4ddf-9e5d-20af3b7da0cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:23.782109 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bae211-94ea-4ddf-9e5d-20af3b7da0cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:23.910236 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bae211-94ea-4ddf-9e5d-20af3b7da0cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:23.911924 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bae211-94ea-4ddf-9e5d-20af3b7da0cd service cinder] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:23.932530 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1018/2036] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:23 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:51:24.096343 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:26.689755 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:28.364832 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:28.529538 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249bc621-908b-45d5-941a-a1b5b487b610 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:28.614581 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249bc621-908b-45d5-941a-a1b5b487b610 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:28.621283 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e3da9-6de5-46a6-8936-0a148d0c3b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:28.623809 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e3da9-6de5-46a6-8936-0a148d0c3b60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:28.623809 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e3da9-6de5-46a6-8936-0a148d0c3b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:28.623809 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e3da9-6de5-46a6-8936-0a148d0c3b60 admin admin] PATH_INFO: `/v3/users/9a06826ec14d4c9591e1fc3b3286238b` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:28.627990 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594e3da9-6de5-46a6-8936-0a148d0c3b60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a06826ec14d4c9591e1fc3b3286238b)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:28.630671 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594e3da9-6de5-46a6-8936-0a148d0c3b60 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:28.913423 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-594e3da9-6de5-46a6-8936-0a148d0c3b60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a06826ec14d4c9591e1fc3b3286238b'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:28.914460 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-594e3da9-6de5-46a6-8936-0a148d0c3b60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a06826ec14d4c9591e1fc3b3286238b'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:28.939778 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-594e3da9-6de5-46a6-8936-0a148d0c3b60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a06826ec14d4c9591e1fc3b3286238b'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:29.098112 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-594e3da9-6de5-46a6-8936-0a148d0c3b60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a06826ec14d4c9591e1fc3b3286238b'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:29.107144 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-594e3da9-6de5-46a6-8936-0a148d0c3b60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a06826ec14d4c9591e1fc3b3286238b'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:29.114984 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1019/2037] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 16:51:28 2022] DELETE /identity/v3/users/9a06826ec14d4c9591e1fc3b3286238b => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:29.119778 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec6166-2bfd-4185-9ecc-b06930531dbb None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:29.120359 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec6166-2bfd-4185-9ecc-b06930531dbb None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:29.120359 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec6166-2bfd-4185-9ecc-b06930531dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:29.140785 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-52ec6166-2bfd-4185-9ecc-b06930531dbb None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:29.142323 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-52ec6166-2bfd-4185-9ecc-b06930531dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:29.214103 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1019/2038] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:51:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:51:29.223070 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e3da9-6de5-46a6-8936-0a148d0c3b60 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:29.224583 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-594e3da9-6de5-46a6-8936-0a148d0c3b60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:29.293370 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e3da9-6de5-46a6-8936-0a148d0c3b60 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:29.297118 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeffc51-8f2f-47d4-914f-845bb8b108e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:29.297776 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeffc51-8f2f-47d4-914f-845bb8b108e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:29.298055 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeffc51-8f2f-47d4-914f-845bb8b108e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:29.298328 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeffc51-8f2f-47d4-914f-845bb8b108e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:29.309920 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeffc51-8f2f-47d4-914f-845bb8b108e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:29.311505 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeffc51-8f2f-47d4-914f-845bb8b108e8 service neutron] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:29.323558 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1020/2039] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:51:29.495447 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:29.632326 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec6166-2bfd-4185-9ecc-b06930531dbb None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:29.634650 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-52ec6166-2bfd-4185-9ecc-b06930531dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:29.655467 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec6166-2bfd-4185-9ecc-b06930531dbb None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:29.671390 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6192241e-c8c9-49f9-973d-8dc3f593358c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:29.672299 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6192241e-c8c9-49f9-973d-8dc3f593358c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:29.672580 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6192241e-c8c9-49f9-973d-8dc3f593358c admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:29.672856 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6192241e-c8c9-49f9-973d-8dc3f593358c admin admin] PATH_INFO: `/v3/users/0dae7055217b40cbb744620fac5d75f3` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:29.675588 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6192241e-c8c9-49f9-973d-8dc3f593358c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dae7055217b40cbb744620fac5d75f3)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:29.677937 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6192241e-c8c9-49f9-973d-8dc3f593358c admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:30.077187 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeffc51-8f2f-47d4-914f-845bb8b108e8 service neutron] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:30.079994 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-0eeffc51-8f2f-47d4-914f-845bb8b108e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:30.106114 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeffc51-8f2f-47d4-914f-845bb8b108e8 service neutron] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:30.109232 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-6192241e-c8c9-49f9-973d-8dc3f593358c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dae7055217b40cbb744620fac5d75f3'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:30.123331 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b67b747-2005-46d8-b8f4-a61cf112e102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:30.127908 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67b747-2005-46d8-b8f4-a61cf112e102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:30.128420 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67b747-2005-46d8-b8f4-a61cf112e102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:30.128857 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67b747-2005-46d8-b8f4-a61cf112e102 admin admin] PATH_INFO: `/v3/projects/d72ba77241474f368e6532be66e7696f` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:30.132923 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b67b747-2005-46d8-b8f4-a61cf112e102 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d72ba77241474f368e6532be66e7696f)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:30.135099 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b67b747-2005-46d8-b8f4-a61cf112e102 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:30.141665 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-6192241e-c8c9-49f9-973d-8dc3f593358c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dae7055217b40cbb744620fac5d75f3'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:30.142952 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-6192241e-c8c9-49f9-973d-8dc3f593358c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dae7055217b40cbb744620fac5d75f3'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:30.151064 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-6192241e-c8c9-49f9-973d-8dc3f593358c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dae7055217b40cbb744620fac5d75f3'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:30.235922 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-6192241e-c8c9-49f9-973d-8dc3f593358c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dae7055217b40cbb744620fac5d75f3'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:30.243293 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1020/2040] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 16:51:29 2022] DELETE /identity/v3/users/0dae7055217b40cbb744620fac5d75f3 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:30.248172 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6631e57-e543-418d-902f-d47be8e88632 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:30.248661 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6631e57-e543-418d-902f-d47be8e88632 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:30.249183 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6631e57-e543-418d-902f-d47be8e88632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:30.270647 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-a6631e57-e543-418d-902f-d47be8e88632 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:30.272289 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-a6631e57-e543-418d-902f-d47be8e88632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:30.311976 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-3b67b747-2005-46d8-b8f4-a61cf112e102 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd72ba77241474f368e6532be66e7696f', 'request_id': 'req-3b67b747-2005-46d8-b8f4-a61cf112e102'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:30.359519 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1021/2041] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:51:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:30.368908 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6631e57-e543-418d-902f-d47be8e88632 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:30.370939 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-a6631e57-e543-418d-902f-d47be8e88632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:30.417925 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-3b67b747-2005-46d8-b8f4-a61cf112e102 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd72ba77241474f368e6532be66e7696f', 'request_id': 'req-3b67b747-2005-46d8-b8f4-a61cf112e102'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:30.429360 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-3b67b747-2005-46d8-b8f4-a61cf112e102 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd72ba77241474f368e6532be66e7696f', 'request_id': 'req-3b67b747-2005-46d8-b8f4-a61cf112e102'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:30.444955 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-3b67b747-2005-46d8-b8f4-a61cf112e102 admin admin] The token cache is being invalidate because project d72ba77241474f368e6532be66e7696f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:51:30.445347 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-3b67b747-2005-46d8-b8f4-a61cf112e102 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:30.445925 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-3b67b747-2005-46d8-b8f4-a61cf112e102 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:30.448434 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1021/2042] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 16:51:30 2022] DELETE /identity/v3/projects/d72ba77241474f368e6532be66e7696f => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:30.452646 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b67b747-2005-46d8-b8f4-a61cf112e102 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:30.457316 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-3b67b747-2005-46d8-b8f4-a61cf112e102 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:30.458045 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6631e57-e543-418d-902f-d47be8e88632 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:30.466611 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d710d7be-3484-446a-a224-c9b061f7b91f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:30.467463 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d710d7be-3484-446a-a224-c9b061f7b91f service neutron] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:30.467790 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d710d7be-3484-446a-a224-c9b061f7b91f service neutron] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:30.468085 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d710d7be-3484-446a-a224-c9b061f7b91f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:30.470797 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-d710d7be-3484-446a-a224-c9b061f7b91f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:30.484059 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b67b747-2005-46d8-b8f4-a61cf112e102 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:30.487852 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d710d7be-3484-446a-a224-c9b061f7b91f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:30.489756 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d710d7be-3484-446a-a224-c9b061f7b91f service neutron] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:30.492443 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7103b97f-76ff-4d65-966b-c776b7752383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:30.493441 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103b97f-76ff-4d65-966b-c776b7752383 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:30.494236 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103b97f-76ff-4d65-966b-c776b7752383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:30.494536 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103b97f-76ff-4d65-966b-c776b7752383 admin admin] PATH_INFO: `/v3/users/0e580c48851f42358b51e53e31babfff` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:30.495962 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7103b97f-76ff-4d65-966b-c776b7752383 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e580c48851f42358b51e53e31babfff)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:30.498052 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7103b97f-76ff-4d65-966b-c776b7752383 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:30.503906 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1022/2043] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 16:51:30.961461 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-7103b97f-76ff-4d65-966b-c776b7752383 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e580c48851f42358b51e53e31babfff'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:30.965179 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-7103b97f-76ff-4d65-966b-c776b7752383 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e580c48851f42358b51e53e31babfff'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:30.988220 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-7103b97f-76ff-4d65-966b-c776b7752383 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e580c48851f42358b51e53e31babfff'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:31.089797 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-7103b97f-76ff-4d65-966b-c776b7752383 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e580c48851f42358b51e53e31babfff'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:31.098986 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-7103b97f-76ff-4d65-966b-c776b7752383 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e580c48851f42358b51e53e31babfff'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:31.107261 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1022/2044] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 16:51:30 2022] DELETE /identity/v3/users/0e580c48851f42358b51e53e31babfff => generated 0 bytes in 655 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:51:31.134317 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d710d7be-3484-446a-a224-c9b061f7b91f service neutron] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:31.136828 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-d710d7be-3484-446a-a224-c9b061f7b91f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:31.152254 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d710d7be-3484-446a-a224-c9b061f7b91f service neutron] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:31.264859 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12188e41-ccab-4877-aa48-34211ac55ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:31.266005 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12188e41-ccab-4877-aa48-34211ac55ff2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:31.266523 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12188e41-ccab-4877-aa48-34211ac55ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:31.266954 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12188e41-ccab-4877-aa48-34211ac55ff2 admin admin] PATH_INFO: `/v3/projects/4d8fa60080a848798bfb952359c5fa49` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:31.268236 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12188e41-ccab-4877-aa48-34211ac55ff2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d8fa60080a848798bfb952359c5fa49)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:31.270183 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12188e41-ccab-4877-aa48-34211ac55ff2 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:31.433843 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-12188e41-ccab-4877-aa48-34211ac55ff2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d8fa60080a848798bfb952359c5fa49', 'request_id': 'req-12188e41-ccab-4877-aa48-34211ac55ff2'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:31.440690 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-12188e41-ccab-4877-aa48-34211ac55ff2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d8fa60080a848798bfb952359c5fa49', 'request_id': 'req-12188e41-ccab-4877-aa48-34211ac55ff2'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:31.450024 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-12188e41-ccab-4877-aa48-34211ac55ff2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d8fa60080a848798bfb952359c5fa49', 'request_id': 'req-12188e41-ccab-4877-aa48-34211ac55ff2'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:31.609094 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-12188e41-ccab-4877-aa48-34211ac55ff2 admin admin] The token cache is being invalidate because project 4d8fa60080a848798bfb952359c5fa49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:51:31.609705 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-12188e41-ccab-4877-aa48-34211ac55ff2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:31.611885 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-12188e41-ccab-4877-aa48-34211ac55ff2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:31.614095 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1023/2045] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 16:51:31 2022] DELETE /identity/v3/projects/4d8fa60080a848798bfb952359c5fa49 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:31.618701 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7103b97f-76ff-4d65-966b-c776b7752383 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:31.620305 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-7103b97f-76ff-4d65-966b-c776b7752383 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:31.644922 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7103b97f-76ff-4d65-966b-c776b7752383 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:31.806977 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ae795-6e1a-4397-a279-80e82a15b223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:31.807946 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ae795-6e1a-4397-a279-80e82a15b223 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:31.808475 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ae795-6e1a-4397-a279-80e82a15b223 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:31.808766 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ae795-6e1a-4397-a279-80e82a15b223 admin admin] PATH_INFO: `/v3/users/746aadc6a15941cc9a65d278160a34df` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:31.810144 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5ae795-6e1a-4397-a279-80e82a15b223 admin admin] RBAC: Authorizing `identity:delete_user(user_id=746aadc6a15941cc9a65d278160a34df)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:31.812351 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5ae795-6e1a-4397-a279-80e82a15b223 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:31.894347 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12188e41-ccab-4877-aa48-34211ac55ff2 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:31.896920 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-12188e41-ccab-4877-aa48-34211ac55ff2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:31.931132 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12188e41-ccab-4877-aa48-34211ac55ff2 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:31.938485 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c32fd2e-f89a-442e-a37a-367d4e6ddec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:31.944441 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c32fd2e-f89a-442e-a37a-367d4e6ddec0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:31.945463 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c32fd2e-f89a-442e-a37a-367d4e6ddec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:31.945926 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c32fd2e-f89a-442e-a37a-367d4e6ddec0 admin admin] PATH_INFO: `/v3/projects/ea6639d7316a4ac9b857a0798bb5b474` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:31.955075 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c32fd2e-f89a-442e-a37a-367d4e6ddec0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea6639d7316a4ac9b857a0798bb5b474)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:31.955075 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c32fd2e-f89a-442e-a37a-367d4e6ddec0 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:32.073794 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-ab5ae795-6e1a-4397-a279-80e82a15b223 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '746aadc6a15941cc9a65d278160a34df'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:32.073794 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-ab5ae795-6e1a-4397-a279-80e82a15b223 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '746aadc6a15941cc9a65d278160a34df'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:32.090470 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-ab5ae795-6e1a-4397-a279-80e82a15b223 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '746aadc6a15941cc9a65d278160a34df'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:32.252719 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-ab5ae795-6e1a-4397-a279-80e82a15b223 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '746aadc6a15941cc9a65d278160a34df'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:32.275963 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:32.279483 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-ab5ae795-6e1a-4397-a279-80e82a15b223 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '746aadc6a15941cc9a65d278160a34df'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:32.289514 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-3c32fd2e-f89a-442e-a37a-367d4e6ddec0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea6639d7316a4ac9b857a0798bb5b474', 'request_id': 'req-3c32fd2e-f89a-442e-a37a-367d4e6ddec0'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:32.297734 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1023/2046] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 16:51:31 2022] DELETE /identity/v3/users/746aadc6a15941cc9a65d278160a34df => generated 0 bytes in 677 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:32.328311 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-3c32fd2e-f89a-442e-a37a-367d4e6ddec0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea6639d7316a4ac9b857a0798bb5b474', 'request_id': 'req-3c32fd2e-f89a-442e-a37a-367d4e6ddec0'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:32.348305 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-3c32fd2e-f89a-442e-a37a-367d4e6ddec0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea6639d7316a4ac9b857a0798bb5b474', 'request_id': 'req-3c32fd2e-f89a-442e-a37a-367d4e6ddec0'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:32.378376 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:32.494874 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-3c32fd2e-f89a-442e-a37a-367d4e6ddec0 admin admin] The token cache is being invalidate because project ea6639d7316a4ac9b857a0798bb5b474 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:51:32.494874 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-3c32fd2e-f89a-442e-a37a-367d4e6ddec0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:32.494874 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-3c32fd2e-f89a-442e-a37a-367d4e6ddec0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:32.495251 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1024/2047] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 16:51:31 2022] DELETE /identity/v3/projects/ea6639d7316a4ac9b857a0798bb5b474 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:51:32.500259 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83222374-bb46-46a2-b16b-1362fd90742e None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:32.500858 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83222374-bb46-46a2-b16b-1362fd90742e None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:32.501332 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83222374-bb46-46a2-b16b-1362fd90742e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:32.535917 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-83222374-bb46-46a2-b16b-1362fd90742e None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:32.537505 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-83222374-bb46-46a2-b16b-1362fd90742e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:32.655532 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1024/2048] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:51:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:32.663548 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f6b67-a9fa-41ac-91de-dbce11425e53 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:32.663933 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f6b67-a9fa-41ac-91de-dbce11425e53 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:32.664278 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f6b67-a9fa-41ac-91de-dbce11425e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:32.688647 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-cb3f6b67-a9fa-41ac-91de-dbce11425e53 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:32.690294 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-cb3f6b67-a9fa-41ac-91de-dbce11425e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:32.704472 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1025/2049] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:51:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:51:32.711031 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83222374-bb46-46a2-b16b-1362fd90742e None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:32.736773 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83222374-bb46-46a2-b16b-1362fd90742e None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:32.743895 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c55daf-e53a-49cb-b810-647d10acc010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:32.744694 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c55daf-e53a-49cb-b810-647d10acc010 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:32.745764 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c55daf-e53a-49cb-b810-647d10acc010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:32.746059 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c55daf-e53a-49cb-b810-647d10acc010 admin admin] PATH_INFO: `/v3/domains` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:32.746880 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c55daf-e53a-49cb-b810-647d10acc010 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:51:32.747283 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c55daf-e53a-49cb-b810-647d10acc010 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:32.749216 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c55daf-e53a-49cb-b810-647d10acc010 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:32.768615 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1025/2050] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Jul 18 16:51:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:51:32.769929 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f6b67-a9fa-41ac-91de-dbce11425e53 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:32.785155 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f6b67-a9fa-41ac-91de-dbce11425e53 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:32.791601 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700dec64-dc87-4bd9-901c-5808df489515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:32.792370 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700dec64-dc87-4bd9-901c-5808df489515 admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:32.793014 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700dec64-dc87-4bd9-901c-5808df489515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:32.793154 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700dec64-dc87-4bd9-901c-5808df489515 admin admin] PATH_INFO: `/v3/projects` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:32.793805 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700dec64-dc87-4bd9-901c-5808df489515 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:32.795949 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700dec64-dc87-4bd9-901c-5808df489515 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:32.848868 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c55daf-e53a-49cb-b810-647d10acc010 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:32.853457 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-20c55daf-e53a-49cb-b810-647d10acc010 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:32.879917 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c55daf-e53a-49cb-b810-647d10acc010 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:32.888648 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde3b204-8c3e-429a-9b34-84e484252ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:32.890026 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3b204-8c3e-429a-9b34-84e484252ec2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:32.890630 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3b204-8c3e-429a-9b34-84e484252ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:32.893019 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3b204-8c3e-429a-9b34-84e484252ec2 admin admin] PATH_INFO: `/v3/projects/fb9a2d3de3324f22bb8989f781d7fa4d` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:32.893019 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde3b204-8c3e-429a-9b34-84e484252ec2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb9a2d3de3324f22bb8989f781d7fa4d)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:32.894875 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde3b204-8c3e-429a-9b34-84e484252ec2 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:32.981532 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1026/2051] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:51:32 2022] POST /identity/v3/projects => generated 383 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:32.982782 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700dec64-dc87-4bd9-901c-5808df489515 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:33.053758 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700dec64-dc87-4bd9-901c-5808df489515 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:33.061908 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10119ebc-abdf-454a-8153-206d8c771df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:33.062608 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10119ebc-abdf-454a-8153-206d8c771df2 admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:33.062886 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10119ebc-abdf-454a-8153-206d8c771df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:33.065089 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10119ebc-abdf-454a-8153-206d8c771df2 admin admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:33.065089 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10119ebc-abdf-454a-8153-206d8c771df2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:33.066605 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10119ebc-abdf-454a-8153-206d8c771df2 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:33.088584 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-fde3b204-8c3e-429a-9b34-84e484252ec2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb9a2d3de3324f22bb8989f781d7fa4d', 'request_id': 'req-fde3b204-8c3e-429a-9b34-84e484252ec2'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:33.212707 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-fde3b204-8c3e-429a-9b34-84e484252ec2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb9a2d3de3324f22bb8989f781d7fa4d', 'request_id': 'req-fde3b204-8c3e-429a-9b34-84e484252ec2'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:33.223906 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1027/2052] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 16:51:32 2022] POST /identity/v3/users => generated 292 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:33.223906 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405dfd5-406b-436d-8323-89ee37e19142 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:33.223906 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405dfd5-406b-436d-8323-89ee37e19142 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:33.223906 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405dfd5-406b-436d-8323-89ee37e19142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:33.228916 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-fde3b204-8c3e-429a-9b34-84e484252ec2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb9a2d3de3324f22bb8989f781d7fa4d', 'request_id': 'req-fde3b204-8c3e-429a-9b34-84e484252ec2'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:33.247478 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-fde3b204-8c3e-429a-9b34-84e484252ec2 admin admin] The token cache is being invalidate because project fb9a2d3de3324f22bb8989f781d7fa4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:51:33.247869 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-fde3b204-8c3e-429a-9b34-84e484252ec2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:33.249239 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-fde3b204-8c3e-429a-9b34-84e484252ec2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:33.256465 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1026/2053] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 16:51:32 2022] DELETE /identity/v3/projects/fb9a2d3de3324f22bb8989f781d7fa4d => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:51:33.264453 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde3b204-8c3e-429a-9b34-84e484252ec2 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:33.271056 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-fde3b204-8c3e-429a-9b34-84e484252ec2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:33.286333 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-d405dfd5-406b-436d-8323-89ee37e19142 None None] MFA Rules not processed for user `47beed36a8644c5f80186734ab3fd865`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:33.287568 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-d405dfd5-406b-436d-8323-89ee37e19142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:33.429192 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde3b204-8c3e-429a-9b34-84e484252ec2 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:33.433246 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1028/2054] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:51:33 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:33.437735 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb5ac9-ff87-4f46-af8e-390b0a1cbc59 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:33.437735 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb5ac9-ff87-4f46-af8e-390b0a1cbc59 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:33.437735 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb5ac9-ff87-4f46-af8e-390b0a1cbc59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:33.453215 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcaae4c-7680-421f-b000-56e08542606f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:33.454951 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcaae4c-7680-421f-b000-56e08542606f admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:33.455416 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcaae4c-7680-421f-b000-56e08542606f admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:33.456518 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcaae4c-7680-421f-b000-56e08542606f admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:33.459111 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcaae4c-7680-421f-b000-56e08542606f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:33.466246 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcaae4c-7680-421f-b000-56e08542606f admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:33.469585 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-caeb5ac9-ff87-4f46-af8e-390b0a1cbc59 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:33.471188 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-caeb5ac9-ff87-4f46-af8e-390b0a1cbc59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:33.496058 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1027/2055] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:33 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:33.496530 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1029/2056] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:51:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:33.497470 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb5ac9-ff87-4f46-af8e-390b0a1cbc59 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:33.500472 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-caeb5ac9-ff87-4f46-af8e-390b0a1cbc59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:33.506548 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcaae4c-7680-421f-b000-56e08542606f admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:33.523481 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcaae4c-7680-421f-b000-56e08542606f admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:33.545766 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40815f27-d0ac-4eb3-9d87-e44c2eddf279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:33.546465 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40815f27-d0ac-4eb3-9d87-e44c2eddf279 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:33.547314 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40815f27-d0ac-4eb3-9d87-e44c2eddf279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:33.547314 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40815f27-d0ac-4eb3-9d87-e44c2eddf279 admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:33.547919 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40815f27-d0ac-4eb3-9d87-e44c2eddf279 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:33.549379 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40815f27-d0ac-4eb3-9d87-e44c2eddf279 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:33.561286 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1028/2057] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:33 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 16:51:33.562650 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595bd222-60aa-4238-b558-5375f1aeaeca None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:33.562943 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595bd222-60aa-4238-b558-5375f1aeaeca None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:33.563225 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595bd222-60aa-4238-b558-5375f1aeaeca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:33.603923 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-595bd222-60aa-4238-b558-5375f1aeaeca None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:33.609858 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-595bd222-60aa-4238-b558-5375f1aeaeca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:33.623874 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1029/2058] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:51:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:33.623874 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595bd222-60aa-4238-b558-5375f1aeaeca None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:33.650409 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595bd222-60aa-4238-b558-5375f1aeaeca None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:33.669293 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c806426-ade3-4d73-966f-9fedb0514cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:33.670701 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c806426-ade3-4d73-966f-9fedb0514cf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:33.670938 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c806426-ade3-4d73-966f-9fedb0514cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:33.671298 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c806426-ade3-4d73-966f-9fedb0514cf0 admin admin] PATH_INFO: `/v3/projects/a7f0bd39460f4995b07f85c0eac71006/users/aeeb10be2d3a406f810e440e9a743ead/roles/ad3a2bc7b2094a4da1a95a143c8d9436` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:33.705653 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c806426-ade3-4d73-966f-9fedb0514cf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7f0bd39460f4995b07f85c0eac71006, user_id=aeeb10be2d3a406f810e440e9a743ead, role_id=ad3a2bc7b2094a4da1a95a143c8d9436)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:33.708685 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c806426-ade3-4d73-966f-9fedb0514cf0 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:33.728345 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb5ac9-ff87-4f46-af8e-390b0a1cbc59 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:33.734377 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee05484-763b-44ef-a1a8-414919f02e57 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e638fbc5f1f3447c8e189c228bbae530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:33.735576 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee05484-763b-44ef-a1a8-414919f02e57 service glance] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:33.736012 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee05484-763b-44ef-a1a8-414919f02e57 service glance] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:33.736296 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee05484-763b-44ef-a1a8-414919f02e57 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:33.739287 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-0ee05484-763b-44ef-a1a8-414919f02e57 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:33.868831 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee05484-763b-44ef-a1a8-414919f02e57 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:33.870812 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee05484-763b-44ef-a1a8-414919f02e57 service glance] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:33.885500 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1030/2059] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:51:33 2022] PUT /identity/v3/projects/a7f0bd39460f4995b07f85c0eac71006/users/aeeb10be2d3a406f810e440e9a743ead/roles/ad3a2bc7b2094a4da1a95a143c8d9436 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:33.885500 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c806426-ade3-4d73-966f-9fedb0514cf0 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:33.888682 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1030/2060] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:51:33.890914 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf6882a-50cb-4582-93e5-bb4046e1d604 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:33.891316 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf6882a-50cb-4582-93e5-bb4046e1d604 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:33.891752 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf6882a-50cb-4582-93e5-bb4046e1d604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:33.950961 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-ccf6882a-50cb-4582-93e5-bb4046e1d604 None None] MFA Rules not processed for user `aeeb10be2d3a406f810e440e9a743ead`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:33.953805 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-ccf6882a-50cb-4582-93e5-bb4046e1d604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:33.968206 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c806426-ade3-4d73-966f-9fedb0514cf0 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:33.974014 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406485df-3ceb-4e64-92e1-32b46bd97fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:33.974755 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406485df-3ceb-4e64-92e1-32b46bd97fa3 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:33.975049 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406485df-3ceb-4e64-92e1-32b46bd97fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:33.975320 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406485df-3ceb-4e64-92e1-32b46bd97fa3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:33.976145 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406485df-3ceb-4e64-92e1-32b46bd97fa3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:51:33.976460 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406485df-3ceb-4e64-92e1-32b46bd97fa3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:33.978696 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406485df-3ceb-4e64-92e1-32b46bd97fa3 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:33.994060 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1031/2061] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Jul 18 16:51:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:51:34.000052 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406485df-3ceb-4e64-92e1-32b46bd97fa3 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:34.025860 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406485df-3ceb-4e64-92e1-32b46bd97fa3 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:34.034025 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad90e92-681d-42e5-ba32-9b8bf3afbd4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:34.035134 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad90e92-681d-42e5-ba32-9b8bf3afbd4b admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:34.035603 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad90e92-681d-42e5-ba32-9b8bf3afbd4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:34.036070 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad90e92-681d-42e5-ba32-9b8bf3afbd4b admin admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:34.036911 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad90e92-681d-42e5-ba32-9b8bf3afbd4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:34.039933 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad90e92-681d-42e5-ba32-9b8bf3afbd4b admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:34.081009 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1031/2062] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:51:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:34.086410 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf6882a-50cb-4582-93e5-bb4046e1d604 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:34.099966 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf6882a-50cb-4582-93e5-bb4046e1d604 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:34.105221 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6969e43c-e78f-4cb1-8025-c3a7fb444e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:34.106683 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6969e43c-e78f-4cb1-8025-c3a7fb444e1c admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:34.107287 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6969e43c-e78f-4cb1-8025-c3a7fb444e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:34.107875 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6969e43c-e78f-4cb1-8025-c3a7fb444e1c admin admin] PATH_INFO: `/v3/projects` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:34.109052 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6969e43c-e78f-4cb1-8025-c3a7fb444e1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:34.111392 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6969e43c-e78f-4cb1-8025-c3a7fb444e1c admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:34.161601 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1032/2063] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:51:33 2022] POST /identity/v3/projects => generated 373 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:34.162803 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad90e92-681d-42e5-ba32-9b8bf3afbd4b admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:34.221723 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1032/2064] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:51:34 2022] POST /identity/v3/projects => generated 385 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:34.224559 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6969e43c-e78f-4cb1-8025-c3a7fb444e1c admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:34.326509 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad90e92-681d-42e5-ba32-9b8bf3afbd4b admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:34.363029 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6969e43c-e78f-4cb1-8025-c3a7fb444e1c admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:34.370081 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4510a52e-3eba-48ee-b911-18c9fa1179f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:34.371148 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4510a52e-3eba-48ee-b911-18c9fa1179f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:34.371148 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4510a52e-3eba-48ee-b911-18c9fa1179f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:34.371377 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4510a52e-3eba-48ee-b911-18c9fa1179f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:34.372263 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4510a52e-3eba-48ee-b911-18c9fa1179f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:34.374259 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4510a52e-3eba-48ee-b911-18c9fa1179f7 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:34.426865 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f93831-b2bf-437d-a62c-f70142599aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:34.427805 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f93831-b2bf-437d-a62c-f70142599aed admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:34.429024 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f93831-b2bf-437d-a62c-f70142599aed admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:34.431539 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f93831-b2bf-437d-a62c-f70142599aed admin admin] PATH_INFO: `/v3/users` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:34.432422 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f93831-b2bf-437d-a62c-f70142599aed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:34.434517 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f93831-b2bf-437d-a62c-f70142599aed admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:34.517521 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1033/2065] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 16:51:34 2022] POST /identity/v3/users => generated 293 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:34.519102 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c4b50-4567-452b-8d37-79447abefed8 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:34.519416 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c4b50-4567-452b-8d37-79447abefed8 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:34.520005 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c4b50-4567-452b-8d37-79447abefed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:34.556915 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-033c4b50-4567-452b-8d37-79447abefed8 None None] MFA Rules not processed for user `ea2a096c4b964f03aed533d1e5e96db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:34.558097 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-033c4b50-4567-452b-8d37-79447abefed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:34.629518 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1033/2066] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 16:51:34 2022] POST /identity/v3/users => generated 287 bytes in 467 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:34.648416 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f93831-b2bf-437d-a62c-f70142599aed admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:34.661680 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f93831-b2bf-437d-a62c-f70142599aed admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:34.667852 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e08ead-a5f6-4ceb-bc01-c33033c44a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:34.669262 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e08ead-a5f6-4ceb-bc01-c33033c44a50 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:34.669646 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e08ead-a5f6-4ceb-bc01-c33033c44a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:34.669987 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e08ead-a5f6-4ceb-bc01-c33033c44a50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:34.675998 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e08ead-a5f6-4ceb-bc01-c33033c44a50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:34.675998 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e08ead-a5f6-4ceb-bc01-c33033c44a50 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:34.678478 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1034/2067] 10.222.0.81 () {58 vars in 1009 bytes} [Mon Jul 18 16:51:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:34.679527 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c4b50-4567-452b-8d37-79447abefed8 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:34.710888 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c4b50-4567-452b-8d37-79447abefed8 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:34.714998 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eebb2ca-50dd-4bfe-aa03-bd9d67ee4dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:34.715692 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eebb2ca-50dd-4bfe-aa03-bd9d67ee4dad admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:34.716130 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eebb2ca-50dd-4bfe-aa03-bd9d67ee4dad admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:34.716523 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eebb2ca-50dd-4bfe-aa03-bd9d67ee4dad admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:34.717392 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eebb2ca-50dd-4bfe-aa03-bd9d67ee4dad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:34.719670 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eebb2ca-50dd-4bfe-aa03-bd9d67ee4dad admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:34.726556 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1034/2068] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:34 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:34.728307 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e08ead-a5f6-4ceb-bc01-c33033c44a50 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:34.732672 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1035/2069] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:34 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:34.742613 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eebb2ca-50dd-4bfe-aa03-bd9d67ee4dad admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:34.744820 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e08ead-a5f6-4ceb-bc01-c33033c44a50 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:34.750139 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78daeb9-813e-41a5-a44b-d036ae16a5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:34.751170 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78daeb9-813e-41a5-a44b-d036ae16a5ce admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:34.752064 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78daeb9-813e-41a5-a44b-d036ae16a5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:34.752064 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78daeb9-813e-41a5-a44b-d036ae16a5ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:34.753585 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78daeb9-813e-41a5-a44b-d036ae16a5ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:34.754452 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eebb2ca-50dd-4bfe-aa03-bd9d67ee4dad admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:34.755036 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78daeb9-813e-41a5-a44b-d036ae16a5ce admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:34.760670 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45817d3-8d28-4224-bd9f-fe29aa2f0d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:34.761518 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45817d3-8d28-4224-bd9f-fe29aa2f0d30 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:34.761826 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45817d3-8d28-4224-bd9f-fe29aa2f0d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:34.762076 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45817d3-8d28-4224-bd9f-fe29aa2f0d30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:34.762817 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45817d3-8d28-4224-bd9f-fe29aa2f0d30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:34.764536 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45817d3-8d28-4224-bd9f-fe29aa2f0d30 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:34.771843 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1035/2070] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:34 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:34.773180 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78daeb9-813e-41a5-a44b-d036ae16a5ce admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:34.775163 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-f78daeb9-813e-41a5-a44b-d036ae16a5ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:34.778907 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1036/2071] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:34.778907 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45817d3-8d28-4224-bd9f-fe29aa2f0d30 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:34.789141 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45817d3-8d28-4224-bd9f-fe29aa2f0d30 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:34.797397 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7234e6e-2320-45cf-a502-a7cea50a09ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:34.798092 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7234e6e-2320-45cf-a502-a7cea50a09ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:34.798376 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7234e6e-2320-45cf-a502-a7cea50a09ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:34.798647 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7234e6e-2320-45cf-a502-a7cea50a09ac admin admin] PATH_INFO: `/v3/projects/4d6418a3d4594759892873a82c17deec/users/0ac14d44174b46e9999e34a749307742/roles/ad3a2bc7b2094a4da1a95a143c8d9436` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:34.836904 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7234e6e-2320-45cf-a502-a7cea50a09ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d6418a3d4594759892873a82c17deec, user_id=0ac14d44174b46e9999e34a749307742, role_id=ad3a2bc7b2094a4da1a95a143c8d9436)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:34.839652 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7234e6e-2320-45cf-a502-a7cea50a09ac admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:34.866811 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78daeb9-813e-41a5-a44b-d036ae16a5ce admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:34.872704 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba64df-e56f-43b9-b40b-775f80613b10 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251475c53ac64cd48ae84567d8c2ee87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:34.873367 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba64df-e56f-43b9-b40b-775f80613b10 service swift] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:34.873658 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba64df-e56f-43b9-b40b-775f80613b10 service swift] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:34.873993 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba64df-e56f-43b9-b40b-775f80613b10 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:34.883932 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dba64df-e56f-43b9-b40b-775f80613b10 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:34.885519 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dba64df-e56f-43b9-b40b-775f80613b10 service swift] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:34.894826 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1036/2072] 10.222.0.81 () {60 vars in 1384 bytes} [Mon Jul 18 16:51:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 16:51:34.895454 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba64df-e56f-43b9-b40b-775f80613b10 service swift] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:34.905583 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba64df-e56f-43b9-b40b-775f80613b10 service swift] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:34.911415 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89565f77-dfbf-43c3-996f-1220747ae5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:34.913869 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89565f77-dfbf-43c3-996f-1220747ae5af admin admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:34.914024 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89565f77-dfbf-43c3-996f-1220747ae5af admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:34.914281 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89565f77-dfbf-43c3-996f-1220747ae5af admin admin] PATH_INFO: `/v3/projects/e98e3818c045448b9b642bfa825131e3/users/ea500994fa224c75a276fac106248d14/roles/ad3a2bc7b2094a4da1a95a143c8d9436` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:34.953936 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89565f77-dfbf-43c3-996f-1220747ae5af admin admin] RBAC: Authorizing `identity:create_grant(project_id=e98e3818c045448b9b642bfa825131e3, user_id=ea500994fa224c75a276fac106248d14, role_id=ad3a2bc7b2094a4da1a95a143c8d9436)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:34.965571 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89565f77-dfbf-43c3-996f-1220747ae5af admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:35.013577 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1037/2073] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:51:34 2022] PUT /identity/v3/projects/4d6418a3d4594759892873a82c17deec/users/0ac14d44174b46e9999e34a749307742/roles/ad3a2bc7b2094a4da1a95a143c8d9436 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:35.031425 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716065e3-06b6-4b9e-9e9d-792bc2fe9d1c None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:35.034484 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716065e3-06b6-4b9e-9e9d-792bc2fe9d1c None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:35.036308 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716065e3-06b6-4b9e-9e9d-792bc2fe9d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:35.049506 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1037/2074] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:51:34 2022] PUT /identity/v3/projects/e98e3818c045448b9b642bfa825131e3/users/ea500994fa224c75a276fac106248d14/roles/ad3a2bc7b2094a4da1a95a143c8d9436 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:35.066054 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd393138-d8cf-4d85-8307-7974ba9f0fb8 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:35.066491 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd393138-d8cf-4d85-8307-7974ba9f0fb8 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:35.066781 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd393138-d8cf-4d85-8307-7974ba9f0fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:35.204534 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-dd393138-d8cf-4d85-8307-7974ba9f0fb8 None None] MFA Rules not processed for user `ea500994fa224c75a276fac106248d14`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:35.205863 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-dd393138-d8cf-4d85-8307-7974ba9f0fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:35.207983 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-716065e3-06b6-4b9e-9e9d-792bc2fe9d1c None None] MFA Rules not processed for user `0ac14d44174b46e9999e34a749307742`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:35.209445 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-716065e3-06b6-4b9e-9e9d-792bc2fe9d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:35.232355 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:35.393911 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1038/2075] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:51:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:35.403051 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd393138-d8cf-4d85-8307-7974ba9f0fb8 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:35.404640 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-dd393138-d8cf-4d85-8307-7974ba9f0fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:35.434733 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1038/2076] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:51:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:35.435783 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716065e3-06b6-4b9e-9e9d-792bc2fe9d1c None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:35.500363 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd393138-d8cf-4d85-8307-7974ba9f0fb8 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:35.505637 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bbb2e1-4513-4eac-bbe9-77631d35f7e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:35.506426 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bbb2e1-4513-4eac-bbe9-77631d35f7e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:35.506710 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bbb2e1-4513-4eac-bbe9-77631d35f7e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:35.506993 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bbb2e1-4513-4eac-bbe9-77631d35f7e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:35.519759 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bbb2e1-4513-4eac-bbe9-77631d35f7e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:35.521489 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bbb2e1-4513-4eac-bbe9-77631d35f7e6 service cinder] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:35.536314 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1039/2077] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 16:51:35.612507 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:35.613331 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716065e3-06b6-4b9e-9e9d-792bc2fe9d1c None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:35.635947 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c86ea2-512d-4537-b019-4cb8a43a4c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:35.637079 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c86ea2-512d-4537-b019-4cb8a43a4c0b admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:35.637556 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c86ea2-512d-4537-b019-4cb8a43a4c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:35.637986 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c86ea2-512d-4537-b019-4cb8a43a4c0b admin admin] PATH_INFO: `/v3/projects` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:35.640414 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c86ea2-512d-4537-b019-4cb8a43a4c0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:35.643606 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c86ea2-512d-4537-b019-4cb8a43a4c0b admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:35.763728 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1039/2078] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:51:35 2022] POST /identity/v3/projects => generated 385 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:35.765976 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bbb2e1-4513-4eac-bbe9-77631d35f7e6 service cinder] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:35.785191 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bbb2e1-4513-4eac-bbe9-77631d35f7e6 service cinder] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:35.971829 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb0738-0207-4dc5-96db-fd5d4b2fb0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:35.972756 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb0738-0207-4dc5-96db-fd5d4b2fb0a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:35.973958 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb0738-0207-4dc5-96db-fd5d4b2fb0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:35.974424 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb0738-0207-4dc5-96db-fd5d4b2fb0a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:35.975479 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eb0738-0207-4dc5-96db-fd5d4b2fb0a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:35.980519 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eb0738-0207-4dc5-96db-fd5d4b2fb0a9 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:36.123576 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1040/2079] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 16:51:35 2022] POST /identity/v3/users => generated 299 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:36.125826 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c86ea2-512d-4537-b019-4cb8a43a4c0b admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:36.144542 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c86ea2-512d-4537-b019-4cb8a43a4c0b admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:36.156725 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e39a1e-4211-40b3-ac23-5fc049ed63c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:36.157415 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e39a1e-4211-40b3-ac23-5fc049ed63c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:36.157697 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e39a1e-4211-40b3-ac23-5fc049ed63c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:36.158011 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e39a1e-4211-40b3-ac23-5fc049ed63c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:36.158699 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e39a1e-4211-40b3-ac23-5fc049ed63c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:36.170357 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e39a1e-4211-40b3-ac23-5fc049ed63c1 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:36.203437 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1040/2080] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:36 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:36.204515 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb0738-0207-4dc5-96db-fd5d4b2fb0a9 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:36.220006 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb0738-0207-4dc5-96db-fd5d4b2fb0a9 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:36.239287 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487fdaa-6bb7-45d4-85c0-b873dcfa4235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:36.266334 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487fdaa-6bb7-45d4-85c0-b873dcfa4235 admin admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:36.267340 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487fdaa-6bb7-45d4-85c0-b873dcfa4235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:36.267633 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487fdaa-6bb7-45d4-85c0-b873dcfa4235 admin admin] PATH_INFO: `/v3/projects/eeaa19dbbf2b40499feee878cffa0422/users/9ccc10081cea4852993aa27d6232f1c3/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:36.331277 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b487fdaa-6bb7-45d4-85c0-b873dcfa4235 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeaa19dbbf2b40499feee878cffa0422, user_id=9ccc10081cea4852993aa27d6232f1c3, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:36.335893 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b487fdaa-6bb7-45d4-85c0-b873dcfa4235 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:36.452684 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1041/2081] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:51:36 2022] PUT /identity/v3/projects/eeaa19dbbf2b40499feee878cffa0422/users/9ccc10081cea4852993aa27d6232f1c3/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:36.456391 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e39a1e-4211-40b3-ac23-5fc049ed63c1 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:36.476725 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e39a1e-4211-40b3-ac23-5fc049ed63c1 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:36.656343 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f071853-78e6-454a-900a-dc28df387450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:36.659607 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f071853-78e6-454a-900a-dc28df387450 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:36.660656 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f071853-78e6-454a-900a-dc28df387450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:36.666276 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f071853-78e6-454a-900a-dc28df387450 admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:36.667290 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f071853-78e6-454a-900a-dc28df387450 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:36.673725 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f071853-78e6-454a-900a-dc28df387450 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:36.714916 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1041/2082] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:36 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:36.719194 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487fdaa-6bb7-45d4-85c0-b873dcfa4235 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:36.740761 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487fdaa-6bb7-45d4-85c0-b873dcfa4235 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:36.747876 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32669884-0a13-46f5-9e82-1d88f193dc68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:36.748831 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32669884-0a13-46f5-9e82-1d88f193dc68 admin admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:36.749132 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32669884-0a13-46f5-9e82-1d88f193dc68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:36.749893 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32669884-0a13-46f5-9e82-1d88f193dc68 admin admin] PATH_INFO: `/v3/projects/eeaa19dbbf2b40499feee878cffa0422/users/9ccc10081cea4852993aa27d6232f1c3/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:36.752879 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32669884-0a13-46f5-9e82-1d88f193dc68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeaa19dbbf2b40499feee878cffa0422, user_id=9ccc10081cea4852993aa27d6232f1c3, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:36.756640 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32669884-0a13-46f5-9e82-1d88f193dc68 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:36.774656 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1042/2083] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:51:36 2022] PUT /identity/v3/projects/eeaa19dbbf2b40499feee878cffa0422/users/9ccc10081cea4852993aa27d6232f1c3/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:36.790868 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a9b9c9-371f-4b87-a40b-3d65492f88fb None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:36.791417 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a9b9c9-371f-4b87-a40b-3d65492f88fb None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:36.791878 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a9b9c9-371f-4b87-a40b-3d65492f88fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:36.920029 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-58a9b9c9-371f-4b87-a40b-3d65492f88fb None None] MFA Rules not processed for user `9ccc10081cea4852993aa27d6232f1c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:36.921378 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-58a9b9c9-371f-4b87-a40b-3d65492f88fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:37.192889 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1042/2084] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:51:36 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:37.219084 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32669884-0a13-46f5-9e82-1d88f193dc68 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:37.273130 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4943ddc-9e9d-4ef6-95e2-0b46367aa80e None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:37.273426 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4943ddc-9e9d-4ef6-95e2-0b46367aa80e None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:37.273715 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4943ddc-9e9d-4ef6-95e2-0b46367aa80e None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:37.275352 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1043/2085] 10.222.0.81 () {54 vars in 921 bytes} [Mon Jul 18 16:51:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:51:37.301954 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7b5a3-918d-4e62-bc9d-73ed01dd706a None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:37.302243 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7b5a3-918d-4e62-bc9d-73ed01dd706a None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:37.302522 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7b5a3-918d-4e62-bc9d-73ed01dd706a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:37.359944 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32669884-0a13-46f5-9e82-1d88f193dc68 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:37.367539 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d7cb00-e4e7-4ea3-af0e-555c3beadbbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:37.370507 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d7cb00-e4e7-4ea3-af0e-555c3beadbbb service cinder] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:37.371000 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d7cb00-e4e7-4ea3-af0e-555c3beadbbb service cinder] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:37.371697 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d7cb00-e4e7-4ea3-af0e-555c3beadbbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:37.372743 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-b5b7b5a3-918d-4e62-bc9d-73ed01dd706a None None] MFA Rules not processed for user `5700ad7df774415b89737c7dddcc5b2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:37.374421 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-b5b7b5a3-918d-4e62-bc9d-73ed01dd706a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:37.501429 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d7cb00-e4e7-4ea3-af0e-555c3beadbbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:37.504306 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d7cb00-e4e7-4ea3-af0e-555c3beadbbb service cinder] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:37.516945 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1043/2086] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:51:37.538043 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1044/2087] 10.222.0.81 () {58 vars in 1018 bytes} [Mon Jul 18 16:51:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:51:37.556748 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d7cb00-e4e7-4ea3-af0e-555c3beadbbb service cinder] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:37.558284 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-89d7cb00-e4e7-4ea3-af0e-555c3beadbbb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:37.575861 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d7cb00-e4e7-4ea3-af0e-555c3beadbbb service cinder] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:37.585596 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a3dd07-18b4-4c14-9f54-ae7ae2fba753 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700ad7df774415b89737c7dddcc5b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:37.586324 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3dd07-18b4-4c14-9f54-ae7ae2fba753 service placement] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:37.587033 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3dd07-18b4-4c14-9f54-ae7ae2fba753 service placement] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:37.587318 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3dd07-18b4-4c14-9f54-ae7ae2fba753 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:37.636506 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a3dd07-18b4-4c14-9f54-ae7ae2fba753 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:37.638211 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a3dd07-18b4-4c14-9f54-ae7ae2fba753 service placement] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:37.681197 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b7b5a3-918d-4e62-bc9d-73ed01dd706a None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:37.684442 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1044/2088] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:51:37.684807 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-b5b7b5a3-918d-4e62-bc9d-73ed01dd706a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:37.858688 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b7b5a3-918d-4e62-bc9d-73ed01dd706a None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:37.910379 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48c7298-c47b-40de-ab7e-e71acd2fe275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:37.911539 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c7298-c47b-40de-ab7e-e71acd2fe275 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:37.911864 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c7298-c47b-40de-ab7e-e71acd2fe275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:37.912462 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c7298-c47b-40de-ab7e-e71acd2fe275 admin admin] PATH_INFO: `/v3/users/7c6f005f5340494dabfc000fe19fe60a` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:37.914165 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48c7298-c47b-40de-ab7e-e71acd2fe275 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c6f005f5340494dabfc000fe19fe60a)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:37.916320 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48c7298-c47b-40de-ab7e-e71acd2fe275 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:38.230419 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-b48c7298-c47b-40de-ab7e-e71acd2fe275 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c6f005f5340494dabfc000fe19fe60a'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:38.251020 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-b48c7298-c47b-40de-ab7e-e71acd2fe275 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c6f005f5340494dabfc000fe19fe60a'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:38.252905 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-b48c7298-c47b-40de-ab7e-e71acd2fe275 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c6f005f5340494dabfc000fe19fe60a'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:38.284567 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-b48c7298-c47b-40de-ab7e-e71acd2fe275 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c6f005f5340494dabfc000fe19fe60a'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:38.412975 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-b48c7298-c47b-40de-ab7e-e71acd2fe275 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c6f005f5340494dabfc000fe19fe60a'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:38.421554 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1045/2089] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 16:51:37 2022] DELETE /identity/v3/users/7c6f005f5340494dabfc000fe19fe60a => generated 0 bytes in 741 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:38.542940 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:38.845870 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a3dd07-18b4-4c14-9f54-ae7ae2fba753 service placement] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:38.864352 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a3dd07-18b4-4c14-9f54-ae7ae2fba753 service placement] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:38.995519 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57570f14-74ec-4a77-be0d-76e79d6a4510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:38.996491 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57570f14-74ec-4a77-be0d-76e79d6a4510 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:38.996847 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57570f14-74ec-4a77-be0d-76e79d6a4510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:38.997188 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57570f14-74ec-4a77-be0d-76e79d6a4510 admin admin] PATH_INFO: `/v3/projects/11f85668e030420ea9b51b724dcd950d` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:38.998533 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57570f14-74ec-4a77-be0d-76e79d6a4510 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11f85668e030420ea9b51b724dcd950d)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:39.001913 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57570f14-74ec-4a77-be0d-76e79d6a4510 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:39.229762 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-57570f14-74ec-4a77-be0d-76e79d6a4510 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11f85668e030420ea9b51b724dcd950d', 'request_id': 'req-57570f14-74ec-4a77-be0d-76e79d6a4510'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:39.326251 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-57570f14-74ec-4a77-be0d-76e79d6a4510 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11f85668e030420ea9b51b724dcd950d', 'request_id': 'req-57570f14-74ec-4a77-be0d-76e79d6a4510'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:39.356635 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-57570f14-74ec-4a77-be0d-76e79d6a4510 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11f85668e030420ea9b51b724dcd950d', 'request_id': 'req-57570f14-74ec-4a77-be0d-76e79d6a4510'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:39.369293 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-57570f14-74ec-4a77-be0d-76e79d6a4510 admin admin] The token cache is being invalidate because project 11f85668e030420ea9b51b724dcd950d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:51:39.369581 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-57570f14-74ec-4a77-be0d-76e79d6a4510 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:39.370274 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-57570f14-74ec-4a77-be0d-76e79d6a4510 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:39.371880 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1045/2090] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 16:51:38 2022] DELETE /identity/v3/projects/11f85668e030420ea9b51b724dcd950d => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:39.377761 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0891b75-65f7-432e-afcc-19d7dc9cad9d None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:39.378334 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0891b75-65f7-432e-afcc-19d7dc9cad9d None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:39.379421 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0891b75-65f7-432e-afcc-19d7dc9cad9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:39.401350 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-c0891b75-65f7-432e-afcc-19d7dc9cad9d None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:39.402694 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-c0891b75-65f7-432e-afcc-19d7dc9cad9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:39.504272 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1046/2091] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:51:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:39.506879 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5544a0-db29-41ff-89d7-665479b3996f None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:39.507172 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5544a0-db29-41ff-89d7-665479b3996f None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:39.507539 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5544a0-db29-41ff-89d7-665479b3996f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:39.528591 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-2b5544a0-db29-41ff-89d7-665479b3996f None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:39.529946 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-2b5544a0-db29-41ff-89d7-665479b3996f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:39.538515 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:39.548431 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1046/2092] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:51:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:39.555492 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0891b75-65f7-432e-afcc-19d7dc9cad9d None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:39.579013 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0891b75-65f7-432e-afcc-19d7dc9cad9d None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:39.593548 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac9f51e-3d2f-47be-bef1-66a8f061ec89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:39.594235 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac9f51e-3d2f-47be-bef1-66a8f061ec89 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:39.594945 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac9f51e-3d2f-47be-bef1-66a8f061ec89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:39.596605 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac9f51e-3d2f-47be-bef1-66a8f061ec89 admin admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:39.596605 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac9f51e-3d2f-47be-bef1-66a8f061ec89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:51:39.596605 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac9f51e-3d2f-47be-bef1-66a8f061ec89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:39.598044 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac9f51e-3d2f-47be-bef1-66a8f061ec89 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:39.618581 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1047/2093] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Jul 18 16:51:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:51:39.622728 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5544a0-db29-41ff-89d7-665479b3996f None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:39.633198 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5544a0-db29-41ff-89d7-665479b3996f None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:39.644188 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025315a0-33c0-4deb-a347-7a9eacab5dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:39.645585 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025315a0-33c0-4deb-a347-7a9eacab5dc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:39.646065 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025315a0-33c0-4deb-a347-7a9eacab5dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:39.646723 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025315a0-33c0-4deb-a347-7a9eacab5dc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:39.647578 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025315a0-33c0-4deb-a347-7a9eacab5dc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:39.650435 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025315a0-33c0-4deb-a347-7a9eacab5dc7 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:39.787646 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1047/2094] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:51:39 2022] POST /identity/v3/projects => generated 383 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:39.792650 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac9f51e-3d2f-47be-bef1-66a8f061ec89 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:39.807375 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac9f51e-3d2f-47be-bef1-66a8f061ec89 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:39.952887 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616ef393-58dc-48e5-812b-916272809be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:39.953962 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ef393-58dc-48e5-812b-916272809be4 admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:39.954474 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ef393-58dc-48e5-812b-916272809be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:39.954921 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ef393-58dc-48e5-812b-916272809be4 admin admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:39.956162 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616ef393-58dc-48e5-812b-916272809be4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:39.959216 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616ef393-58dc-48e5-812b-916272809be4 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:40.516187 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1048/2095] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 16:51:39 2022] POST /identity/v3/users => generated 292 bytes in 724 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:40.520207 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025315a0-33c0-4deb-a347-7a9eacab5dc7 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:40.536268 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025315a0-33c0-4deb-a347-7a9eacab5dc7 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:40.536911 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c473cef-63d5-46bd-9143-3ff7e052a4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:40.537650 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c473cef-63d5-46bd-9143-3ff7e052a4d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:40.537935 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c473cef-63d5-46bd-9143-3ff7e052a4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:40.538212 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c473cef-63d5-46bd-9143-3ff7e052a4d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:40.538988 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c473cef-63d5-46bd-9143-3ff7e052a4d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:40.541343 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c473cef-63d5-46bd-9143-3ff7e052a4d3 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:40.552833 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1048/2096] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 16:51:40.557089 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616ef393-58dc-48e5-812b-916272809be4 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:40.567725 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616ef393-58dc-48e5-812b-916272809be4 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:40.574391 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361ff1e-d265-41aa-aa33-25588c4624d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:40.575065 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361ff1e-d265-41aa-aa33-25588c4624d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:40.575372 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361ff1e-d265-41aa-aa33-25588c4624d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:40.575772 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361ff1e-d265-41aa-aa33-25588c4624d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:40.576523 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f361ff1e-d265-41aa-aa33-25588c4624d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:40.578205 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f361ff1e-d265-41aa-aa33-25588c4624d2 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:40.590277 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1049/2097] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:40.599838 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c473cef-63d5-46bd-9143-3ff7e052a4d3 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:40.616105 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c473cef-63d5-46bd-9143-3ff7e052a4d3 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:40.622105 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2bb037-8173-4705-91fb-6bba772942d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:40.623205 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2bb037-8173-4705-91fb-6bba772942d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:40.623670 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2bb037-8173-4705-91fb-6bba772942d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:40.623981 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2bb037-8173-4705-91fb-6bba772942d7 admin admin] PATH_INFO: `/v3/projects/e5dca19b5f2446ae82f931c86c4c1175/users/46efb659a6f0489d9c13664b62e95885/roles/ad3a2bc7b2094a4da1a95a143c8d9436` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:40.646685 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2bb037-8173-4705-91fb-6bba772942d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5dca19b5f2446ae82f931c86c4c1175, user_id=46efb659a6f0489d9c13664b62e95885, role_id=ad3a2bc7b2094a4da1a95a143c8d9436)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:40.650236 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2bb037-8173-4705-91fb-6bba772942d7 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:40.788841 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1049/2098] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:51:40 2022] PUT /identity/v3/projects/e5dca19b5f2446ae82f931c86c4c1175/users/46efb659a6f0489d9c13664b62e95885/roles/ad3a2bc7b2094a4da1a95a143c8d9436 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:40.801205 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d0c8c-6233-4cc6-bbf2-a3164bcbbcb0 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:40.801497 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d0c8c-6233-4cc6-bbf2-a3164bcbbcb0 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:40.801755 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d0c8c-6233-4cc6-bbf2-a3164bcbbcb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:40.853795 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-769d0c8c-6233-4cc6-bbf2-a3164bcbbcb0 None None] MFA Rules not processed for user `46efb659a6f0489d9c13664b62e95885`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:40.856284 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-769d0c8c-6233-4cc6-bbf2-a3164bcbbcb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:41.056262 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1050/2099] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:51:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:41.066967 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2bb037-8173-4705-91fb-6bba772942d7 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:41.069117 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-ad2bb037-8173-4705-91fb-6bba772942d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:41.191882 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2bb037-8173-4705-91fb-6bba772942d7 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:41.198527 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129fad4d-2424-47ca-9c65-aaa4cfda299f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07f0c5bf1bee48a0bafdf7a9e4537c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:41.199368 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129fad4d-2424-47ca-9c65-aaa4cfda299f service nova] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:41.199652 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129fad4d-2424-47ca-9c65-aaa4cfda299f service nova] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:41.199949 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129fad4d-2424-47ca-9c65-aaa4cfda299f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:41.214056 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129fad4d-2424-47ca-9c65-aaa4cfda299f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:41.215798 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129fad4d-2424-47ca-9c65-aaa4cfda299f service nova] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:41.235151 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1050/2100] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:51:41.335075 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d0c8c-6233-4cc6-bbf2-a3164bcbbcb0 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:41.337102 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-769d0c8c-6233-4cc6-bbf2-a3164bcbbcb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:41.421872 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d0c8c-6233-4cc6-bbf2-a3164bcbbcb0 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:41.426661 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f526f0c-e7b1-4aa5-bed3-49ba83f3aa85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:41.427340 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f526f0c-e7b1-4aa5-bed3-49ba83f3aa85 service cinder] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:41.427623 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f526f0c-e7b1-4aa5-bed3-49ba83f3aa85 service cinder] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:41.427997 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f526f0c-e7b1-4aa5-bed3-49ba83f3aa85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:41.430094 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-0f526f0c-e7b1-4aa5-bed3-49ba83f3aa85 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:41.515684 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f526f0c-e7b1-4aa5-bed3-49ba83f3aa85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:41.518373 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f526f0c-e7b1-4aa5-bed3-49ba83f3aa85 service cinder] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:41.529753 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1051/2101] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:51:41.644497 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:42.731267 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:44.021486 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:44.080298 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129fad4d-2424-47ca-9c65-aaa4cfda299f service nova] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:44.082473 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-129fad4d-2424-47ca-9c65-aaa4cfda299f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:44.210778 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129fad4d-2424-47ca-9c65-aaa4cfda299f service nova] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:44.220614 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb3d0c-2aac-4d48-983b-59265d8a9d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:44.225248 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb3d0c-2aac-4d48-983b-59265d8a9d08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:44.225554 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb3d0c-2aac-4d48-983b-59265d8a9d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:44.225834 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb3d0c-2aac-4d48-983b-59265d8a9d08 admin admin] PATH_INFO: `/v3/users/ea500994fa224c75a276fac106248d14` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:44.227239 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abb3d0c-2aac-4d48-983b-59265d8a9d08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea500994fa224c75a276fac106248d14)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:44.229284 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abb3d0c-2aac-4d48-983b-59265d8a9d08 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:44.266262 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f526f0c-e7b1-4aa5-bed3-49ba83f3aa85 service cinder] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:44.275423 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f526f0c-e7b1-4aa5-bed3-49ba83f3aa85 service cinder] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:44.279546 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a604b-99a9-47c4-95e1-42ddd9a704d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:44.280215 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a604b-99a9-47c4-95e1-42ddd9a704d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:44.280688 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a604b-99a9-47c4-95e1-42ddd9a704d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:44.280986 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a604b-99a9-47c4-95e1-42ddd9a704d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:44.282918 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-533a604b-99a9-47c4-95e1-42ddd9a704d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:44.370759 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533a604b-99a9-47c4-95e1-42ddd9a704d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:44.372326 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533a604b-99a9-47c4-95e1-42ddd9a704d6 service cinder] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:44.386127 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1052/2102] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:44 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:51:44.534439 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-6abb3d0c-2aac-4d48-983b-59265d8a9d08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea500994fa224c75a276fac106248d14'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:44.535058 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-6abb3d0c-2aac-4d48-983b-59265d8a9d08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea500994fa224c75a276fac106248d14'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:44.548814 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-6abb3d0c-2aac-4d48-983b-59265d8a9d08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea500994fa224c75a276fac106248d14'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:44.672935 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-6abb3d0c-2aac-4d48-983b-59265d8a9d08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea500994fa224c75a276fac106248d14'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:44.683080 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-6abb3d0c-2aac-4d48-983b-59265d8a9d08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea500994fa224c75a276fac106248d14'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:44.697739 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1051/2103] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 16:51:44 2022] DELETE /identity/v3/users/ea500994fa224c75a276fac106248d14 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:44.702187 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4d9fd-8cfe-420e-aab3-5c30c14d29c2 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:44.702590 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4d9fd-8cfe-420e-aab3-5c30c14d29c2 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:44.702963 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4d9fd-8cfe-420e-aab3-5c30c14d29c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:44.740073 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-cfb4d9fd-8cfe-420e-aab3-5c30c14d29c2 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:44.741567 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-cfb4d9fd-8cfe-420e-aab3-5c30c14d29c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:44.817827 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1053/2104] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:51:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:51:44.828088 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb3d0c-2aac-4d48-983b-59265d8a9d08 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:44.829748 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-6abb3d0c-2aac-4d48-983b-59265d8a9d08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:44.904241 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb3d0c-2aac-4d48-983b-59265d8a9d08 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:44.908651 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38cea6a-3bc5-43a4-89b7-070404c3cd48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:44.911425 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38cea6a-3bc5-43a4-89b7-070404c3cd48 service neutron] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:44.911850 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38cea6a-3bc5-43a4-89b7-070404c3cd48 service neutron] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:44.912203 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38cea6a-3bc5-43a4-89b7-070404c3cd48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:44.924018 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38cea6a-3bc5-43a4-89b7-070404c3cd48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:44.925748 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38cea6a-3bc5-43a4-89b7-070404c3cd48 service neutron] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:44.940165 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1052/2105] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:51:45.518264 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb4d9fd-8cfe-420e-aab3-5c30c14d29c2 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:45.520644 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-cfb4d9fd-8cfe-420e-aab3-5c30c14d29c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:45.522359 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:45.545389 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb4d9fd-8cfe-420e-aab3-5c30c14d29c2 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:45.551117 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93afd447-4b19-4c78-a722-7b5227759361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:45.552368 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afd447-4b19-4c78-a722-7b5227759361 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:45.552646 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afd447-4b19-4c78-a722-7b5227759361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:45.553086 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afd447-4b19-4c78-a722-7b5227759361 admin admin] PATH_INFO: `/v3/projects/e98e3818c045448b9b642bfa825131e3` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:45.554527 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93afd447-4b19-4c78-a722-7b5227759361 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e98e3818c045448b9b642bfa825131e3)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:45.557054 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93afd447-4b19-4c78-a722-7b5227759361 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:45.776237 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-93afd447-4b19-4c78-a722-7b5227759361 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e98e3818c045448b9b642bfa825131e3', 'request_id': 'req-93afd447-4b19-4c78-a722-7b5227759361'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:45.786906 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-93afd447-4b19-4c78-a722-7b5227759361 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e98e3818c045448b9b642bfa825131e3', 'request_id': 'req-93afd447-4b19-4c78-a722-7b5227759361'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:45.796527 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-93afd447-4b19-4c78-a722-7b5227759361 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e98e3818c045448b9b642bfa825131e3', 'request_id': 'req-93afd447-4b19-4c78-a722-7b5227759361'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:45.904614 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-93afd447-4b19-4c78-a722-7b5227759361 admin admin] The token cache is being invalidate because project e98e3818c045448b9b642bfa825131e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:51:45.904907 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-93afd447-4b19-4c78-a722-7b5227759361 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:45.907815 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-93afd447-4b19-4c78-a722-7b5227759361 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:45.909333 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1054/2106] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 16:51:45 2022] DELETE /identity/v3/projects/e98e3818c045448b9b642bfa825131e3 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:45.914937 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa2213-ff6e-41df-a81f-c50c835c5060 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:45.915232 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa2213-ff6e-41df-a81f-c50c835c5060 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:45.915517 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa2213-ff6e-41df-a81f-c50c835c5060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:45.936300 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-8afa2213-ff6e-41df-a81f-c50c835c5060 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:45.937763 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-8afa2213-ff6e-41df-a81f-c50c835c5060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:46.046677 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:46.049548 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1053/2107] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:51:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:46.057818 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372c945-24f8-4ae4-920d-8b12b867e19a None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:46.058204 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372c945-24f8-4ae4-920d-8b12b867e19a None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:46.058532 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372c945-24f8-4ae4-920d-8b12b867e19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:46.093063 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-4372c945-24f8-4ae4-920d-8b12b867e19a None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:46.094351 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-4372c945-24f8-4ae4-920d-8b12b867e19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:46.112014 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1055/2108] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:51:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:46.115195 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa2213-ff6e-41df-a81f-c50c835c5060 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:46.126094 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa2213-ff6e-41df-a81f-c50c835c5060 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:46.133804 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc9219f-b2da-4f4b-94d8-a729d96cb2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:46.134569 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9219f-b2da-4f4b-94d8-a729d96cb2e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:46.134866 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9219f-b2da-4f4b-94d8-a729d96cb2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:46.135148 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9219f-b2da-4f4b-94d8-a729d96cb2e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:46.135915 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc9219f-b2da-4f4b-94d8-a729d96cb2e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:51:46.136353 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc9219f-b2da-4f4b-94d8-a729d96cb2e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:46.138277 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc9219f-b2da-4f4b-94d8-a729d96cb2e1 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:46.153209 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1054/2109] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Jul 18 16:51:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:51:46.157324 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4372c945-24f8-4ae4-920d-8b12b867e19a None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:46.168591 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4372c945-24f8-4ae4-920d-8b12b867e19a None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:46.173432 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2678bd-2022-4af7-9d37-776f4daa40c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:46.174097 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2678bd-2022-4af7-9d37-776f4daa40c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:46.174382 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2678bd-2022-4af7-9d37-776f4daa40c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:46.174682 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2678bd-2022-4af7-9d37-776f4daa40c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:46.175366 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2678bd-2022-4af7-9d37-776f4daa40c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:46.177809 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2678bd-2022-4af7-9d37-776f4daa40c9 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:46.345175 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1056/2110] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:51:46 2022] POST /identity/v3/projects => generated 383 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:46.350349 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc9219f-b2da-4f4b-94d8-a729d96cb2e1 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:46.362512 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc9219f-b2da-4f4b-94d8-a729d96cb2e1 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:46.446055 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e1a705-e9cf-4be6-87db-7e0857f4464a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:46.446467 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1a705-e9cf-4be6-87db-7e0857f4464a admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:46.446760 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1a705-e9cf-4be6-87db-7e0857f4464a admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:46.447218 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1a705-e9cf-4be6-87db-7e0857f4464a admin admin] PATH_INFO: `/v3/users` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:46.447972 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e1a705-e9cf-4be6-87db-7e0857f4464a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:46.450683 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e1a705-e9cf-4be6-87db-7e0857f4464a admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:46.597423 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1055/2111] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 16:51:46 2022] POST /identity/v3/users => generated 292 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:46.601177 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2678bd-2022-4af7-9d37-776f4daa40c9 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:46.613082 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2678bd-2022-4af7-9d37-776f4daa40c9 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:46.618627 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a813f6f3-bb9a-4faf-b394-d65f7828db67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:46.619437 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813f6f3-bb9a-4faf-b394-d65f7828db67 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:46.619742 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813f6f3-bb9a-4faf-b394-d65f7828db67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:46.620042 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813f6f3-bb9a-4faf-b394-d65f7828db67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:46.621424 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a813f6f3-bb9a-4faf-b394-d65f7828db67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:46.623048 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a813f6f3-bb9a-4faf-b394-d65f7828db67 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:46.636158 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1057/2112] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 16:51:46.639975 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e1a705-e9cf-4be6-87db-7e0857f4464a admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:46.660683 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e1a705-e9cf-4be6-87db-7e0857f4464a admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:46.666858 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf891406-8a55-4658-a94e-dad8b027e049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:46.667618 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf891406-8a55-4658-a94e-dad8b027e049 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:46.667946 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf891406-8a55-4658-a94e-dad8b027e049 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:46.668276 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf891406-8a55-4658-a94e-dad8b027e049 admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:46.669032 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf891406-8a55-4658-a94e-dad8b027e049 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:46.670802 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf891406-8a55-4658-a94e-dad8b027e049 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:46.683136 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1056/2113] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:46 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 16:51:46.689715 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a813f6f3-bb9a-4faf-b394-d65f7828db67 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:46.703836 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a813f6f3-bb9a-4faf-b394-d65f7828db67 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:46.714771 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a880e2-89e3-4ab6-84e1-b20db975af0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:46.717644 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a880e2-89e3-4ab6-84e1-b20db975af0f admin admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:46.717644 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a880e2-89e3-4ab6-84e1-b20db975af0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:46.717644 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a880e2-89e3-4ab6-84e1-b20db975af0f admin admin] PATH_INFO: `/v3/projects/c48ce39984204831b9700b47f3007e5f/users/3c27d7efec574a06bf2cf5df1ba1b857/roles/ad3a2bc7b2094a4da1a95a143c8d9436` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:46.734843 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a880e2-89e3-4ab6-84e1-b20db975af0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c48ce39984204831b9700b47f3007e5f, user_id=3c27d7efec574a06bf2cf5df1ba1b857, role_id=ad3a2bc7b2094a4da1a95a143c8d9436)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:46.737705 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a880e2-89e3-4ab6-84e1-b20db975af0f admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:46.886527 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1058/2114] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:51:46 2022] PUT /identity/v3/projects/c48ce39984204831b9700b47f3007e5f/users/3c27d7efec574a06bf2cf5df1ba1b857/roles/ad3a2bc7b2094a4da1a95a143c8d9436 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:46.900155 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91c953-33d6-4155-b41d-a161d9977b91 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:46.900468 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91c953-33d6-4155-b41d-a161d9977b91 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:46.901452 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91c953-33d6-4155-b41d-a161d9977b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:46.937139 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-3d91c953-33d6-4155-b41d-a161d9977b91 None None] MFA Rules not processed for user `3c27d7efec574a06bf2cf5df1ba1b857`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:46.938382 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-3d91c953-33d6-4155-b41d-a161d9977b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:47.077683 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1057/2115] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:51:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:47.092638 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a880e2-89e3-4ab6-84e1-b20db975af0f admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:47.095332 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-26a880e2-89e3-4ab6-84e1-b20db975af0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:47.178450 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a880e2-89e3-4ab6-84e1-b20db975af0f admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:47.187482 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d172380-e425-448a-bb43-81de7a4c50d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:47.187482 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d172380-e425-448a-bb43-81de7a4c50d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:47.187482 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d172380-e425-448a-bb43-81de7a4c50d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:47.187482 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d172380-e425-448a-bb43-81de7a4c50d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:47.195472 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d172380-e425-448a-bb43-81de7a4c50d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:47.197364 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d172380-e425-448a-bb43-81de7a4c50d1 service cinder] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:47.208643 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1059/2116] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 16:51:48.002681 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:48.183888 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:49.431422 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc198a-03a2-4b21-ac00-fcd8be4ac4fb None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:49.432101 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc198a-03a2-4b21-ac00-fcd8be4ac4fb None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:49.432101 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc198a-03a2-4b21-ac00-fcd8be4ac4fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:49.469754 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-adcc198a-03a2-4b21-ac00-fcd8be4ac4fb None None] MFA Rules not processed for user `ee0824c301ef4dfd89cbf51e9c36a913`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:49.478773 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-adcc198a-03a2-4b21-ac00-fcd8be4ac4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:49.555755 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1058/2117] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:51:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:50.275347 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:50.585042 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d172380-e425-448a-bb43-81de7a4c50d1 service cinder] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:50.586649 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-6d172380-e425-448a-bb43-81de7a4c50d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:50.663837 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d172380-e425-448a-bb43-81de7a4c50d1 service cinder] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:50.669847 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7010ab2-5726-4ae0-b407-e2e11fa129ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:50.671052 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7010ab2-5726-4ae0-b407-e2e11fa129ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:50.671407 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7010ab2-5726-4ae0-b407-e2e11fa129ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:50.671790 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7010ab2-5726-4ae0-b407-e2e11fa129ef admin admin] PATH_INFO: `/v3/users/aeeb10be2d3a406f810e440e9a743ead` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:50.673125 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7010ab2-5726-4ae0-b407-e2e11fa129ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=aeeb10be2d3a406f810e440e9a743ead)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:50.675157 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7010ab2-5726-4ae0-b407-e2e11fa129ef admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:50.933613 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-e7010ab2-5726-4ae0-b407-e2e11fa129ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aeeb10be2d3a406f810e440e9a743ead'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:50.945705 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-e7010ab2-5726-4ae0-b407-e2e11fa129ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aeeb10be2d3a406f810e440e9a743ead'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:50.946923 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-e7010ab2-5726-4ae0-b407-e2e11fa129ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aeeb10be2d3a406f810e440e9a743ead'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:50.954838 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-e7010ab2-5726-4ae0-b407-e2e11fa129ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aeeb10be2d3a406f810e440e9a743ead'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:51.089488 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-e7010ab2-5726-4ae0-b407-e2e11fa129ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aeeb10be2d3a406f810e440e9a743ead'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:51.096176 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1060/2118] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 16:51:50 2022] DELETE /identity/v3/users/aeeb10be2d3a406f810e440e9a743ead => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:51.100704 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9cb838-8557-46c3-845a-c8cc1f1195e1 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:51.101275 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9cb838-8557-46c3-845a-c8cc1f1195e1 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:51.101275 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9cb838-8557-46c3-845a-c8cc1f1195e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:51.119375 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-9f9cb838-8557-46c3-845a-c8cc1f1195e1 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:51.120651 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-9f9cb838-8557-46c3-845a-c8cc1f1195e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:51.183382 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1059/2119] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:51:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:51.192994 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7010ab2-5726-4ae0-b407-e2e11fa129ef admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:51.194455 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-e7010ab2-5726-4ae0-b407-e2e11fa129ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:51.256295 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7010ab2-5726-4ae0-b407-e2e11fa129ef admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:51.260032 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c653b8-ffb8-4655-ad46-f98d82ed5cf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:51.260693 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c653b8-ffb8-4655-ad46-f98d82ed5cf7 service neutron] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:51.261002 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c653b8-ffb8-4655-ad46-f98d82ed5cf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:51.261291 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c653b8-ffb8-4655-ad46-f98d82ed5cf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:51.272232 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c653b8-ffb8-4655-ad46-f98d82ed5cf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:51.273657 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c653b8-ffb8-4655-ad46-f98d82ed5cf7 service neutron] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:51.283821 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1061/2120] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:51:51.558010 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:52.129550 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9cb838-8557-46c3-845a-c8cc1f1195e1 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:52.129550 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-9f9cb838-8557-46c3-845a-c8cc1f1195e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:52.141718 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9cb838-8557-46c3-845a-c8cc1f1195e1 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:52.146695 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f013903-2b5d-45f1-9c58-b7337093743c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:52.152248 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f013903-2b5d-45f1-9c58-b7337093743c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:52.153442 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c653b8-ffb8-4655-ad46-f98d82ed5cf7 service neutron] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:52.154887 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-43c653b8-ffb8-4655-ad46-f98d82ed5cf7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:52.158893 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f013903-2b5d-45f1-9c58-b7337093743c admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:52.160520 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f013903-2b5d-45f1-9c58-b7337093743c admin admin] PATH_INFO: `/v3/users/46efb659a6f0489d9c13664b62e95885` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:52.169175 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f013903-2b5d-45f1-9c58-b7337093743c admin admin] RBAC: Authorizing `identity:delete_user(user_id=46efb659a6f0489d9c13664b62e95885)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:52.171165 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f013903-2b5d-45f1-9c58-b7337093743c admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:52.181687 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c653b8-ffb8-4655-ad46-f98d82ed5cf7 service neutron] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:52.191015 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a9963-c8a8-4fd9-8680-c2319524164b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:52.192297 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a9963-c8a8-4fd9-8680-c2319524164b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:52.192582 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a9963-c8a8-4fd9-8680-c2319524164b admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:52.192862 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a9963-c8a8-4fd9-8680-c2319524164b admin admin] PATH_INFO: `/v3/projects/a7f0bd39460f4995b07f85c0eac71006` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:52.194307 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7a9963-c8a8-4fd9-8680-c2319524164b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7f0bd39460f4995b07f85c0eac71006)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:52.196844 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7a9963-c8a8-4fd9-8680-c2319524164b admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:52.377969 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-3f013903-2b5d-45f1-9c58-b7337093743c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46efb659a6f0489d9c13664b62e95885'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:52.378419 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-ed7a9963-c8a8-4fd9-8680-c2319524164b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7f0bd39460f4995b07f85c0eac71006', 'request_id': 'req-ed7a9963-c8a8-4fd9-8680-c2319524164b'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:52.379013 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-3f013903-2b5d-45f1-9c58-b7337093743c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46efb659a6f0489d9c13664b62e95885'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:52.384427 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-ed7a9963-c8a8-4fd9-8680-c2319524164b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7f0bd39460f4995b07f85c0eac71006', 'request_id': 'req-ed7a9963-c8a8-4fd9-8680-c2319524164b'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:52.390873 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-ed7a9963-c8a8-4fd9-8680-c2319524164b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7f0bd39460f4995b07f85c0eac71006', 'request_id': 'req-ed7a9963-c8a8-4fd9-8680-c2319524164b'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:52.391137 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-3f013903-2b5d-45f1-9c58-b7337093743c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46efb659a6f0489d9c13664b62e95885'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:52.503586 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-ed7a9963-c8a8-4fd9-8680-c2319524164b admin admin] The token cache is being invalidate because project a7f0bd39460f4995b07f85c0eac71006 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:51:52.503939 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-ed7a9963-c8a8-4fd9-8680-c2319524164b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:52.504586 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-ed7a9963-c8a8-4fd9-8680-c2319524164b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:52.506155 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1062/2121] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 16:51:52 2022] DELETE /identity/v3/projects/a7f0bd39460f4995b07f85c0eac71006 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:51:52.510777 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a9963-c8a8-4fd9-8680-c2319524164b admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:52.512232 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-ed7a9963-c8a8-4fd9-8680-c2319524164b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:52.587692 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a9963-c8a8-4fd9-8680-c2319524164b admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:52.592344 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb67b17-4e02-43cc-84ab-7af46cde626e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:52.593214 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb67b17-4e02-43cc-84ab-7af46cde626e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:52.593499 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb67b17-4e02-43cc-84ab-7af46cde626e admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:52.593776 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb67b17-4e02-43cc-84ab-7af46cde626e admin admin] PATH_INFO: `/v3/users/0ac14d44174b46e9999e34a749307742` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:52.595053 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb67b17-4e02-43cc-84ab-7af46cde626e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ac14d44174b46e9999e34a749307742)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:52.597041 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb67b17-4e02-43cc-84ab-7af46cde626e admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:52.646229 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-3f013903-2b5d-45f1-9c58-b7337093743c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46efb659a6f0489d9c13664b62e95885'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:52.654084 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-3f013903-2b5d-45f1-9c58-b7337093743c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46efb659a6f0489d9c13664b62e95885'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:52.660611 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1060/2122] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 16:51:52 2022] DELETE /identity/v3/users/46efb659a6f0489d9c13664b62e95885 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:52.661705 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f013903-2b5d-45f1-9c58-b7337093743c admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:52.664523 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-3f013903-2b5d-45f1-9c58-b7337093743c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:52.731926 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f013903-2b5d-45f1-9c58-b7337093743c admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:52.736566 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e73c298-85d5-4402-a46b-0ae56ef11d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:52.737436 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73c298-85d5-4402-a46b-0ae56ef11d79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:52.737717 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73c298-85d5-4402-a46b-0ae56ef11d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:52.737992 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73c298-85d5-4402-a46b-0ae56ef11d79 admin admin] PATH_INFO: `/v3/users/3c27d7efec574a06bf2cf5df1ba1b857` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:52.739282 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e73c298-85d5-4402-a46b-0ae56ef11d79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c27d7efec574a06bf2cf5df1ba1b857)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:52.741234 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e73c298-85d5-4402-a46b-0ae56ef11d79 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:53.245427 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-dcb67b17-4e02-43cc-84ab-7af46cde626e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ac14d44174b46e9999e34a749307742'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:53.257247 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-dcb67b17-4e02-43cc-84ab-7af46cde626e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ac14d44174b46e9999e34a749307742'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:53.258077 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-dcb67b17-4e02-43cc-84ab-7af46cde626e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ac14d44174b46e9999e34a749307742'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:53.265148 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-dcb67b17-4e02-43cc-84ab-7af46cde626e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ac14d44174b46e9999e34a749307742'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:53.582723 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-0e73c298-85d5-4402-a46b-0ae56ef11d79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c27d7efec574a06bf2cf5df1ba1b857'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:53.583440 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-0e73c298-85d5-4402-a46b-0ae56ef11d79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c27d7efec574a06bf2cf5df1ba1b857'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:53.596130 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-0e73c298-85d5-4402-a46b-0ae56ef11d79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c27d7efec574a06bf2cf5df1ba1b857'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:53.646725 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-dcb67b17-4e02-43cc-84ab-7af46cde626e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ac14d44174b46e9999e34a749307742'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:53.654016 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1063/2123] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 16:51:52 2022] DELETE /identity/v3/users/0ac14d44174b46e9999e34a749307742 => generated 0 bytes in 1144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:51:53.657626 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411efdee-98c1-481c-987e-f5c425fdc5f3 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:53.657626 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411efdee-98c1-481c-987e-f5c425fdc5f3 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:53.657626 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411efdee-98c1-481c-987e-f5c425fdc5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:53.674065 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-411efdee-98c1-481c-987e-f5c425fdc5f3 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:53.675301 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-411efdee-98c1-481c-987e-f5c425fdc5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:53.740280 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1064/2124] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:51:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:53.750581 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411efdee-98c1-481c-987e-f5c425fdc5f3 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:53.752893 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-411efdee-98c1-481c-987e-f5c425fdc5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:53.776486 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-0e73c298-85d5-4402-a46b-0ae56ef11d79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c27d7efec574a06bf2cf5df1ba1b857'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:53.796212 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-0e73c298-85d5-4402-a46b-0ae56ef11d79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c27d7efec574a06bf2cf5df1ba1b857'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:53.814553 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1061/2125] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 16:51:52 2022] DELETE /identity/v3/users/3c27d7efec574a06bf2cf5df1ba1b857 => generated 0 bytes in 1151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:53.816504 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411efdee-98c1-481c-987e-f5c425fdc5f3 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:53.816715 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0ca6c-893d-4aaf-8a4b-0028ceeadf57 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:53.817348 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0ca6c-893d-4aaf-8a4b-0028ceeadf57 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:53.817987 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0ca6c-893d-4aaf-8a4b-0028ceeadf57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:53.840611 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-57b0ca6c-893d-4aaf-8a4b-0028ceeadf57 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:53.847086 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-57b0ca6c-893d-4aaf-8a4b-0028ceeadf57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:53.869888 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f577b451-fd9c-44b7-8569-27e778eacdd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:53.870597 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f577b451-fd9c-44b7-8569-27e778eacdd3 service neutron] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:53.870887 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f577b451-fd9c-44b7-8569-27e778eacdd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:53.871167 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f577b451-fd9c-44b7-8569-27e778eacdd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:53.872985 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-f577b451-fd9c-44b7-8569-27e778eacdd3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:53.913735 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1062/2126] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:51:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:51:53.923493 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b0ca6c-893d-4aaf-8a4b-0028ceeadf57 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:53.924979 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-57b0ca6c-893d-4aaf-8a4b-0028ceeadf57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:53.938700 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b0ca6c-893d-4aaf-8a4b-0028ceeadf57 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:53.948098 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e6dbe-0082-46ff-96b4-fa643782bef0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:53.948818 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e6dbe-0082-46ff-96b4-fa643782bef0 service neutron] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:53.949105 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e6dbe-0082-46ff-96b4-fa643782bef0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:53.949518 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e6dbe-0082-46ff-96b4-fa643782bef0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:53.951586 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f577b451-fd9c-44b7-8569-27e778eacdd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:53.953096 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f577b451-fd9c-44b7-8569-27e778eacdd3 service neutron] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:53.964344 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380e6dbe-0082-46ff-96b4-fa643782bef0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:53.964344 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380e6dbe-0082-46ff-96b4-fa643782bef0 service neutron] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:53.964853 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1065/2127] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:51:53.974994 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1063/2128] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 16:51:53.987193 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:54.387490 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f577b451-fd9c-44b7-8569-27e778eacdd3 service neutron] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:54.388977 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-f577b451-fd9c-44b7-8569-27e778eacdd3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:54.402143 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f577b451-fd9c-44b7-8569-27e778eacdd3 service neutron] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:54.407001 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c35463e-e9ff-4863-95ff-976e4501a01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:54.408173 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c35463e-e9ff-4863-95ff-976e4501a01f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:54.408581 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c35463e-e9ff-4863-95ff-976e4501a01f admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:54.408741 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c35463e-e9ff-4863-95ff-976e4501a01f admin admin] PATH_INFO: `/v3/projects/4d6418a3d4594759892873a82c17deec` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:54.410099 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c35463e-e9ff-4863-95ff-976e4501a01f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d6418a3d4594759892873a82c17deec)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:54.412062 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c35463e-e9ff-4863-95ff-976e4501a01f admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:54.591896 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-1c35463e-e9ff-4863-95ff-976e4501a01f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d6418a3d4594759892873a82c17deec', 'request_id': 'req-1c35463e-e9ff-4863-95ff-976e4501a01f'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:54.593216 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-1c35463e-e9ff-4863-95ff-976e4501a01f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d6418a3d4594759892873a82c17deec', 'request_id': 'req-1c35463e-e9ff-4863-95ff-976e4501a01f'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:54.599848 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-1c35463e-e9ff-4863-95ff-976e4501a01f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d6418a3d4594759892873a82c17deec', 'request_id': 'req-1c35463e-e9ff-4863-95ff-976e4501a01f'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:54.700203 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e6dbe-0082-46ff-96b4-fa643782bef0 service neutron] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:54.701736 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-380e6dbe-0082-46ff-96b4-fa643782bef0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:54.714477 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e6dbe-0082-46ff-96b4-fa643782bef0 service neutron] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:54.753195 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-1c35463e-e9ff-4863-95ff-976e4501a01f admin admin] The token cache is being invalidate because project 4d6418a3d4594759892873a82c17deec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:51:54.753683 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-1c35463e-e9ff-4863-95ff-976e4501a01f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:54.755106 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-1c35463e-e9ff-4863-95ff-976e4501a01f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:54.759219 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1066/2129] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 16:51:54 2022] DELETE /identity/v3/projects/4d6418a3d4594759892873a82c17deec => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:51:54.762426 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c35463e-e9ff-4863-95ff-976e4501a01f admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:54.763832 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-1c35463e-e9ff-4863-95ff-976e4501a01f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:54.795008 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2720d9-cb56-47e8-bcb1-7c1b8bcc490e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:54.796276 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2720d9-cb56-47e8-bcb1-7c1b8bcc490e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:54.796959 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2720d9-cb56-47e8-bcb1-7c1b8bcc490e admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:54.797940 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2720d9-cb56-47e8-bcb1-7c1b8bcc490e admin admin] PATH_INFO: `/v3/projects/e5dca19b5f2446ae82f931c86c4c1175` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:54.799675 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2720d9-cb56-47e8-bcb1-7c1b8bcc490e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5dca19b5f2446ae82f931c86c4c1175)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:54.802018 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2720d9-cb56-47e8-bcb1-7c1b8bcc490e admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:54.843393 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c35463e-e9ff-4863-95ff-976e4501a01f admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:54.848905 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4da157-1cf7-4c93-bd72-980ed76e4996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:54.849789 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4da157-1cf7-4c93-bd72-980ed76e4996 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:54.850066 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4da157-1cf7-4c93-bd72-980ed76e4996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:54.850487 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4da157-1cf7-4c93-bd72-980ed76e4996 admin admin] PATH_INFO: `/v3/projects/c48ce39984204831b9700b47f3007e5f` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:54.852172 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4da157-1cf7-4c93-bd72-980ed76e4996 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c48ce39984204831b9700b47f3007e5f)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:54.854273 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4da157-1cf7-4c93-bd72-980ed76e4996 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:55.139395 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-1a2720d9-cb56-47e8-bcb1-7c1b8bcc490e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5dca19b5f2446ae82f931c86c4c1175', 'request_id': 'req-1a2720d9-cb56-47e8-bcb1-7c1b8bcc490e'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:55.140621 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-dd4da157-1cf7-4c93-bd72-980ed76e4996 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c48ce39984204831b9700b47f3007e5f', 'request_id': 'req-dd4da157-1cf7-4c93-bd72-980ed76e4996'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:55.149323 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-dd4da157-1cf7-4c93-bd72-980ed76e4996 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c48ce39984204831b9700b47f3007e5f', 'request_id': 'req-dd4da157-1cf7-4c93-bd72-980ed76e4996'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:55.157788 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-dd4da157-1cf7-4c93-bd72-980ed76e4996 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c48ce39984204831b9700b47f3007e5f', 'request_id': 'req-dd4da157-1cf7-4c93-bd72-980ed76e4996'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:55.257692 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-1a2720d9-cb56-47e8-bcb1-7c1b8bcc490e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5dca19b5f2446ae82f931c86c4c1175', 'request_id': 'req-1a2720d9-cb56-47e8-bcb1-7c1b8bcc490e'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:55.265124 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-1a2720d9-cb56-47e8-bcb1-7c1b8bcc490e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5dca19b5f2446ae82f931c86c4c1175', 'request_id': 'req-1a2720d9-cb56-47e8-bcb1-7c1b8bcc490e'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:55.277378 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-1a2720d9-cb56-47e8-bcb1-7c1b8bcc490e admin admin] The token cache is being invalidate because project e5dca19b5f2446ae82f931c86c4c1175 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:51:55.277671 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-1a2720d9-cb56-47e8-bcb1-7c1b8bcc490e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:55.278327 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-1a2720d9-cb56-47e8-bcb1-7c1b8bcc490e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:55.280068 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1064/2130] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 16:51:54 2022] DELETE /identity/v3/projects/e5dca19b5f2446ae82f931c86c4c1175 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:51:55.283576 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2720d9-cb56-47e8-bcb1-7c1b8bcc490e admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:55.284566 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-1a2720d9-cb56-47e8-bcb1-7c1b8bcc490e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:55.363803 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2720d9-cb56-47e8-bcb1-7c1b8bcc490e admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:55.390553 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-dd4da157-1cf7-4c93-bd72-980ed76e4996 admin admin] The token cache is being invalidate because project c48ce39984204831b9700b47f3007e5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:51:55.394276 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-dd4da157-1cf7-4c93-bd72-980ed76e4996 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:55.394276 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-dd4da157-1cf7-4c93-bd72-980ed76e4996 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:55.394276 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1067/2131] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 16:51:54 2022] DELETE /identity/v3/projects/c48ce39984204831b9700b47f3007e5f => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:55.395217 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e441d-88a8-406a-98d5-d079a35f56e1 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:55.395508 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e441d-88a8-406a-98d5-d079a35f56e1 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:55.395810 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e441d-88a8-406a-98d5-d079a35f56e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:55.414821 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-fe9e441d-88a8-406a-98d5-d079a35f56e1 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:55.416347 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-fe9e441d-88a8-406a-98d5-d079a35f56e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:55.428735 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f1f4d-60fb-4877-b5bd-c60b01d4a3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:55.429624 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f1f4d-60fb-4877-b5bd-c60b01d4a3cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:55.430430 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f1f4d-60fb-4877-b5bd-c60b01d4a3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:55.430712 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f1f4d-60fb-4877-b5bd-c60b01d4a3cf admin admin] PATH_INFO: `/v3/users/9ccc10081cea4852993aa27d6232f1c3` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:55.431982 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484f1f4d-60fb-4877-b5bd-c60b01d4a3cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ccc10081cea4852993aa27d6232f1c3)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:55.434196 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484f1f4d-60fb-4877-b5bd-c60b01d4a3cf admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:55.485023 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1068/2132] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:51:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:55.486580 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e85bb7-56cc-4dfe-909c-20f226b22efe None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:55.486943 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e85bb7-56cc-4dfe-909c-20f226b22efe None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:55.487307 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e85bb7-56cc-4dfe-909c-20f226b22efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:55.510361 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-88e85bb7-56cc-4dfe-909c-20f226b22efe None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:55.511559 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-88e85bb7-56cc-4dfe-909c-20f226b22efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:55.520250 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1069/2133] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:51:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:55.520934 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab8c0a0-6e6a-4efe-b733-e2c5092c5e08 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:55.521215 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab8c0a0-6e6a-4efe-b733-e2c5092c5e08 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:55.521487 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab8c0a0-6e6a-4efe-b733-e2c5092c5e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:55.541108 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-1ab8c0a0-6e6a-4efe-b733-e2c5092c5e08 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:55.542157 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-1ab8c0a0-6e6a-4efe-b733-e2c5092c5e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:55.547173 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:55.550517 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1070/2134] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:51:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:55.551672 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cbf226-e430-474a-846a-c8bf25d0f783 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:55.552200 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cbf226-e430-474a-846a-c8bf25d0f783 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:55.552309 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cbf226-e430-474a-846a-c8bf25d0f783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:55.571682 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-a0cbf226-e430-474a-846a-c8bf25d0f783 None None] MFA Rules not processed for user `ea2a096c4b964f03aed533d1e5e96db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:55.573317 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-a0cbf226-e430-474a-846a-c8bf25d0f783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:55.646978 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1071/2135] 10.222.0.81 () {58 vars in 1009 bytes} [Mon Jul 18 16:51:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:55.650867 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c8f6b1-576d-4705-b38e-69cba2bd5b46 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:55.650867 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c8f6b1-576d-4705-b38e-69cba2bd5b46 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:55.650867 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c8f6b1-576d-4705-b38e-69cba2bd5b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:55.671405 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-95c8f6b1-576d-4705-b38e-69cba2bd5b46 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:55.672713 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-95c8f6b1-576d-4705-b38e-69cba2bd5b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:55.681168 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1072/2136] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:51:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:55.684772 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c8f6b1-576d-4705-b38e-69cba2bd5b46 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:55.694567 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c8f6b1-576d-4705-b38e-69cba2bd5b46 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:55.699493 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11a9b38-c81a-4011-bd31-f05ef306bf9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:55.700252 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a9b38-c81a-4011-bd31-f05ef306bf9d admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:55.700535 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a9b38-c81a-4011-bd31-f05ef306bf9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:55.700811 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a9b38-c81a-4011-bd31-f05ef306bf9d admin admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:55.701550 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11a9b38-c81a-4011-bd31-f05ef306bf9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:51:55.701860 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11a9b38-c81a-4011-bd31-f05ef306bf9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:55.703445 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11a9b38-c81a-4011-bd31-f05ef306bf9d admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:55.715568 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1073/2137] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Jul 18 16:51:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:51:55.716384 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11a9b38-c81a-4011-bd31-f05ef306bf9d admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:55.718947 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-f11a9b38-c81a-4011-bd31-f05ef306bf9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:55.738180 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-484f1f4d-60fb-4877-b5bd-c60b01d4a3cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ccc10081cea4852993aa27d6232f1c3'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:55.739370 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-484f1f4d-60fb-4877-b5bd-c60b01d4a3cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ccc10081cea4852993aa27d6232f1c3'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:55.756787 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-484f1f4d-60fb-4877-b5bd-c60b01d4a3cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ccc10081cea4852993aa27d6232f1c3'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:55.806116 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11a9b38-c81a-4011-bd31-f05ef306bf9d admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:55.814817 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaadfc20-fc2a-453c-bcb9-3b90f082939f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251475c53ac64cd48ae84567d8c2ee87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:55.815520 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaadfc20-fc2a-453c-bcb9-3b90f082939f service swift] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:55.816315 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaadfc20-fc2a-453c-bcb9-3b90f082939f service swift] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:55.816570 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaadfc20-fc2a-453c-bcb9-3b90f082939f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:55.824161 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-484f1f4d-60fb-4877-b5bd-c60b01d4a3cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ccc10081cea4852993aa27d6232f1c3'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:55.826767 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaadfc20-fc2a-453c-bcb9-3b90f082939f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:55.829528 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaadfc20-fc2a-453c-bcb9-3b90f082939f service swift] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:55.832937 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-484f1f4d-60fb-4877-b5bd-c60b01d4a3cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ccc10081cea4852993aa27d6232f1c3'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:55.842012 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1074/2138] 10.222.0.81 () {60 vars in 1384 bytes} [Mon Jul 18 16:51:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 16:51:55.851644 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaadfc20-fc2a-453c-bcb9-3b90f082939f service swift] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:55.866139 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1065/2139] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 16:51:55 2022] DELETE /identity/v3/users/9ccc10081cea4852993aa27d6232f1c3 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:55.867380 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f1f4d-60fb-4877-b5bd-c60b01d4a3cf admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:55.870833 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaadfc20-fc2a-453c-bcb9-3b90f082939f service swift] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:55.871564 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-484f1f4d-60fb-4877-b5bd-c60b01d4a3cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:55.947791 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fc398e-f69d-45ea-9d30-bec21cf2450f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:55.948669 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc398e-f69d-45ea-9d30-bec21cf2450f admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:55.949050 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc398e-f69d-45ea-9d30-bec21cf2450f admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:55.949723 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc398e-f69d-45ea-9d30-bec21cf2450f admin admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:55.950777 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fc398e-f69d-45ea-9d30-bec21cf2450f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:51:55.951343 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fc398e-f69d-45ea-9d30-bec21cf2450f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:55.953170 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fc398e-f69d-45ea-9d30-bec21cf2450f admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:55.980275 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f1f4d-60fb-4877-b5bd-c60b01d4a3cf admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:55.985514 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1075/2140] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Jul 18 16:51:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:51:55.986689 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fc398e-f69d-45ea-9d30-bec21cf2450f admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:55.988161 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649e17e0-fc56-402d-b727-b65093fc8ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:55.989779 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e17e0-fc56-402d-b727-b65093fc8ddf admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:55.990251 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e17e0-fc56-402d-b727-b65093fc8ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:55.990788 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e17e0-fc56-402d-b727-b65093fc8ddf admin admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:55.991638 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649e17e0-fc56-402d-b727-b65093fc8ddf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:55.994057 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-25fc398e-f69d-45ea-9d30-bec21cf2450f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:55.996176 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649e17e0-fc56-402d-b727-b65093fc8ddf admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:56.037500 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fc398e-f69d-45ea-9d30-bec21cf2450f admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:56.049977 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de5954-0375-4d42-93e7-0e283546d743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:56.052364 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de5954-0375-4d42-93e7-0e283546d743 admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:56.054035 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de5954-0375-4d42-93e7-0e283546d743 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:56.054319 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de5954-0375-4d42-93e7-0e283546d743 admin admin] PATH_INFO: `/v3/projects` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:56.055597 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93de5954-0375-4d42-93e7-0e283546d743 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:56.062159 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93de5954-0375-4d42-93e7-0e283546d743 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:56.128002 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1066/2141] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:51:55 2022] POST /identity/v3/projects => generated 387 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:56.132272 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649e17e0-fc56-402d-b727-b65093fc8ddf admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:56.226255 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1076/2142] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:51:55 2022] POST /identity/v3/projects => generated 373 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:56.227963 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de5954-0375-4d42-93e7-0e283546d743 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:56.301493 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649e17e0-fc56-402d-b727-b65093fc8ddf admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:56.388683 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf47cf7a-4cf8-44ef-ba66-b66737346e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:56.395943 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf47cf7a-4cf8-44ef-ba66-b66737346e81 admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:56.401114 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de5954-0375-4d42-93e7-0e283546d743 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:56.408082 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf47cf7a-4cf8-44ef-ba66-b66737346e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:56.408524 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf47cf7a-4cf8-44ef-ba66-b66737346e81 admin admin] PATH_INFO: `/v3/users` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:56.409594 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf47cf7a-4cf8-44ef-ba66-b66737346e81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:56.412361 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf47cf7a-4cf8-44ef-ba66-b66737346e81 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:56.450398 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13378c99-ba22-4df2-baed-184816b8641a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:56.451209 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13378c99-ba22-4df2-baed-184816b8641a admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:56.451496 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13378c99-ba22-4df2-baed-184816b8641a admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:56.451807 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13378c99-ba22-4df2-baed-184816b8641a admin admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:56.452707 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13378c99-ba22-4df2-baed-184816b8641a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:56.456526 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13378c99-ba22-4df2-baed-184816b8641a admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:56.558034 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1067/2143] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 16:51:56 2022] POST /identity/v3/users => generated 294 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:56.559872 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf47cf7a-4cf8-44ef-ba66-b66737346e81 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:56.580054 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf47cf7a-4cf8-44ef-ba66-b66737346e81 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:56.585398 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e24ef-5957-4379-b304-711f867f27d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:56.586244 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e24ef-5957-4379-b304-711f867f27d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:56.586581 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e24ef-5957-4379-b304-711f867f27d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:56.607928 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e24ef-5957-4379-b304-711f867f27d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:56.607928 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e24ef-5957-4379-b304-711f867f27d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:56.607928 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e24ef-5957-4379-b304-711f867f27d5 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:56.607928 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1068/2144] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:56 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 16:51:56.608271 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1077/2145] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 16:51:56 2022] POST /identity/v3/users => generated 287 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:56.610975 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e24ef-5957-4379-b304-711f867f27d5 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:56.615430 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13378c99-ba22-4df2-baed-184816b8641a admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:56.638730 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13378c99-ba22-4df2-baed-184816b8641a admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:56.646625 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a41b90-ac03-4db2-98fa-f67d0b61c004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:56.646625 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a41b90-ac03-4db2-98fa-f67d0b61c004 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:56.646625 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a41b90-ac03-4db2-98fa-f67d0b61c004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:56.646625 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a41b90-ac03-4db2-98fa-f67d0b61c004 admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:56.647582 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a41b90-ac03-4db2-98fa-f67d0b61c004 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:56.649890 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a41b90-ac03-4db2-98fa-f67d0b61c004 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:56.663159 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1078/2146] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:56 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:56.668853 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a41b90-ac03-4db2-98fa-f67d0b61c004 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:56.669081 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e24ef-5957-4379-b304-711f867f27d5 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:56.678402 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68be371e-6363-4c75-b821-564ef3636e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:56.679094 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be371e-6363-4c75-b821-564ef3636e5b admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:56.679377 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be371e-6363-4c75-b821-564ef3636e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:56.681165 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be371e-6363-4c75-b821-564ef3636e5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:56.693948 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68be371e-6363-4c75-b821-564ef3636e5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:56.696780 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68be371e-6363-4c75-b821-564ef3636e5b admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:56.696946 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a41b90-ac03-4db2-98fa-f67d0b61c004 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:56.709475 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc66d60f-762b-497e-8fbb-43458e4e2b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:56.710660 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc66d60f-762b-497e-8fbb-43458e4e2b25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:56.711072 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc66d60f-762b-497e-8fbb-43458e4e2b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:56.711630 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc66d60f-762b-497e-8fbb-43458e4e2b25 admin admin] PATH_INFO: `/v3/projects/9f8fd6801be64dc3813e004eac9ab19d/users/1a5ecb009c904013b663909e7003face/roles/ad3a2bc7b2094a4da1a95a143c8d9436` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:56.727893 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1069/2147] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:56 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:56.732374 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68be371e-6363-4c75-b821-564ef3636e5b admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:56.757730 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68be371e-6363-4c75-b821-564ef3636e5b admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:56.766871 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e749a-ee3e-412b-8e66-9e56c47dc201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:56.771195 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e749a-ee3e-412b-8e66-9e56c47dc201 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:56.771487 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e749a-ee3e-412b-8e66-9e56c47dc201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:56.772253 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc66d60f-762b-497e-8fbb-43458e4e2b25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f8fd6801be64dc3813e004eac9ab19d, user_id=1a5ecb009c904013b663909e7003face, role_id=ad3a2bc7b2094a4da1a95a143c8d9436)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:56.774256 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e749a-ee3e-412b-8e66-9e56c47dc201 admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:56.775874 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6e749a-ee3e-412b-8e66-9e56c47dc201 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:56.782144 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6e749a-ee3e-412b-8e66-9e56c47dc201 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:56.782341 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc66d60f-762b-497e-8fbb-43458e4e2b25 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:56.816008 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1070/2148] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:56 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:56.818205 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e749a-ee3e-412b-8e66-9e56c47dc201 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:56.834551 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e749a-ee3e-412b-8e66-9e56c47dc201 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:56.845396 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b518eaf9-4a2f-45d0-a118-0fc9666bb810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:56.848323 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b518eaf9-4a2f-45d0-a118-0fc9666bb810 admin admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:56.849286 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b518eaf9-4a2f-45d0-a118-0fc9666bb810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:56.850123 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b518eaf9-4a2f-45d0-a118-0fc9666bb810 admin admin] PATH_INFO: `/v3/projects/66d46465b66145fb98fae02dee13b758/users/5456d05816e1477cab284976ea490adb/roles/ad3a2bc7b2094a4da1a95a143c8d9436` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:56.892980 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b518eaf9-4a2f-45d0-a118-0fc9666bb810 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66d46465b66145fb98fae02dee13b758, user_id=5456d05816e1477cab284976ea490adb, role_id=ad3a2bc7b2094a4da1a95a143c8d9436)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:56.896058 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b518eaf9-4a2f-45d0-a118-0fc9666bb810 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:57.024428 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1079/2149] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:51:56 2022] PUT /identity/v3/projects/9f8fd6801be64dc3813e004eac9ab19d/users/1a5ecb009c904013b663909e7003face/roles/ad3a2bc7b2094a4da1a95a143c8d9436 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:57.028079 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1071/2150] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:51:56 2022] PUT /identity/v3/projects/66d46465b66145fb98fae02dee13b758/users/5456d05816e1477cab284976ea490adb/roles/ad3a2bc7b2094a4da1a95a143c8d9436 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:57.053465 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150ddf5-6545-4f5d-bae0-d412db19a5af None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:57.055704 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150ddf5-6545-4f5d-bae0-d412db19a5af None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:57.055704 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150ddf5-6545-4f5d-bae0-d412db19a5af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:57.058955 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b152c34d-af08-449e-b717-bda1790faa4c None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:57.059255 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b152c34d-af08-449e-b717-bda1790faa4c None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:57.059525 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b152c34d-af08-449e-b717-bda1790faa4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:57.105219 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:57.139991 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-7150ddf5-6545-4f5d-bae0-d412db19a5af None None] MFA Rules not processed for user `1a5ecb009c904013b663909e7003face`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:57.141235 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-7150ddf5-6545-4f5d-bae0-d412db19a5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:57.146952 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-b152c34d-af08-449e-b717-bda1790faa4c None None] MFA Rules not processed for user `5456d05816e1477cab284976ea490adb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:57.148483 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-b152c34d-af08-449e-b717-bda1790faa4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:57.287954 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1072/2151] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:51:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:57.293060 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b152c34d-af08-449e-b717-bda1790faa4c None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:57.294852 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-b152c34d-af08-449e-b717-bda1790faa4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:57.311907 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1080/2152] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:51:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:57.312884 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7150ddf5-6545-4f5d-bae0-d412db19a5af None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:57.314234 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-7150ddf5-6545-4f5d-bae0-d412db19a5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:57.459319 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7150ddf5-6545-4f5d-bae0-d412db19a5af None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:57.459865 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b152c34d-af08-449e-b717-bda1790faa4c None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:57.467542 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1b9178-72cf-4994-b26c-c81d3d557e82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:57.468291 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b9178-72cf-4994-b26c-c81d3d557e82 service cinder] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:57.468579 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b9178-72cf-4994-b26c-c81d3d557e82 service cinder] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:57.468860 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b9178-72cf-4994-b26c-c81d3d557e82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:57.478962 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dc41c4-7c00-4fb3-b208-fe92dfa5dd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:57.480624 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc41c4-7c00-4fb3-b208-fe92dfa5dd19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:57.480624 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc41c4-7c00-4fb3-b208-fe92dfa5dd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:57.481205 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc41c4-7c00-4fb3-b208-fe92dfa5dd19 admin admin] PATH_INFO: `/v3/projects/eeaa19dbbf2b40499feee878cffa0422` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:57.488733 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dc41c4-7c00-4fb3-b208-fe92dfa5dd19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eeaa19dbbf2b40499feee878cffa0422)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:57.490058 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1b9178-72cf-4994-b26c-c81d3d557e82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:57.490895 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dc41c4-7c00-4fb3-b208-fe92dfa5dd19 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:57.492743 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1b9178-72cf-4994-b26c-c81d3d557e82 service cinder] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:57.516509 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1081/2153] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:57 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:51:57.516509 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1b9178-72cf-4994-b26c-c81d3d557e82 service cinder] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:57.535236 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1b9178-72cf-4994-b26c-c81d3d557e82 service cinder] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:57.542916 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4170dc-4bd7-41dd-a80d-d2bfe37c6358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:57.543736 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4170dc-4bd7-41dd-a80d-d2bfe37c6358 admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:57.544120 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4170dc-4bd7-41dd-a80d-d2bfe37c6358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:57.544531 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4170dc-4bd7-41dd-a80d-d2bfe37c6358 admin admin] PATH_INFO: `/v3/projects` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:57.545635 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4170dc-4bd7-41dd-a80d-d2bfe37c6358 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:57.550813 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4170dc-4bd7-41dd-a80d-d2bfe37c6358 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:57.633035 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:57.720871 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-71dc41c4-7c00-4fb3-b208-fe92dfa5dd19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eeaa19dbbf2b40499feee878cffa0422', 'request_id': 'req-71dc41c4-7c00-4fb3-b208-fe92dfa5dd19'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:57.743943 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:57.750770 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1082/2154] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:51:57 2022] POST /identity/v3/projects => generated 383 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:57.754204 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4170dc-4bd7-41dd-a80d-d2bfe37c6358 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:57.834732 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-71dc41c4-7c00-4fb3-b208-fe92dfa5dd19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eeaa19dbbf2b40499feee878cffa0422', 'request_id': 'req-71dc41c4-7c00-4fb3-b208-fe92dfa5dd19'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:57.844573 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-71dc41c4-7c00-4fb3-b208-fe92dfa5dd19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eeaa19dbbf2b40499feee878cffa0422', 'request_id': 'req-71dc41c4-7c00-4fb3-b208-fe92dfa5dd19'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:57.882071 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-71dc41c4-7c00-4fb3-b208-fe92dfa5dd19 admin admin] The token cache is being invalidate because project eeaa19dbbf2b40499feee878cffa0422 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:51:57.882989 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-71dc41c4-7c00-4fb3-b208-fe92dfa5dd19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:57.888204 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-71dc41c4-7c00-4fb3-b208-fe92dfa5dd19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:57.890047 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1073/2155] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 16:51:57 2022] DELETE /identity/v3/projects/eeaa19dbbf2b40499feee878cffa0422 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:57.895067 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d501e3-1bac-4e36-95dd-dd87a1ec05e8 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:57.895534 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d501e3-1bac-4e36-95dd-dd87a1ec05e8 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:57.895959 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d501e3-1bac-4e36-95dd-dd87a1ec05e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:57.923450 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-c8d501e3-1bac-4e36-95dd-dd87a1ec05e8 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:57.926117 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-c8d501e3-1bac-4e36-95dd-dd87a1ec05e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:57.939850 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1074/2156] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:51:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:57.940693 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4170dc-4bd7-41dd-a80d-d2bfe37c6358 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:57.948471 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d2fe9-d4cb-41a4-a5c8-44c75704f89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:57.948955 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512a602-10f7-4063-b0bf-ec2df6415067 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:57.949404 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d2fe9-d4cb-41a4-a5c8-44c75704f89e admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:57.949680 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512a602-10f7-4063-b0bf-ec2df6415067 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:57.949903 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d2fe9-d4cb-41a4-a5c8-44c75704f89e admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:57.950283 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d2fe9-d4cb-41a4-a5c8-44c75704f89e admin admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:57.950757 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512a602-10f7-4063-b0bf-ec2df6415067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:57.951207 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264d2fe9-d4cb-41a4-a5c8-44c75704f89e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:57.953421 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264d2fe9-d4cb-41a4-a5c8-44c75704f89e admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:57.987284 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-7512a602-10f7-4063-b0bf-ec2df6415067 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:57.989115 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-7512a602-10f7-4063-b0bf-ec2df6415067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:58.013516 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1075/2157] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:51:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:58.017514 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7512a602-10f7-4063-b0bf-ec2df6415067 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:58.028875 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7512a602-10f7-4063-b0bf-ec2df6415067 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:58.034779 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2104d9d-b5ae-4df8-a12a-aa60a117ce5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:58.036873 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2104d9d-b5ae-4df8-a12a-aa60a117ce5f admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:58.036873 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2104d9d-b5ae-4df8-a12a-aa60a117ce5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:58.036873 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2104d9d-b5ae-4df8-a12a-aa60a117ce5f admin admin] PATH_INFO: `/v3/domains` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:58.038034 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2104d9d-b5ae-4df8-a12a-aa60a117ce5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:51:58.038515 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2104d9d-b5ae-4df8-a12a-aa60a117ce5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:58.041437 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2104d9d-b5ae-4df8-a12a-aa60a117ce5f admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:58.071113 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1076/2158] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Jul 18 16:51:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:51:58.072610 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2104d9d-b5ae-4df8-a12a-aa60a117ce5f admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:58.103619 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2104d9d-b5ae-4df8-a12a-aa60a117ce5f admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:58.111121 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10372389-0370-409e-a66f-31333f2840af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:58.112487 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10372389-0370-409e-a66f-31333f2840af admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:58.113103 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10372389-0370-409e-a66f-31333f2840af admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:58.113578 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10372389-0370-409e-a66f-31333f2840af admin admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:58.114627 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10372389-0370-409e-a66f-31333f2840af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:58.117159 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10372389-0370-409e-a66f-31333f2840af admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:58.119911 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1083/2159] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 16:51:57 2022] POST /identity/v3/users => generated 298 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:58.121492 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d2fe9-d4cb-41a4-a5c8-44c75704f89e admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:58.124800 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-264d2fe9-d4cb-41a4-a5c8-44c75704f89e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:58.157001 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d2fe9-d4cb-41a4-a5c8-44c75704f89e admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:58.168092 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a8eee0-471c-47b7-98c5-0575da863d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:58.171282 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a8eee0-471c-47b7-98c5-0575da863d06 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:58.171282 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a8eee0-471c-47b7-98c5-0575da863d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:58.171282 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a8eee0-471c-47b7-98c5-0575da863d06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:58.171282 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a8eee0-471c-47b7-98c5-0575da863d06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:58.176991 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a8eee0-471c-47b7-98c5-0575da863d06 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:58.201801 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1084/2160] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:58.208883 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a8eee0-471c-47b7-98c5-0575da863d06 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:58.230711 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a8eee0-471c-47b7-98c5-0575da863d06 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:58.238504 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad47769d-bdaf-41bf-aeb4-86897dd38474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:58.240256 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad47769d-bdaf-41bf-aeb4-86897dd38474 admin admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:58.240725 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad47769d-bdaf-41bf-aeb4-86897dd38474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:58.241256 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad47769d-bdaf-41bf-aeb4-86897dd38474 admin admin] PATH_INFO: `/v3/projects/f647e4b1eedd47128d5d24f324616649/users/6097c98f205f4bbbbd4ed6021f49733f/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:58.254390 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1077/2161] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:51:58 2022] POST /identity/v3/projects => generated 365 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:58.258543 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10372389-0370-409e-a66f-31333f2840af admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:58.272068 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad47769d-bdaf-41bf-aeb4-86897dd38474 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f647e4b1eedd47128d5d24f324616649, user_id=6097c98f205f4bbbbd4ed6021f49733f, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:58.275252 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad47769d-bdaf-41bf-aeb4-86897dd38474 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:58.345086 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10372389-0370-409e-a66f-31333f2840af admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:58.350183 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c4de22-e411-47cd-bda1-cd6846d23e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:58.350942 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c4de22-e411-47cd-bda1-cd6846d23e9b admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:58.353825 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c4de22-e411-47cd-bda1-cd6846d23e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:58.353825 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c4de22-e411-47cd-bda1-cd6846d23e9b admin admin] PATH_INFO: `/v3/users` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:58.353825 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c4de22-e411-47cd-bda1-cd6846d23e9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:58.355084 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c4de22-e411-47cd-bda1-cd6846d23e9b admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:58.390471 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1085/2162] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:51:58 2022] PUT /identity/v3/projects/f647e4b1eedd47128d5d24f324616649/users/6097c98f205f4bbbbd4ed6021f49733f/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:58.394522 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad47769d-bdaf-41bf-aeb4-86897dd38474 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:58.462677 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad47769d-bdaf-41bf-aeb4-86897dd38474 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:58.469604 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b6542-a24e-4cad-ae6b-4463852244e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:58.470476 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b6542-a24e-4cad-ae6b-4463852244e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:58.470949 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b6542-a24e-4cad-ae6b-4463852244e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:58.471375 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b6542-a24e-4cad-ae6b-4463852244e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:58.472299 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38b6542-a24e-4cad-ae6b-4463852244e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:58.473922 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38b6542-a24e-4cad-ae6b-4463852244e7 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:58.486375 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1086/2163] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:58.490567 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b6542-a24e-4cad-ae6b-4463852244e7 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:58.501186 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b6542-a24e-4cad-ae6b-4463852244e7 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:58.506313 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d9491d-2fe0-4397-a429-40ae26cee62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:58.507318 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9491d-2fe0-4397-a429-40ae26cee62a admin admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:58.507610 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9491d-2fe0-4397-a429-40ae26cee62a admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:58.508032 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9491d-2fe0-4397-a429-40ae26cee62a admin admin] PATH_INFO: `/v3/projects/f647e4b1eedd47128d5d24f324616649/users/6097c98f205f4bbbbd4ed6021f49733f/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:58.510168 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d9491d-2fe0-4397-a429-40ae26cee62a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f647e4b1eedd47128d5d24f324616649, user_id=6097c98f205f4bbbbd4ed6021f49733f, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:58.513225 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d9491d-2fe0-4397-a429-40ae26cee62a admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:58.520778 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1078/2164] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 16:51:58 2022] POST /identity/v3/users => generated 283 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:58.532724 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1087/2165] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:51:58 2022] PUT /identity/v3/projects/f647e4b1eedd47128d5d24f324616649/users/6097c98f205f4bbbbd4ed6021f49733f/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:51:58.534496 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c4de22-e411-47cd-bda1-cd6846d23e9b admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:58.537235 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ab003-35b0-4018-825e-27fa875300d4 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:58.537590 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ab003-35b0-4018-825e-27fa875300d4 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:58.537881 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ab003-35b0-4018-825e-27fa875300d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:58.547862 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c4de22-e411-47cd-bda1-cd6846d23e9b admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:58.575250 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-a55ab003-35b0-4018-825e-27fa875300d4 None None] MFA Rules not processed for user `6097c98f205f4bbbbd4ed6021f49733f`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:58.577260 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-a55ab003-35b0-4018-825e-27fa875300d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:58.626205 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036feb7c-1a68-419f-b896-b32f53d6ca90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:58.627324 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036feb7c-1a68-419f-b896-b32f53d6ca90 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:58.627940 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036feb7c-1a68-419f-b896-b32f53d6ca90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:58.628221 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036feb7c-1a68-419f-b896-b32f53d6ca90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:58.628961 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036feb7c-1a68-419f-b896-b32f53d6ca90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:58.630678 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036feb7c-1a68-419f-b896-b32f53d6ca90 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:58.662276 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1088/2166] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:51:58 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:51:58.662479 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1079/2167] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 16:51:58.664855 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ab003-35b0-4018-825e-27fa875300d4 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:58.668713 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036feb7c-1a68-419f-b896-b32f53d6ca90 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:58.670546 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-036feb7c-1a68-419f-b896-b32f53d6ca90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:58.675734 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ab003-35b0-4018-825e-27fa875300d4 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:58.685763 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b636cac-309d-4d60-a53c-fd70a62b9c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:58.686454 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b636cac-309d-4d60-a53c-fd70a62b9c12 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:58.686731 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b636cac-309d-4d60-a53c-fd70a62b9c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:58.687000 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b636cac-309d-4d60-a53c-fd70a62b9c12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:58.687815 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b636cac-309d-4d60-a53c-fd70a62b9c12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:58.689571 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b636cac-309d-4d60-a53c-fd70a62b9c12 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:58.701731 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1089/2168] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:58.707887 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b636cac-309d-4d60-a53c-fd70a62b9c12 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:58.723858 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b636cac-309d-4d60-a53c-fd70a62b9c12 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:58.728911 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a099edf-76ea-42b0-8626-386202ad154c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:58.729881 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a099edf-76ea-42b0-8626-386202ad154c admin admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:58.730231 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a099edf-76ea-42b0-8626-386202ad154c admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:58.730506 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a099edf-76ea-42b0-8626-386202ad154c admin admin] PATH_INFO: `/v3/projects/0ee1bd22a4a541f79b0eb08acd752bea/users/25e8fc147a2641179495291820557874/roles/ad3a2bc7b2094a4da1a95a143c8d9436` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:58.746600 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a099edf-76ea-42b0-8626-386202ad154c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ee1bd22a4a541f79b0eb08acd752bea, user_id=25e8fc147a2641179495291820557874, role_id=ad3a2bc7b2094a4da1a95a143c8d9436)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:58.748045 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036feb7c-1a68-419f-b896-b32f53d6ca90 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:58.749594 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a099edf-76ea-42b0-8626-386202ad154c admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:58.752056 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adad5698-e67a-4382-bbd7-f5aec2f43e41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:58.753182 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad5698-e67a-4382-bbd7-f5aec2f43e41 service cinder] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:58.756089 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad5698-e67a-4382-bbd7-f5aec2f43e41 service cinder] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:58.756596 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad5698-e67a-4382-bbd7-f5aec2f43e41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:58.768369 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adad5698-e67a-4382-bbd7-f5aec2f43e41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:58.769938 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adad5698-e67a-4382-bbd7-f5aec2f43e41 service cinder] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:58.783881 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1080/2169] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:58 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 16:51:58.808874 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adad5698-e67a-4382-bbd7-f5aec2f43e41 service cinder] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:58.827922 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adad5698-e67a-4382-bbd7-f5aec2f43e41 service cinder] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:58.827922 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0744372-3e81-446d-b753-0b8ac1c9a889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:58.827922 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0744372-3e81-446d-b753-0b8ac1c9a889 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:58.827922 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0744372-3e81-446d-b753-0b8ac1c9a889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:58.828310 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0744372-3e81-446d-b753-0b8ac1c9a889 admin admin] PATH_INFO: `/v3/users/1a5ecb009c904013b663909e7003face` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:58.828310 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0744372-3e81-446d-b753-0b8ac1c9a889 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a5ecb009c904013b663909e7003face)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:58.830089 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0744372-3e81-446d-b753-0b8ac1c9a889 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:58.851757 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1090/2170] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:51:58 2022] PUT /identity/v3/projects/0ee1bd22a4a541f79b0eb08acd752bea/users/25e8fc147a2641179495291820557874/roles/ad3a2bc7b2094a4da1a95a143c8d9436 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:51:58.857604 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baafe4a-767f-4166-ae5d-f9ac96917ba5 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:58.857892 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baafe4a-767f-4166-ae5d-f9ac96917ba5 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:58.858169 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baafe4a-767f-4166-ae5d-f9ac96917ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:58.908313 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-3baafe4a-767f-4166-ae5d-f9ac96917ba5 None None] MFA Rules not processed for user `25e8fc147a2641179495291820557874`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:58.909632 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-3baafe4a-767f-4166-ae5d-f9ac96917ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:59.005269 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1091/2171] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:51:58 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:51:59.017319 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baafe4a-767f-4166-ae5d-f9ac96917ba5 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:59.018712 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-3baafe4a-767f-4166-ae5d-f9ac96917ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:59.098913 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baafe4a-767f-4166-ae5d-f9ac96917ba5 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:59.100941 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-f0744372-3e81-446d-b753-0b8ac1c9a889 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a5ecb009c904013b663909e7003face'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:59.101816 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-f0744372-3e81-446d-b753-0b8ac1c9a889 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a5ecb009c904013b663909e7003face'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:59.105474 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d494fcd4-7617-4471-ba38-757fdd296e2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:59.107031 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d494fcd4-7617-4471-ba38-757fdd296e2a service cinder] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:59.107303 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d494fcd4-7617-4471-ba38-757fdd296e2a service cinder] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:59.107949 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d494fcd4-7617-4471-ba38-757fdd296e2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:59.119819 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-f0744372-3e81-446d-b753-0b8ac1c9a889 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a5ecb009c904013b663909e7003face'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:59.121104 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d494fcd4-7617-4471-ba38-757fdd296e2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:59.123876 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d494fcd4-7617-4471-ba38-757fdd296e2a service cinder] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:59.143295 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1092/2172] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:59 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 16:51:59.263537 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-f0744372-3e81-446d-b753-0b8ac1c9a889 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a5ecb009c904013b663909e7003face'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:59.276959 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-f0744372-3e81-446d-b753-0b8ac1c9a889 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a5ecb009c904013b663909e7003face'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:59.291767 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1081/2173] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 16:51:58 2022] DELETE /identity/v3/users/1a5ecb009c904013b663909e7003face => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:51:59.297693 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4a50c-458a-4538-8378-ded432fa797a None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:59.298214 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4a50c-458a-4538-8378-ded432fa797a None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:59.298507 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4a50c-458a-4538-8378-ded432fa797a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:59.345251 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-11e4a50c-458a-4538-8378-ded432fa797a None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:59.347578 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-11e4a50c-458a-4538-8378-ded432fa797a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:59.489299 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1093/2174] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:51:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:59.500213 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0744372-3e81-446d-b753-0b8ac1c9a889 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:59.503393 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-f0744372-3e81-446d-b753-0b8ac1c9a889 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:59.519642 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:59.570275 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0744372-3e81-446d-b753-0b8ac1c9a889 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:59.574258 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf34f0b7-3d61-4594-9cde-ec721c45ad3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:59.574867 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34f0b7-3d61-4594-9cde-ec721c45ad3a service neutron] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:59.575299 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34f0b7-3d61-4594-9cde-ec721c45ad3a service neutron] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:59.575423 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34f0b7-3d61-4594-9cde-ec721c45ad3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:59.586064 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf34f0b7-3d61-4594-9cde-ec721c45ad3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:59.587888 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf34f0b7-3d61-4594-9cde-ec721c45ad3a service neutron] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:59.599404 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1082/2175] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:51:59.704534 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:00.813797 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e4a50c-458a-4538-8378-ded432fa797a None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:00.816891 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-11e4a50c-458a-4538-8378-ded432fa797a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:00.846453 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e4a50c-458a-4538-8378-ded432fa797a None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:00.884474 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4dc65c-2e94-4d2b-94d4-c65f1ec1e95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:00.886034 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4dc65c-2e94-4d2b-94d4-c65f1ec1e95b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:00.886717 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4dc65c-2e94-4d2b-94d4-c65f1ec1e95b admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:00.887376 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4dc65c-2e94-4d2b-94d4-c65f1ec1e95b admin admin] PATH_INFO: `/v3/projects/9f8fd6801be64dc3813e004eac9ab19d` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:00.889684 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4dc65c-2e94-4d2b-94d4-c65f1ec1e95b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f8fd6801be64dc3813e004eac9ab19d)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:00.894279 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4dc65c-2e94-4d2b-94d4-c65f1ec1e95b admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:01.057238 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df25807-8e46-4721-82e3-62b957204cda None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:01.057834 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df25807-8e46-4721-82e3-62b957204cda None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:01.057834 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df25807-8e46-4721-82e3-62b957204cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:01.076129 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-7df25807-8e46-4721-82e3-62b957204cda None None] MFA Rules not processed for user `5456d05816e1477cab284976ea490adb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:01.077337 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-7df25807-8e46-4721-82e3-62b957204cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:01.106551 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-4b4dc65c-2e94-4d2b-94d4-c65f1ec1e95b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f8fd6801be64dc3813e004eac9ab19d', 'request_id': 'req-4b4dc65c-2e94-4d2b-94d4-c65f1ec1e95b'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:01.112562 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-4b4dc65c-2e94-4d2b-94d4-c65f1ec1e95b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f8fd6801be64dc3813e004eac9ab19d', 'request_id': 'req-4b4dc65c-2e94-4d2b-94d4-c65f1ec1e95b'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:01.125799 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-4b4dc65c-2e94-4d2b-94d4-c65f1ec1e95b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f8fd6801be64dc3813e004eac9ab19d', 'request_id': 'req-4b4dc65c-2e94-4d2b-94d4-c65f1ec1e95b'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:01.140627 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1083/2176] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:52:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:52:01.298546 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-4b4dc65c-2e94-4d2b-94d4-c65f1ec1e95b admin admin] The token cache is being invalidate because project 9f8fd6801be64dc3813e004eac9ab19d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:52:01.298897 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-4b4dc65c-2e94-4d2b-94d4-c65f1ec1e95b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:01.300063 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-4b4dc65c-2e94-4d2b-94d4-c65f1ec1e95b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:01.301961 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1094/2177] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 16:52:00 2022] DELETE /identity/v3/projects/9f8fd6801be64dc3813e004eac9ab19d => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:01.306342 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df25807-8e46-4721-82e3-62b957204cda None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:01.317211 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df25807-8e46-4721-82e3-62b957204cda None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:01.380150 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9840bd03-58d0-40b0-bffa-0ac613cf347f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:01.381040 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840bd03-58d0-40b0-bffa-0ac613cf347f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:01.381326 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840bd03-58d0-40b0-bffa-0ac613cf347f admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:01.381635 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840bd03-58d0-40b0-bffa-0ac613cf347f admin admin] PATH_INFO: `/v3/users/6097c98f205f4bbbbd4ed6021f49733f` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:01.382846 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9840bd03-58d0-40b0-bffa-0ac613cf347f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6097c98f205f4bbbbd4ed6021f49733f)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:01.384842 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9840bd03-58d0-40b0-bffa-0ac613cf347f admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:01.554195 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-9840bd03-58d0-40b0-bffa-0ac613cf347f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6097c98f205f4bbbbd4ed6021f49733f'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:01.560639 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-9840bd03-58d0-40b0-bffa-0ac613cf347f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6097c98f205f4bbbbd4ed6021f49733f'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:01.567446 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-9840bd03-58d0-40b0-bffa-0ac613cf347f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6097c98f205f4bbbbd4ed6021f49733f'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:01.723755 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-9840bd03-58d0-40b0-bffa-0ac613cf347f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6097c98f205f4bbbbd4ed6021f49733f'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:01.733127 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-9840bd03-58d0-40b0-bffa-0ac613cf347f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6097c98f205f4bbbbd4ed6021f49733f'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:01.745105 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1084/2178] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 16:52:01 2022] DELETE /identity/v3/users/6097c98f205f4bbbbd4ed6021f49733f => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:52:02.104576 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:02.310764 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4dc65c-2e94-4d2b-94d4-c65f1ec1e95b admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:02.312859 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-4b4dc65c-2e94-4d2b-94d4-c65f1ec1e95b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:02.326245 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4dc65c-2e94-4d2b-94d4-c65f1ec1e95b admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:02.390004 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c7f4b-0e7c-4e9d-9864-44f266db4204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:02.390882 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c7f4b-0e7c-4e9d-9864-44f266db4204 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:02.391170 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c7f4b-0e7c-4e9d-9864-44f266db4204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:02.391447 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c7f4b-0e7c-4e9d-9864-44f266db4204 admin admin] PATH_INFO: `/v3/projects/f647e4b1eedd47128d5d24f324616649` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:02.398095 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2c7f4b-0e7c-4e9d-9864-44f266db4204 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f647e4b1eedd47128d5d24f324616649)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:02.398095 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2c7f4b-0e7c-4e9d-9864-44f266db4204 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:02.509434 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:02.563202 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-7b2c7f4b-0e7c-4e9d-9864-44f266db4204 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f647e4b1eedd47128d5d24f324616649', 'request_id': 'req-7b2c7f4b-0e7c-4e9d-9864-44f266db4204'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:02.568858 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-7b2c7f4b-0e7c-4e9d-9864-44f266db4204 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f647e4b1eedd47128d5d24f324616649', 'request_id': 'req-7b2c7f4b-0e7c-4e9d-9864-44f266db4204'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:02.575728 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-7b2c7f4b-0e7c-4e9d-9864-44f266db4204 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f647e4b1eedd47128d5d24f324616649', 'request_id': 'req-7b2c7f4b-0e7c-4e9d-9864-44f266db4204'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:02.692123 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-7b2c7f4b-0e7c-4e9d-9864-44f266db4204 admin admin] The token cache is being invalidate because project f647e4b1eedd47128d5d24f324616649 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:52:02.694067 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-7b2c7f4b-0e7c-4e9d-9864-44f266db4204 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:02.694067 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-7b2c7f4b-0e7c-4e9d-9864-44f266db4204 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:02.695098 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1095/2179] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 16:52:02 2022] DELETE /identity/v3/projects/f647e4b1eedd47128d5d24f324616649 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:02.696305 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48701096-8528-49c1-a4ef-5f4c38caaf8f None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:02.696577 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48701096-8528-49c1-a4ef-5f4c38caaf8f None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:02.696856 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48701096-8528-49c1-a4ef-5f4c38caaf8f None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:02.698249 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1085/2180] 10.222.0.81 () {54 vars in 921 bytes} [Mon Jul 18 16:52:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:52:02.700659 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba1e71-5724-4c66-b801-9c5e27806b90 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:02.701274 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba1e71-5724-4c66-b801-9c5e27806b90 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:02.701617 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba1e71-5724-4c66-b801-9c5e27806b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:02.712276 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9909c0-09d8-4ece-aed2-298e0531af28 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:02.712566 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9909c0-09d8-4ece-aed2-298e0531af28 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:02.712890 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9909c0-09d8-4ece-aed2-298e0531af28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:02.723172 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-87ba1e71-5724-4c66-b801-9c5e27806b90 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:02.724606 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-87ba1e71-5724-4c66-b801-9c5e27806b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:02.738718 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-4f9909c0-09d8-4ece-aed2-298e0531af28 None None] MFA Rules not processed for user `5700ad7df774415b89737c7dddcc5b2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:02.740385 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-4f9909c0-09d8-4ece-aed2-298e0531af28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:02.799046 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1096/2181] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:52:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:52:02.807399 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9c44b-6d23-4119-b73b-77460b465388 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:02.807688 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9c44b-6d23-4119-b73b-77460b465388 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:02.808000 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9c44b-6d23-4119-b73b-77460b465388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:02.812111 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1086/2182] 10.222.0.81 () {58 vars in 1018 bytes} [Mon Jul 18 16:52:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:52:02.824143 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9909c0-09d8-4ece-aed2-298e0531af28 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:02.825549 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-4f9909c0-09d8-4ece-aed2-298e0531af28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:02.827375 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-75d9c44b-6d23-4119-b73b-77460b465388 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:02.828580 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-75d9c44b-6d23-4119-b73b-77460b465388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:02.836802 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1097/2183] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:52:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:52:02.839150 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9909c0-09d8-4ece-aed2-298e0531af28 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:02.841011 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d9c44b-6d23-4119-b73b-77460b465388 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:02.844572 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c1726-610b-486a-94e9-fcb8d6d71e7d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700ad7df774415b89737c7dddcc5b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:02.845225 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c1726-610b-486a-94e9-fcb8d6d71e7d service placement] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:02.845505 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c1726-610b-486a-94e9-fcb8d6d71e7d service placement] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:02.845783 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c1726-610b-486a-94e9-fcb8d6d71e7d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:02.850171 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d9c44b-6d23-4119-b73b-77460b465388 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:02.854579 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5c1726-610b-486a-94e9-fcb8d6d71e7d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:02.855705 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b8b00-176f-4640-95aa-2e8bf16ff947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:02.855855 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b8b00-176f-4640-95aa-2e8bf16ff947 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:02.856075 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b8b00-176f-4640-95aa-2e8bf16ff947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:02.856193 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5c1726-610b-486a-94e9-fcb8d6d71e7d service placement] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:02.856352 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b8b00-176f-4640-95aa-2e8bf16ff947 admin admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:02.858635 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201b8b00-176f-4640-95aa-2e8bf16ff947 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:52:02.858944 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201b8b00-176f-4640-95aa-2e8bf16ff947 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:02.861209 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201b8b00-176f-4640-95aa-2e8bf16ff947 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:02.874681 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1087/2184] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:52:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 16:52:02.880803 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1098/2185] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Jul 18 16:52:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:52:02.882334 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c1726-610b-486a-94e9-fcb8d6d71e7d service placement] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:02.894394 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c1726-610b-486a-94e9-fcb8d6d71e7d service placement] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:02.899667 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8d7c11-884f-483d-abe8-a551e8a9f995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:02.900380 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d7c11-884f-483d-abe8-a551e8a9f995 admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:02.900881 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d7c11-884f-483d-abe8-a551e8a9f995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:02.901346 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d7c11-884f-483d-abe8-a551e8a9f995 admin admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:02.902374 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8d7c11-884f-483d-abe8-a551e8a9f995 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:02.907186 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8d7c11-884f-483d-abe8-a551e8a9f995 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:03.029834 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1088/2186] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:52:02 2022] POST /identity/v3/projects => generated 379 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:52:03.033854 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b8b00-176f-4640-95aa-2e8bf16ff947 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:03.045520 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b8b00-176f-4640-95aa-2e8bf16ff947 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:03.122061 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ed2b7f-8afd-4d94-980f-1be54ccd6ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:03.122758 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed2b7f-8afd-4d94-980f-1be54ccd6ece admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:03.123141 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed2b7f-8afd-4d94-980f-1be54ccd6ece admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:03.123388 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed2b7f-8afd-4d94-980f-1be54ccd6ece admin admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:03.126377 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ed2b7f-8afd-4d94-980f-1be54ccd6ece admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:03.132218 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ed2b7f-8afd-4d94-980f-1be54ccd6ece admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:03.300238 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1099/2187] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 16:52:03 2022] POST /identity/v3/users => generated 290 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:52:03.304330 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8d7c11-884f-483d-abe8-a551e8a9f995 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:03.325876 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8d7c11-884f-483d-abe8-a551e8a9f995 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:03.339373 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a5d630-82b5-4626-81c2-0487a6fc159b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:03.340181 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a5d630-82b5-4626-81c2-0487a6fc159b admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:03.340399 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a5d630-82b5-4626-81c2-0487a6fc159b admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:03.340653 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a5d630-82b5-4626-81c2-0487a6fc159b admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:03.341398 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a5d630-82b5-4626-81c2-0487a6fc159b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:03.362568 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a5d630-82b5-4626-81c2-0487a6fc159b admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:03.382542 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1089/2188] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:52:03 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:52:03.386890 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ed2b7f-8afd-4d94-980f-1be54ccd6ece admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:03.400806 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ed2b7f-8afd-4d94-980f-1be54ccd6ece admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:03.416244 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f89e75c-bb4f-4bb2-ae73-ace2d513780d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:03.417048 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89e75c-bb4f-4bb2-ae73-ace2d513780d admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:03.417338 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89e75c-bb4f-4bb2-ae73-ace2d513780d admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:03.417621 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89e75c-bb4f-4bb2-ae73-ace2d513780d admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:03.418384 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f89e75c-bb4f-4bb2-ae73-ace2d513780d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:03.420070 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f89e75c-bb4f-4bb2-ae73-ace2d513780d admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:03.435454 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1100/2189] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:52:03 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:52:03.440804 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a5d630-82b5-4626-81c2-0487a6fc159b admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:03.450219 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a5d630-82b5-4626-81c2-0487a6fc159b admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:03.455100 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef4805-7355-476c-ac65-38339b8155b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:03.456123 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef4805-7355-476c-ac65-38339b8155b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:03.456476 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef4805-7355-476c-ac65-38339b8155b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:03.456825 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef4805-7355-476c-ac65-38339b8155b9 admin admin] PATH_INFO: `/v3/projects/921f7a70b01646c49f9f960316a18deb/users/88caf872c0d142b69a9e7b5921b5ab65/roles/ad3a2bc7b2094a4da1a95a143c8d9436` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:03.480241 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ef4805-7355-476c-ac65-38339b8155b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=921f7a70b01646c49f9f960316a18deb, user_id=88caf872c0d142b69a9e7b5921b5ab65, role_id=ad3a2bc7b2094a4da1a95a143c8d9436)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:03.488798 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ef4805-7355-476c-ac65-38339b8155b9 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:03.632090 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1090/2190] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:52:03 2022] PUT /identity/v3/projects/921f7a70b01646c49f9f960316a18deb/users/88caf872c0d142b69a9e7b5921b5ab65/roles/ad3a2bc7b2094a4da1a95a143c8d9436 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:03.643866 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6321e3-6fa4-45f2-ab00-ac1f929c7385 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:03.644162 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6321e3-6fa4-45f2-ab00-ac1f929c7385 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:03.644777 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6321e3-6fa4-45f2-ab00-ac1f929c7385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:03.676305 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-eb6321e3-6fa4-45f2-ab00-ac1f929c7385 None None] MFA Rules not processed for user `88caf872c0d142b69a9e7b5921b5ab65`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:03.678137 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-eb6321e3-6fa4-45f2-ab00-ac1f929c7385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:03.756457 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1101/2191] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:52:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:52:03.764425 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef4805-7355-476c-ac65-38339b8155b9 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:03.766225 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-a2ef4805-7355-476c-ac65-38339b8155b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:03.766838 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6321e3-6fa4-45f2-ab00-ac1f929c7385 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:03.856028 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef4805-7355-476c-ac65-38339b8155b9 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:03.860884 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46886d3-47ca-4d45-afcf-1190b8331fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:03.861763 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46886d3-47ca-4d45-afcf-1190b8331fdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:03.862046 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46886d3-47ca-4d45-afcf-1190b8331fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:03.862347 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46886d3-47ca-4d45-afcf-1190b8331fdf admin admin] PATH_INFO: `/v3/users/af422e904a394f31b6c3285f4ad79c30` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:03.863574 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46886d3-47ca-4d45-afcf-1190b8331fdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=af422e904a394f31b6c3285f4ad79c30)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:03.865552 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46886d3-47ca-4d45-afcf-1190b8331fdf admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:03.876936 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6321e3-6fa4-45f2-ab00-ac1f929c7385 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:03.882038 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670c1471-3ccf-4081-a4c9-cad7937b1ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:03.882716 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c1471-3ccf-4081-a4c9-cad7937b1ec2 admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:03.883678 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c1471-3ccf-4081-a4c9-cad7937b1ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:03.883988 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c1471-3ccf-4081-a4c9-cad7937b1ec2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:03.888087 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670c1471-3ccf-4081-a4c9-cad7937b1ec2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:03.890795 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670c1471-3ccf-4081-a4c9-cad7937b1ec2 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:04.102461 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1102/2192] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:52:03 2022] POST /identity/v3/projects => generated 379 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:52:04.107423 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670c1471-3ccf-4081-a4c9-cad7937b1ec2 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:04.185784 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-c46886d3-47ca-4d45-afcf-1190b8331fdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af422e904a394f31b6c3285f4ad79c30'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:04.186563 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-c46886d3-47ca-4d45-afcf-1190b8331fdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af422e904a394f31b6c3285f4ad79c30'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:04.202424 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-c46886d3-47ca-4d45-afcf-1190b8331fdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af422e904a394f31b6c3285f4ad79c30'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:04.205908 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670c1471-3ccf-4081-a4c9-cad7937b1ec2 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:04.213490 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822dd4e0-11e8-423d-83f6-02dedb5ec9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:04.214341 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822dd4e0-11e8-423d-83f6-02dedb5ec9b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:04.214810 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822dd4e0-11e8-423d-83f6-02dedb5ec9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:04.215273 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822dd4e0-11e8-423d-83f6-02dedb5ec9b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:04.216306 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822dd4e0-11e8-423d-83f6-02dedb5ec9b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:04.218685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822dd4e0-11e8-423d-83f6-02dedb5ec9b9 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:04.401178 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1103/2193] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 16:52:04 2022] POST /identity/v3/users => generated 296 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:52:04.402245 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822dd4e0-11e8-423d-83f6-02dedb5ec9b9 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:04.413769 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822dd4e0-11e8-423d-83f6-02dedb5ec9b9 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:04.417577 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-c46886d3-47ca-4d45-afcf-1190b8331fdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af422e904a394f31b6c3285f4ad79c30'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:04.420224 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9eac89-5c7b-4938-a4c2-6c9492d1cfff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:04.420953 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9eac89-5c7b-4938-a4c2-6c9492d1cfff admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:04.421238 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9eac89-5c7b-4938-a4c2-6c9492d1cfff admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:04.421517 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9eac89-5c7b-4938-a4c2-6c9492d1cfff admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:04.422255 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9eac89-5c7b-4938-a4c2-6c9492d1cfff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:04.425018 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9eac89-5c7b-4938-a4c2-6c9492d1cfff admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:04.428542 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-c46886d3-47ca-4d45-afcf-1190b8331fdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af422e904a394f31b6c3285f4ad79c30'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:04.440839 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1104/2195] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:52:04 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:52:04.441859 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9eac89-5c7b-4938-a4c2-6c9492d1cfff admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:04.442868 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1091/2195] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 16:52:03 2022] DELETE /identity/v3/users/af422e904a394f31b6c3285f4ad79c30 => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:04.443924 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-fd9eac89-5c7b-4938-a4c2-6c9492d1cfff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:04.458435 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9eac89-5c7b-4938-a4c2-6c9492d1cfff admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:04.614756 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6dd44b-c30c-479b-8926-5bc54cdcfbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:04.615826 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6dd44b-c30c-479b-8926-5bc54cdcfbf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:04.616255 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6dd44b-c30c-479b-8926-5bc54cdcfbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:04.616634 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6dd44b-c30c-479b-8926-5bc54cdcfbf3 admin admin] PATH_INFO: `/v3/projects/ecd3a006ce0c49df99041dd5e7421825/users/eff913aa16b340eeb8b39253b57be4c0/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:04.642794 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6dd44b-c30c-479b-8926-5bc54cdcfbf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecd3a006ce0c49df99041dd5e7421825, user_id=eff913aa16b340eeb8b39253b57be4c0, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:04.645695 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6dd44b-c30c-479b-8926-5bc54cdcfbf3 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:04.812831 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1105/2196] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:52:04 2022] PUT /identity/v3/projects/ecd3a006ce0c49df99041dd5e7421825/users/eff913aa16b340eeb8b39253b57be4c0/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:04.816822 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46886d3-47ca-4d45-afcf-1190b8331fdf admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:04.829349 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46886d3-47ca-4d45-afcf-1190b8331fdf admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:04.892903 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60499c0-229a-475a-a07d-0e85bfe6eb48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:04.893495 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60499c0-229a-475a-a07d-0e85bfe6eb48 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:04.893778 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60499c0-229a-475a-a07d-0e85bfe6eb48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:04.894055 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60499c0-229a-475a-a07d-0e85bfe6eb48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:04.894880 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60499c0-229a-475a-a07d-0e85bfe6eb48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:04.896512 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60499c0-229a-475a-a07d-0e85bfe6eb48 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:04.909301 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1092/2197] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:52:04 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:52:04.913152 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6dd44b-c30c-479b-8926-5bc54cdcfbf3 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:04.926817 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6dd44b-c30c-479b-8926-5bc54cdcfbf3 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:04.930705 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60499c0-229a-475a-a07d-0e85bfe6eb48 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:04.933076 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-a60499c0-229a-475a-a07d-0e85bfe6eb48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:04.940198 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4b779-eacd-45a9-ac57-8cbcdbd66aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:04.941108 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4b779-eacd-45a9-ac57-8cbcdbd66aca admin admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:04.941390 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4b779-eacd-45a9-ac57-8cbcdbd66aca admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:04.941842 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4b779-eacd-45a9-ac57-8cbcdbd66aca admin admin] PATH_INFO: `/v3/projects/ecd3a006ce0c49df99041dd5e7421825/users/eff913aa16b340eeb8b39253b57be4c0/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:04.944945 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a4b779-eacd-45a9-ac57-8cbcdbd66aca admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecd3a006ce0c49df99041dd5e7421825, user_id=eff913aa16b340eeb8b39253b57be4c0, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:04.948255 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a4b779-eacd-45a9-ac57-8cbcdbd66aca admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:04.949712 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60499c0-229a-475a-a07d-0e85bfe6eb48 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:04.952698 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:04.960251 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d7b31e-928f-454c-a4b2-c15a407ca560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:04.961823 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1106/2198] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:52:04 2022] PUT /identity/v3/projects/ecd3a006ce0c49df99041dd5e7421825/users/eff913aa16b340eeb8b39253b57be4c0/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:04.961946 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d7b31e-928f-454c-a4b2-c15a407ca560 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:04.962044 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d7b31e-928f-454c-a4b2-c15a407ca560 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:04.962268 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d7b31e-928f-454c-a4b2-c15a407ca560 admin admin] PATH_INFO: `/v3/projects/eda2393d6f2f49cd8b19c79347385331` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:04.963674 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d7b31e-928f-454c-a4b2-c15a407ca560 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eda2393d6f2f49cd8b19c79347385331)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:04.965813 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d7b31e-928f-454c-a4b2-c15a407ca560 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:04.971979 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9ef85-c0a4-4271-ac36-af2e97704fb5 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:04.972272 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9ef85-c0a4-4271-ac36-af2e97704fb5 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:04.972556 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9ef85-c0a4-4271-ac36-af2e97704fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:05.017900 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-66b9ef85-c0a4-4271-ac36-af2e97704fb5 None None] MFA Rules not processed for user `eff913aa16b340eeb8b39253b57be4c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:05.021839 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-66b9ef85-c0a4-4271-ac36-af2e97704fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:05.104180 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1107/2199] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:52:04 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:52:05.116483 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b9ef85-c0a4-4271-ac36-af2e97704fb5 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:05.117977 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-66b9ef85-c0a4-4271-ac36-af2e97704fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:05.126172 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-e5d7b31e-928f-454c-a4b2-c15a407ca560 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eda2393d6f2f49cd8b19c79347385331', 'request_id': 'req-e5d7b31e-928f-454c-a4b2-c15a407ca560'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:05.182214 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b9ef85-c0a4-4271-ac36-af2e97704fb5 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:05.246096 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945aee1b-7859-45c1-a540-11e165664387 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:05.246784 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945aee1b-7859-45c1-a540-11e165664387 service cinder] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:05.247022 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945aee1b-7859-45c1-a540-11e165664387 service cinder] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:05.247300 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945aee1b-7859-45c1-a540-11e165664387 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:05.249177 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-945aee1b-7859-45c1-a540-11e165664387 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:05.251811 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-e5d7b31e-928f-454c-a4b2-c15a407ca560 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eda2393d6f2f49cd8b19c79347385331', 'request_id': 'req-e5d7b31e-928f-454c-a4b2-c15a407ca560'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:05.258677 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-e5d7b31e-928f-454c-a4b2-c15a407ca560 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eda2393d6f2f49cd8b19c79347385331', 'request_id': 'req-e5d7b31e-928f-454c-a4b2-c15a407ca560'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:05.271415 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-e5d7b31e-928f-454c-a4b2-c15a407ca560 admin admin] The token cache is being invalidate because project eda2393d6f2f49cd8b19c79347385331 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:52:05.271839 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-e5d7b31e-928f-454c-a4b2-c15a407ca560 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:05.272592 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-e5d7b31e-928f-454c-a4b2-c15a407ca560 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:05.274868 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1093/2200] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 16:52:04 2022] DELETE /identity/v3/projects/eda2393d6f2f49cd8b19c79347385331 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:05.278872 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d7b31e-928f-454c-a4b2-c15a407ca560 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:05.280384 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-e5d7b31e-928f-454c-a4b2-c15a407ca560 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:05.333959 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945aee1b-7859-45c1-a540-11e165664387 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:05.335659 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945aee1b-7859-45c1-a540-11e165664387 service cinder] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:05.345986 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1108/2201] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:52:05 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 16:52:05.358452 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d7b31e-928f-454c-a4b2-c15a407ca560 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:05.363518 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c2110e-0aa6-4b72-beb2-4773fbbe4a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:05.364464 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2110e-0aa6-4b72-beb2-4773fbbe4a7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:05.365039 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2110e-0aa6-4b72-beb2-4773fbbe4a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:05.365190 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2110e-0aa6-4b72-beb2-4773fbbe4a7e admin admin] PATH_INFO: `/v3/users/fe7394e622a44ebdb0a2e10276f3354a` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:05.366708 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c2110e-0aa6-4b72-beb2-4773fbbe4a7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe7394e622a44ebdb0a2e10276f3354a)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:05.369211 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c2110e-0aa6-4b72-beb2-4773fbbe4a7e admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:05.429295 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:05.640392 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-05c2110e-0aa6-4b72-beb2-4773fbbe4a7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe7394e622a44ebdb0a2e10276f3354a'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:05.641105 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-05c2110e-0aa6-4b72-beb2-4773fbbe4a7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe7394e622a44ebdb0a2e10276f3354a'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:05.658999 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-05c2110e-0aa6-4b72-beb2-4773fbbe4a7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe7394e622a44ebdb0a2e10276f3354a'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:05.764241 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-05c2110e-0aa6-4b72-beb2-4773fbbe4a7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe7394e622a44ebdb0a2e10276f3354a'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:05.773314 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-05c2110e-0aa6-4b72-beb2-4773fbbe4a7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe7394e622a44ebdb0a2e10276f3354a'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:05.784633 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1094/2202] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 16:52:05 2022] DELETE /identity/v3/users/fe7394e622a44ebdb0a2e10276f3354a => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:06.131213 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945aee1b-7859-45c1-a540-11e165664387 service cinder] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:06.149507 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945aee1b-7859-45c1-a540-11e165664387 service cinder] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:06.218389 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d47461-6f2f-49bb-9d26-b81d6d427375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:06.219459 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d47461-6f2f-49bb-9d26-b81d6d427375 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:06.219768 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d47461-6f2f-49bb-9d26-b81d6d427375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:06.220161 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d47461-6f2f-49bb-9d26-b81d6d427375 admin admin] PATH_INFO: `/v3/projects/6472cff744d84cf7b925701776b283b9` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:06.221588 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d47461-6f2f-49bb-9d26-b81d6d427375 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6472cff744d84cf7b925701776b283b9)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:06.223540 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d47461-6f2f-49bb-9d26-b81d6d427375 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:06.380167 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-e0d47461-6f2f-49bb-9d26-b81d6d427375 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6472cff744d84cf7b925701776b283b9', 'request_id': 'req-e0d47461-6f2f-49bb-9d26-b81d6d427375'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:06.387691 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-e0d47461-6f2f-49bb-9d26-b81d6d427375 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6472cff744d84cf7b925701776b283b9', 'request_id': 'req-e0d47461-6f2f-49bb-9d26-b81d6d427375'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:06.394976 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-e0d47461-6f2f-49bb-9d26-b81d6d427375 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6472cff744d84cf7b925701776b283b9', 'request_id': 'req-e0d47461-6f2f-49bb-9d26-b81d6d427375'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:06.611793 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-e0d47461-6f2f-49bb-9d26-b81d6d427375 admin admin] The token cache is being invalidate because project 6472cff744d84cf7b925701776b283b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:52:06.612035 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-e0d47461-6f2f-49bb-9d26-b81d6d427375 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:06.612857 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-e0d47461-6f2f-49bb-9d26-b81d6d427375 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:06.614318 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1109/2203] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 16:52:06 2022] DELETE /identity/v3/projects/6472cff744d84cf7b925701776b283b9 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:06.618025 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:06.620038 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28804aa-ccf2-425c-9125-316755380360 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:06.620492 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28804aa-ccf2-425c-9125-316755380360 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:06.620888 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28804aa-ccf2-425c-9125-316755380360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:06.640974 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-d28804aa-ccf2-425c-9125-316755380360 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:06.642274 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-d28804aa-ccf2-425c-9125-316755380360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:06.707437 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1095/2204] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:52:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:52:06.714817 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f54b4-59fa-465b-a45e-fb323c8deb21 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:06.715105 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f54b4-59fa-465b-a45e-fb323c8deb21 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:06.715366 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f54b4-59fa-465b-a45e-fb323c8deb21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:06.738104 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-2d4f54b4-59fa-465b-a45e-fb323c8deb21 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:06.739324 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-2d4f54b4-59fa-465b-a45e-fb323c8deb21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:06.748818 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1110/2205] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:52:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:52:06.754985 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28804aa-ccf2-425c-9125-316755380360 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:06.771129 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28804aa-ccf2-425c-9125-316755380360 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:06.776599 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f467cb1-a585-44e9-8280-3bbe4598e2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:06.777273 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f467cb1-a585-44e9-8280-3bbe4598e2d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:06.777554 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f467cb1-a585-44e9-8280-3bbe4598e2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:06.777832 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f467cb1-a585-44e9-8280-3bbe4598e2d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:06.778562 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f467cb1-a585-44e9-8280-3bbe4598e2d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:52:06.778868 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f467cb1-a585-44e9-8280-3bbe4598e2d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:06.780608 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f467cb1-a585-44e9-8280-3bbe4598e2d1 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:06.795753 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1096/2206] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Jul 18 16:52:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:52:06.799697 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f54b4-59fa-465b-a45e-fb323c8deb21 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:06.809405 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f54b4-59fa-465b-a45e-fb323c8deb21 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:06.814187 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8685df9-c802-490c-a71c-423bd2c670e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:06.814873 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8685df9-c802-490c-a71c-423bd2c670e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:06.815142 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8685df9-c802-490c-a71c-423bd2c670e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:06.815418 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8685df9-c802-490c-a71c-423bd2c670e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:06.816203 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8685df9-c802-490c-a71c-423bd2c670e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:06.818895 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8685df9-c802-490c-a71c-423bd2c670e4 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:06.923783 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1111/2207] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:52:06 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:52:06.932836 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f467cb1-a585-44e9-8280-3bbe4598e2d1 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:06.944294 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f467cb1-a585-44e9-8280-3bbe4598e2d1 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:07.023442 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6645c61-4af2-47ac-aa16-5852ebb84c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:07.024269 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6645c61-4af2-47ac-aa16-5852ebb84c44 admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:07.024622 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6645c61-4af2-47ac-aa16-5852ebb84c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:07.024988 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6645c61-4af2-47ac-aa16-5852ebb84c44 admin admin] PATH_INFO: `/v3/users` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:07.025694 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6645c61-4af2-47ac-aa16-5852ebb84c44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:07.027751 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6645c61-4af2-47ac-aa16-5852ebb84c44 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:07.127043 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1097/2208] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 16:52:06 2022] POST /identity/v3/users => generated 293 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:52:07.128875 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8685df9-c802-490c-a71c-423bd2c670e4 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:07.145051 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8685df9-c802-490c-a71c-423bd2c670e4 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:07.154979 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f9032-6fe7-4203-96a6-f47b066f0faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:07.156513 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f9032-6fe7-4203-96a6-f47b066f0faf admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:07.156513 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f9032-6fe7-4203-96a6-f47b066f0faf admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:07.156513 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f9032-6fe7-4203-96a6-f47b066f0faf admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:07.157211 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3f9032-6fe7-4203-96a6-f47b066f0faf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:07.159930 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3f9032-6fe7-4203-96a6-f47b066f0faf admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:07.172659 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1112/2209] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:52:07 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:52:07.176340 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6645c61-4af2-47ac-aa16-5852ebb84c44 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:07.190413 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6645c61-4af2-47ac-aa16-5852ebb84c44 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:07.203957 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c466e7a7-e5a6-4846-b6c2-f9bb46f928e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:07.204817 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466e7a7-e5a6-4846-b6c2-f9bb46f928e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:07.205105 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466e7a7-e5a6-4846-b6c2-f9bb46f928e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:07.205458 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466e7a7-e5a6-4846-b6c2-f9bb46f928e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:07.206287 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c466e7a7-e5a6-4846-b6c2-f9bb46f928e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:07.208201 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c466e7a7-e5a6-4846-b6c2-f9bb46f928e3 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:07.222681 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1098/2210] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:52:07 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:52:07.227644 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f9032-6fe7-4203-96a6-f47b066f0faf admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:07.243447 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f9032-6fe7-4203-96a6-f47b066f0faf admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:07.250207 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b25ee3-7ae9-427d-81f0-f0dfc2e097ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:07.251348 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b25ee3-7ae9-427d-81f0-f0dfc2e097ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:07.251703 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b25ee3-7ae9-427d-81f0-f0dfc2e097ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:07.252014 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b25ee3-7ae9-427d-81f0-f0dfc2e097ac admin admin] PATH_INFO: `/v3/projects/114624d1e8e243eaad51536bca67d5a2/users/7c25f4db3bc041f495e157e88261206e/roles/ad3a2bc7b2094a4da1a95a143c8d9436` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:07.277706 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b25ee3-7ae9-427d-81f0-f0dfc2e097ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=114624d1e8e243eaad51536bca67d5a2, user_id=7c25f4db3bc041f495e157e88261206e, role_id=ad3a2bc7b2094a4da1a95a143c8d9436)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:07.290252 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b25ee3-7ae9-427d-81f0-f0dfc2e097ac admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:07.292315 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:07.379824 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1113/2211] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:52:07 2022] PUT /identity/v3/projects/114624d1e8e243eaad51536bca67d5a2/users/7c25f4db3bc041f495e157e88261206e/roles/ad3a2bc7b2094a4da1a95a143c8d9436 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:52:07.391003 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66116465-7789-40d5-aeaf-35f0c2d841b9 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:07.391324 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66116465-7789-40d5-aeaf-35f0c2d841b9 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:07.391753 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66116465-7789-40d5-aeaf-35f0c2d841b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:07.445070 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-66116465-7789-40d5-aeaf-35f0c2d841b9 None None] MFA Rules not processed for user `7c25f4db3bc041f495e157e88261206e`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:07.446510 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-66116465-7789-40d5-aeaf-35f0c2d841b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:07.535207 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1099/2212] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:52:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:52:07.548746 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b25ee3-7ae9-427d-81f0-f0dfc2e097ac admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:07.550349 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-b3b25ee3-7ae9-427d-81f0-f0dfc2e097ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:07.587420 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:07.615246 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b25ee3-7ae9-427d-81f0-f0dfc2e097ac admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:07.619521 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da28435-159e-4fe8-9efe-ca902db153a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:07.620537 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da28435-159e-4fe8-9efe-ca902db153a4 service cinder] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:07.620537 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da28435-159e-4fe8-9efe-ca902db153a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:07.620725 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da28435-159e-4fe8-9efe-ca902db153a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:07.629930 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da28435-159e-4fe8-9efe-ca902db153a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:07.631609 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da28435-159e-4fe8-9efe-ca902db153a4 service cinder] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:07.643284 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1114/2213] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:52:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:52:08.636959 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66116465-7789-40d5-aeaf-35f0c2d841b9 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:08.641842 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-66116465-7789-40d5-aeaf-35f0c2d841b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:08.657710 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66116465-7789-40d5-aeaf-35f0c2d841b9 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:08.661814 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b66e91-bc62-4be1-8163-a113065b1913 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:08.662468 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b66e91-bc62-4be1-8163-a113065b1913 service cinder] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:08.662745 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b66e91-bc62-4be1-8163-a113065b1913 service cinder] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:08.663014 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b66e91-bc62-4be1-8163-a113065b1913 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:08.666236 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-51b66e91-bc62-4be1-8163-a113065b1913 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:08.793163 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b66e91-bc62-4be1-8163-a113065b1913 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:08.794554 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b66e91-bc62-4be1-8163-a113065b1913 service cinder] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:08.815910 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1100/2214] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:52:08 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:52:09.069345 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:09.131795 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:09.717751 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:10.557943 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:11.723393 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:11.880641 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:13.282259 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:13.749698 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:14.663572 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da28435-159e-4fe8-9efe-ca902db153a4 service cinder] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:14.667059 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-0da28435-159e-4fe8-9efe-ca902db153a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:14.741546 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da28435-159e-4fe8-9efe-ca902db153a4 service cinder] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:14.747262 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92544791-eeeb-4266-954a-565937dd61e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:14.748175 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92544791-eeeb-4266-954a-565937dd61e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:14.748457 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92544791-eeeb-4266-954a-565937dd61e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:14.748745 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92544791-eeeb-4266-954a-565937dd61e3 admin admin] PATH_INFO: `/v3/users/88caf872c0d142b69a9e7b5921b5ab65` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:14.751359 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92544791-eeeb-4266-954a-565937dd61e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88caf872c0d142b69a9e7b5921b5ab65)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:14.756647 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92544791-eeeb-4266-954a-565937dd61e3 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:14.834813 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:15.063439 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-92544791-eeeb-4266-954a-565937dd61e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88caf872c0d142b69a9e7b5921b5ab65'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:15.076444 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-92544791-eeeb-4266-954a-565937dd61e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88caf872c0d142b69a9e7b5921b5ab65'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:15.077196 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-92544791-eeeb-4266-954a-565937dd61e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88caf872c0d142b69a9e7b5921b5ab65'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:15.084750 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-92544791-eeeb-4266-954a-565937dd61e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88caf872c0d142b69a9e7b5921b5ab65'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:15.189101 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-92544791-eeeb-4266-954a-565937dd61e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88caf872c0d142b69a9e7b5921b5ab65'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:15.196309 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1115/2215] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 16:52:14 2022] DELETE /identity/v3/users/88caf872c0d142b69a9e7b5921b5ab65 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:15.200963 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ad555-27ca-4db0-80d3-afd3ae8ab32b None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:15.201247 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ad555-27ca-4db0-80d3-afd3ae8ab32b None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:15.201529 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ad555-27ca-4db0-80d3-afd3ae8ab32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:15.220353 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-ff8ad555-27ca-4db0-80d3-afd3ae8ab32b None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:15.221574 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-ff8ad555-27ca-4db0-80d3-afd3ae8ab32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:15.286773 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1101/2216] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:52:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:52:15.297519 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92544791-eeeb-4266-954a-565937dd61e3 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:15.299130 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-92544791-eeeb-4266-954a-565937dd61e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:15.366826 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92544791-eeeb-4266-954a-565937dd61e3 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:15.371716 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88453270-0826-4996-b27a-e267fec6e7c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:15.372395 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88453270-0826-4996-b27a-e267fec6e7c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:15.372718 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88453270-0826-4996-b27a-e267fec6e7c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:15.372976 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88453270-0826-4996-b27a-e267fec6e7c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:15.393000 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88453270-0826-4996-b27a-e267fec6e7c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:15.395348 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88453270-0826-4996-b27a-e267fec6e7c3 service neutron] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:15.406821 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1116/2217] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:52:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:52:15.891484 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8ad555-27ca-4db0-80d3-afd3ae8ab32b None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:15.893112 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-ff8ad555-27ca-4db0-80d3-afd3ae8ab32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:15.916021 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8ad555-27ca-4db0-80d3-afd3ae8ab32b None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:15.932294 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f505edf2-0920-40a5-b92e-46e64c65700b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:15.933168 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f505edf2-0920-40a5-b92e-46e64c65700b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:15.933454 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f505edf2-0920-40a5-b92e-46e64c65700b admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:15.933729 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f505edf2-0920-40a5-b92e-46e64c65700b admin admin] PATH_INFO: `/v3/projects/921f7a70b01646c49f9f960316a18deb` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:15.934941 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f505edf2-0920-40a5-b92e-46e64c65700b admin admin] RBAC: Authorizing `identity:delete_project(project_id=921f7a70b01646c49f9f960316a18deb)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:15.936921 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f505edf2-0920-40a5-b92e-46e64c65700b admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:16.156002 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-f505edf2-0920-40a5-b92e-46e64c65700b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '921f7a70b01646c49f9f960316a18deb', 'request_id': 'req-f505edf2-0920-40a5-b92e-46e64c65700b'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:16.234411 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-f505edf2-0920-40a5-b92e-46e64c65700b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '921f7a70b01646c49f9f960316a18deb', 'request_id': 'req-f505edf2-0920-40a5-b92e-46e64c65700b'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:16.240747 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-f505edf2-0920-40a5-b92e-46e64c65700b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '921f7a70b01646c49f9f960316a18deb', 'request_id': 'req-f505edf2-0920-40a5-b92e-46e64c65700b'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:16.252548 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-f505edf2-0920-40a5-b92e-46e64c65700b admin admin] The token cache is being invalidate because project 921f7a70b01646c49f9f960316a18deb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:52:16.253198 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-f505edf2-0920-40a5-b92e-46e64c65700b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:16.253872 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-f505edf2-0920-40a5-b92e-46e64c65700b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:16.255490 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1102/2218] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 16:52:15 2022] DELETE /identity/v3/projects/921f7a70b01646c49f9f960316a18deb => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:16.260256 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88453270-0826-4996-b27a-e267fec6e7c3 service neutron] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:16.270590 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88453270-0826-4996-b27a-e267fec6e7c3 service neutron] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:16.327687 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2515dd-b115-40c3-9a3d-3959db16f2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:16.328601 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2515dd-b115-40c3-9a3d-3959db16f2b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:16.328892 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2515dd-b115-40c3-9a3d-3959db16f2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:16.329168 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2515dd-b115-40c3-9a3d-3959db16f2b3 admin admin] PATH_INFO: `/v3/users/eff913aa16b340eeb8b39253b57be4c0` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:16.330415 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2515dd-b115-40c3-9a3d-3959db16f2b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eff913aa16b340eeb8b39253b57be4c0)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:16.332411 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2515dd-b115-40c3-9a3d-3959db16f2b3 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:16.580593 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-0e2515dd-b115-40c3-9a3d-3959db16f2b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eff913aa16b340eeb8b39253b57be4c0'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:16.593830 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-0e2515dd-b115-40c3-9a3d-3959db16f2b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eff913aa16b340eeb8b39253b57be4c0'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:16.594362 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-0e2515dd-b115-40c3-9a3d-3959db16f2b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eff913aa16b340eeb8b39253b57be4c0'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:16.602053 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-0e2515dd-b115-40c3-9a3d-3959db16f2b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eff913aa16b340eeb8b39253b57be4c0'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:16.691917 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-0e2515dd-b115-40c3-9a3d-3959db16f2b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eff913aa16b340eeb8b39253b57be4c0'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:16.699108 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1117/2219] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 16:52:16 2022] DELETE /identity/v3/users/eff913aa16b340eeb8b39253b57be4c0 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:17.371342 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f505edf2-0920-40a5-b92e-46e64c65700b admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:17.372883 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-f505edf2-0920-40a5-b92e-46e64c65700b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:17.386460 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f505edf2-0920-40a5-b92e-46e64c65700b admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:17.458712 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddb40d8-14dd-421e-a895-028bcff8658c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:17.460939 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb40d8-14dd-421e-a895-028bcff8658c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:17.460939 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb40d8-14dd-421e-a895-028bcff8658c admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:17.460939 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb40d8-14dd-421e-a895-028bcff8658c admin admin] PATH_INFO: `/v3/projects/ecd3a006ce0c49df99041dd5e7421825` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:17.461752 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddb40d8-14dd-421e-a895-028bcff8658c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecd3a006ce0c49df99041dd5e7421825)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:17.464220 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddb40d8-14dd-421e-a895-028bcff8658c admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:17.631281 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-1ddb40d8-14dd-421e-a895-028bcff8658c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecd3a006ce0c49df99041dd5e7421825', 'request_id': 'req-1ddb40d8-14dd-421e-a895-028bcff8658c'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:17.707126 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-1ddb40d8-14dd-421e-a895-028bcff8658c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecd3a006ce0c49df99041dd5e7421825', 'request_id': 'req-1ddb40d8-14dd-421e-a895-028bcff8658c'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:17.708239 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:17.714398 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-1ddb40d8-14dd-421e-a895-028bcff8658c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecd3a006ce0c49df99041dd5e7421825', 'request_id': 'req-1ddb40d8-14dd-421e-a895-028bcff8658c'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:17.728060 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-1ddb40d8-14dd-421e-a895-028bcff8658c admin admin] The token cache is being invalidate because project ecd3a006ce0c49df99041dd5e7421825 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:52:17.729354 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-1ddb40d8-14dd-421e-a895-028bcff8658c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:17.729354 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-1ddb40d8-14dd-421e-a895-028bcff8658c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:17.730881 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1103/2220] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 16:52:17 2022] DELETE /identity/v3/projects/ecd3a006ce0c49df99041dd5e7421825 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:17.735770 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75204c11-7d8e-40b7-ad69-791644122e0e None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:17.736271 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75204c11-7d8e-40b7-ad69-791644122e0e None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:17.736547 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75204c11-7d8e-40b7-ad69-791644122e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:17.757993 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-75204c11-7d8e-40b7-ad69-791644122e0e None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:17.760102 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-75204c11-7d8e-40b7-ad69-791644122e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:17.822765 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1118/2221] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:52:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:52:17.831646 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89233da8-e508-461c-8336-dd6bdc09819d None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:17.831970 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89233da8-e508-461c-8336-dd6bdc09819d None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:17.832245 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89233da8-e508-461c-8336-dd6bdc09819d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:17.854470 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-89233da8-e508-461c-8336-dd6bdc09819d None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:17.855689 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-89233da8-e508-461c-8336-dd6bdc09819d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:17.864153 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1104/2222] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:52:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:52:17.868591 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75204c11-7d8e-40b7-ad69-791644122e0e None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:17.878681 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75204c11-7d8e-40b7-ad69-791644122e0e None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:17.884995 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486de748-1805-44a8-b6f2-0b2fa4295e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:17.885697 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486de748-1805-44a8-b6f2-0b2fa4295e89 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:17.886061 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486de748-1805-44a8-b6f2-0b2fa4295e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:17.886409 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486de748-1805-44a8-b6f2-0b2fa4295e89 admin admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:17.887220 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486de748-1805-44a8-b6f2-0b2fa4295e89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:52:17.887662 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486de748-1805-44a8-b6f2-0b2fa4295e89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:17.889348 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486de748-1805-44a8-b6f2-0b2fa4295e89 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:17.903039 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1119/2223] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Jul 18 16:52:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:52:17.907809 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89233da8-e508-461c-8336-dd6bdc09819d None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:17.919698 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89233da8-e508-461c-8336-dd6bdc09819d None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:17.925954 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce3866-0c07-4470-94c5-c60f5a57825c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:17.926757 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce3866-0c07-4470-94c5-c60f5a57825c admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:17.927221 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce3866-0c07-4470-94c5-c60f5a57825c admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:17.927483 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce3866-0c07-4470-94c5-c60f5a57825c admin admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:17.928305 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ce3866-0c07-4470-94c5-c60f5a57825c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:17.930502 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ce3866-0c07-4470-94c5-c60f5a57825c admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:18.139933 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1105/2224] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:52:17 2022] POST /identity/v3/projects => generated 387 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:52:18.144121 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486de748-1805-44a8-b6f2-0b2fa4295e89 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:18.155563 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486de748-1805-44a8-b6f2-0b2fa4295e89 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:18.225543 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019e097-7f3c-466b-8386-bd7bf39d33f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:18.226379 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019e097-7f3c-466b-8386-bd7bf39d33f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:18.227242 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019e097-7f3c-466b-8386-bd7bf39d33f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:18.227920 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019e097-7f3c-466b-8386-bd7bf39d33f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:18.228796 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f019e097-7f3c-466b-8386-bd7bf39d33f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:18.230795 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f019e097-7f3c-466b-8386-bd7bf39d33f0 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:18.389857 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1120/2225] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 16:52:18 2022] POST /identity/v3/users => generated 294 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:52:18.394812 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce3866-0c07-4470-94c5-c60f5a57825c admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:18.405451 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce3866-0c07-4470-94c5-c60f5a57825c admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:18.410457 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d50fdc2-d5f5-4f03-9110-4ea3256b5137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:18.411376 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50fdc2-d5f5-4f03-9110-4ea3256b5137 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:18.411819 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50fdc2-d5f5-4f03-9110-4ea3256b5137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:18.412204 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50fdc2-d5f5-4f03-9110-4ea3256b5137 admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:18.413049 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d50fdc2-d5f5-4f03-9110-4ea3256b5137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:18.415253 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d50fdc2-d5f5-4f03-9110-4ea3256b5137 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:18.424757 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:18.432100 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1106/2226] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:52:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:52:18.436352 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019e097-7f3c-466b-8386-bd7bf39d33f0 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:18.448407 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019e097-7f3c-466b-8386-bd7bf39d33f0 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:18.453451 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe6dec-335d-467a-b899-c27ff87e0d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:18.454486 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe6dec-335d-467a-b899-c27ff87e0d28 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:18.454668 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe6dec-335d-467a-b899-c27ff87e0d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:18.454951 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe6dec-335d-467a-b899-c27ff87e0d28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:18.455694 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fe6dec-335d-467a-b899-c27ff87e0d28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:18.457348 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fe6dec-335d-467a-b899-c27ff87e0d28 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:18.468487 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1121/2227] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:52:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 16:52:18.475988 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d50fdc2-d5f5-4f03-9110-4ea3256b5137 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:18.486512 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d50fdc2-d5f5-4f03-9110-4ea3256b5137 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:18.491361 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9669f03f-197a-4bec-a900-5ff2ba67d2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:18.492913 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9669f03f-197a-4bec-a900-5ff2ba67d2c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:18.493115 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9669f03f-197a-4bec-a900-5ff2ba67d2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:18.493338 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9669f03f-197a-4bec-a900-5ff2ba67d2c1 admin admin] PATH_INFO: `/v3/projects/990ae1d61a2f43f2a8346fa1a8e3cd8a/users/7285cb16d63748f98d5194336df99759/roles/ad3a2bc7b2094a4da1a95a143c8d9436` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:18.508696 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9669f03f-197a-4bec-a900-5ff2ba67d2c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=990ae1d61a2f43f2a8346fa1a8e3cd8a, user_id=7285cb16d63748f98d5194336df99759, role_id=ad3a2bc7b2094a4da1a95a143c8d9436)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:18.511355 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9669f03f-197a-4bec-a900-5ff2ba67d2c1 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:18.596655 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1107/2228] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:52:18 2022] PUT /identity/v3/projects/990ae1d61a2f43f2a8346fa1a8e3cd8a/users/7285cb16d63748f98d5194336df99759/roles/ad3a2bc7b2094a4da1a95a143c8d9436 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:52:18.607660 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b49712-7164-4ee7-8b1b-95053fed89f9 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:18.607989 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b49712-7164-4ee7-8b1b-95053fed89f9 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:18.608276 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b49712-7164-4ee7-8b1b-95053fed89f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:18.646205 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-92b49712-7164-4ee7-8b1b-95053fed89f9 None None] MFA Rules not processed for user `7285cb16d63748f98d5194336df99759`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:18.647432 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-92b49712-7164-4ee7-8b1b-95053fed89f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:18.730149 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1122/2229] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:52:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:52:18.734718 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9669f03f-197a-4bec-a900-5ff2ba67d2c1 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:18.810326 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9669f03f-197a-4bec-a900-5ff2ba67d2c1 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:18.816084 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e413e207-0d9a-4d56-965a-9989f75e6864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:18.816930 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e413e207-0d9a-4d56-965a-9989f75e6864 admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:18.817219 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e413e207-0d9a-4d56-965a-9989f75e6864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:18.817502 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e413e207-0d9a-4d56-965a-9989f75e6864 admin admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:18.818228 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e413e207-0d9a-4d56-965a-9989f75e6864 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:18.820313 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e413e207-0d9a-4d56-965a-9989f75e6864 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:18.936402 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b49712-7164-4ee7-8b1b-95053fed89f9 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:18.937957 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-92b49712-7164-4ee7-8b1b-95053fed89f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:18.954187 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b49712-7164-4ee7-8b1b-95053fed89f9 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:18.957019 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1108/2230] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:52:18 2022] POST /identity/v3/projects => generated 385 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:52:18.965333 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e413e207-0d9a-4d56-965a-9989f75e6864 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:19.063555 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8627c454-342b-4d5e-b678-a3d425fb5302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:19.064840 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627c454-342b-4d5e-b678-a3d425fb5302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:19.065374 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627c454-342b-4d5e-b678-a3d425fb5302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:19.067288 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627c454-342b-4d5e-b678-a3d425fb5302 admin admin] PATH_INFO: `/v3/users/7c25f4db3bc041f495e157e88261206e` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:19.070233 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8627c454-342b-4d5e-b678-a3d425fb5302 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c25f4db3bc041f495e157e88261206e)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:19.072509 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8627c454-342b-4d5e-b678-a3d425fb5302 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:19.095736 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e413e207-0d9a-4d56-965a-9989f75e6864 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:19.110641 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f0ab5d-3127-481c-9a37-d1ad1a548723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:19.111333 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0ab5d-3127-481c-9a37-d1ad1a548723 admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:19.111619 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0ab5d-3127-481c-9a37-d1ad1a548723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:19.111971 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0ab5d-3127-481c-9a37-d1ad1a548723 admin admin] PATH_INFO: `/v3/users` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:19.112695 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f0ab5d-3127-481c-9a37-d1ad1a548723 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:19.115106 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f0ab5d-3127-481c-9a37-d1ad1a548723 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:19.393636 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1109/2231] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 16:52:18 2022] POST /identity/v3/users => generated 299 bytes in 429 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:52:19.394706 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f0ab5d-3127-481c-9a37-d1ad1a548723 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:19.405865 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f0ab5d-3127-481c-9a37-d1ad1a548723 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:19.412151 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edec4fe-df4b-4319-95e9-328b7ccfa4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:19.413027 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edec4fe-df4b-4319-95e9-328b7ccfa4f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:19.413370 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edec4fe-df4b-4319-95e9-328b7ccfa4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:19.413645 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edec4fe-df4b-4319-95e9-328b7ccfa4f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:19.415012 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edec4fe-df4b-4319-95e9-328b7ccfa4f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:19.416695 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edec4fe-df4b-4319-95e9-328b7ccfa4f0 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:19.430199 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1110/2232] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:52:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:52:19.434967 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edec4fe-df4b-4319-95e9-328b7ccfa4f0 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:19.447845 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edec4fe-df4b-4319-95e9-328b7ccfa4f0 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:19.453000 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50244808-eae5-47d2-bd29-ddc0c3846ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:19.454081 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50244808-eae5-47d2-bd29-ddc0c3846ddd admin admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:19.454363 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50244808-eae5-47d2-bd29-ddc0c3846ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:19.454638 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50244808-eae5-47d2-bd29-ddc0c3846ddd admin admin] PATH_INFO: `/v3/projects/b96805e02d6742c8b33b57e082a755f3/users/681508dbe73c4488b48530dcbe1ddd49/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:19.492560 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50244808-eae5-47d2-bd29-ddc0c3846ddd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b96805e02d6742c8b33b57e082a755f3, user_id=681508dbe73c4488b48530dcbe1ddd49, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:19.496545 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50244808-eae5-47d2-bd29-ddc0c3846ddd admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:19.566384 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-8627c454-342b-4d5e-b678-a3d425fb5302 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c25f4db3bc041f495e157e88261206e'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:19.581590 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-8627c454-342b-4d5e-b678-a3d425fb5302 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c25f4db3bc041f495e157e88261206e'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:19.583509 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-8627c454-342b-4d5e-b678-a3d425fb5302 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c25f4db3bc041f495e157e88261206e'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:19.613191 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-8627c454-342b-4d5e-b678-a3d425fb5302 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c25f4db3bc041f495e157e88261206e'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:19.653238 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1111/2233] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:52:19 2022] PUT /identity/v3/projects/b96805e02d6742c8b33b57e082a755f3/users/681508dbe73c4488b48530dcbe1ddd49/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:19.663113 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50244808-eae5-47d2-bd29-ddc0c3846ddd admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:19.723502 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-8627c454-342b-4d5e-b678-a3d425fb5302 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c25f4db3bc041f495e157e88261206e'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:19.732029 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1123/2234] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 16:52:18 2022] DELETE /identity/v3/users/7c25f4db3bc041f495e157e88261206e => generated 0 bytes in 796 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:52:19.743841 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3345a-c0c8-4487-958d-a81a06e6eff4 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:19.744387 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3345a-c0c8-4487-958d-a81a06e6eff4 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:19.744823 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3345a-c0c8-4487-958d-a81a06e6eff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:19.749802 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50244808-eae5-47d2-bd29-ddc0c3846ddd admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:19.771191 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-13a3345a-c0c8-4487-958d-a81a06e6eff4 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:19.773937 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-13a3345a-c0c8-4487-958d-a81a06e6eff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:19.826487 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0603ea42-745f-42ff-8d1c-ed86fd29c246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:19.827468 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0603ea42-745f-42ff-8d1c-ed86fd29c246 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:19.827822 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0603ea42-745f-42ff-8d1c-ed86fd29c246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:19.828104 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0603ea42-745f-42ff-8d1c-ed86fd29c246 admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:19.828851 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0603ea42-745f-42ff-8d1c-ed86fd29c246 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:19.831007 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0603ea42-745f-42ff-8d1c-ed86fd29c246 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:19.848270 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1124/2235] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:52:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:52:19.856903 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1112/2236] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:52:19 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 16:52:19.858181 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a3345a-c0c8-4487-958d-a81a06e6eff4 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:19.858671 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0603ea42-745f-42ff-8d1c-ed86fd29c246 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:19.859847 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-13a3345a-c0c8-4487-958d-a81a06e6eff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:19.861553 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-0603ea42-745f-42ff-8d1c-ed86fd29c246 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:19.873038 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a3345a-c0c8-4487-958d-a81a06e6eff4 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:19.878457 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad3cc19-d8dc-4342-a514-f995f51597e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:19.879601 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3cc19-d8dc-4342-a514-f995f51597e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:19.879962 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3cc19-d8dc-4342-a514-f995f51597e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:19.880240 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3cc19-d8dc-4342-a514-f995f51597e1 admin admin] PATH_INFO: `/v3/projects/b96805e02d6742c8b33b57e082a755f3/users/681508dbe73c4488b48530dcbe1ddd49/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:19.882424 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad3cc19-d8dc-4342-a514-f995f51597e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b96805e02d6742c8b33b57e082a755f3, user_id=681508dbe73c4488b48530dcbe1ddd49, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:19.885354 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad3cc19-d8dc-4342-a514-f995f51597e1 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:19.901639 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1125/2237] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:52:19 2022] PUT /identity/v3/projects/b96805e02d6742c8b33b57e082a755f3/users/681508dbe73c4488b48530dcbe1ddd49/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:19.920669 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb47714-cca3-44b1-8bd5-b71a258f9a46 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:19.920999 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb47714-cca3-44b1-8bd5-b71a258f9a46 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:19.921351 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb47714-cca3-44b1-8bd5-b71a258f9a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:19.962266 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0603ea42-745f-42ff-8d1c-ed86fd29c246 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:19.962913 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-3eb47714-cca3-44b1-8bd5-b71a258f9a46 None None] MFA Rules not processed for user `681508dbe73c4488b48530dcbe1ddd49`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:19.966239 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-3eb47714-cca3-44b1-8bd5-b71a258f9a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:20.019871 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:20.073398 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1126/2238] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:52:19 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:52:20.089515 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb47714-cca3-44b1-8bd5-b71a258f9a46 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:20.092599 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3879109-96e0-43bf-87a0-a09e2ae5ae3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:20.093428 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3879109-96e0-43bf-87a0-a09e2ae5ae3b service neutron] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:20.093721 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3879109-96e0-43bf-87a0-a09e2ae5ae3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:20.094002 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3879109-96e0-43bf-87a0-a09e2ae5ae3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:20.098720 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-3eb47714-cca3-44b1-8bd5-b71a258f9a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:20.198009 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3879109-96e0-43bf-87a0-a09e2ae5ae3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:20.200091 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3879109-96e0-43bf-87a0-a09e2ae5ae3b service neutron] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:20.215389 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1113/2239] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:52:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:52:20.239863 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb47714-cca3-44b1-8bd5-b71a258f9a46 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:20.251982 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0f2559-2a58-4c67-a262-e46979b6d584 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:20.252670 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f2559-2a58-4c67-a262-e46979b6d584 service cinder] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:20.253224 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f2559-2a58-4c67-a262-e46979b6d584 service cinder] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:20.253548 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f2559-2a58-4c67-a262-e46979b6d584 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:20.266966 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0f2559-2a58-4c67-a262-e46979b6d584 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:20.270743 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0f2559-2a58-4c67-a262-e46979b6d584 service cinder] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:20.285735 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1127/2240] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:52:20 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:52:20.366000 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3879109-96e0-43bf-87a0-a09e2ae5ae3b service neutron] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:20.379471 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3879109-96e0-43bf-87a0-a09e2ae5ae3b service neutron] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:20.386407 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ed37de-8908-489b-95e0-ccad5d01200c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:20.387363 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed37de-8908-489b-95e0-ccad5d01200c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:20.387653 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed37de-8908-489b-95e0-ccad5d01200c admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:20.387975 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed37de-8908-489b-95e0-ccad5d01200c admin admin] PATH_INFO: `/v3/users/7285cb16d63748f98d5194336df99759` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:20.389194 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ed37de-8908-489b-95e0-ccad5d01200c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7285cb16d63748f98d5194336df99759)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:20.391507 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ed37de-8908-489b-95e0-ccad5d01200c admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:20.481763 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50dedef-2424-4dfa-80f0-bc6710298f91 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:20.482369 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50dedef-2424-4dfa-80f0-bc6710298f91 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:20.482866 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50dedef-2424-4dfa-80f0-bc6710298f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:20.505158 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-f50dedef-2424-4dfa-80f0-bc6710298f91 None None] MFA Rules not processed for user `0f292cde7f7142f08e961a3d20d76b31`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:20.506726 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-f50dedef-2424-4dfa-80f0-bc6710298f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:20.572647 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1128/2241] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:52:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:52:20.616013 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-33ed37de-8908-489b-95e0-ccad5d01200c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7285cb16d63748f98d5194336df99759'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:20.622344 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-33ed37de-8908-489b-95e0-ccad5d01200c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7285cb16d63748f98d5194336df99759'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:20.665059 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-33ed37de-8908-489b-95e0-ccad5d01200c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7285cb16d63748f98d5194336df99759'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:20.843112 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-33ed37de-8908-489b-95e0-ccad5d01200c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7285cb16d63748f98d5194336df99759'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:20.859806 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-33ed37de-8908-489b-95e0-ccad5d01200c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7285cb16d63748f98d5194336df99759'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:20.874382 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1114/2242] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 16:52:20 2022] DELETE /identity/v3/users/7285cb16d63748f98d5194336df99759 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:20.879035 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ebd3fd-d2e8-4898-8918-1532d877a4b0 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:20.879485 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ebd3fd-d2e8-4898-8918-1532d877a4b0 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:20.879933 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ebd3fd-d2e8-4898-8918-1532d877a4b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:20.926072 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-29ebd3fd-d2e8-4898-8918-1532d877a4b0 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:20.928162 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-29ebd3fd-d2e8-4898-8918-1532d877a4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:21.045458 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1129/2243] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:52:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:52:21.058922 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ed37de-8908-489b-95e0-ccad5d01200c admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:21.061612 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-33ed37de-8908-489b-95e0-ccad5d01200c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:21.138581 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ed37de-8908-489b-95e0-ccad5d01200c admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:21.143339 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873f2993-ef50-4e03-bf89-c8aaf6d41a86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:21.144045 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f2993-ef50-4e03-bf89-c8aaf6d41a86 service neutron] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:21.144333 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f2993-ef50-4e03-bf89-c8aaf6d41a86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:21.144827 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f2993-ef50-4e03-bf89-c8aaf6d41a86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:21.156507 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873f2993-ef50-4e03-bf89-c8aaf6d41a86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:21.158927 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873f2993-ef50-4e03-bf89-c8aaf6d41a86 service neutron] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:21.171005 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1115/2244] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:52:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:52:21.293420 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ebd3fd-d2e8-4898-8918-1532d877a4b0 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:21.295121 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-29ebd3fd-d2e8-4898-8918-1532d877a4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:21.309663 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ebd3fd-d2e8-4898-8918-1532d877a4b0 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:21.315699 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b6a3ad-06b0-4386-b98f-e9f49ed33825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:21.316749 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6a3ad-06b0-4386-b98f-e9f49ed33825 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:21.317145 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6a3ad-06b0-4386-b98f-e9f49ed33825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:21.317527 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6a3ad-06b0-4386-b98f-e9f49ed33825 admin admin] PATH_INFO: `/v3/projects/114624d1e8e243eaad51536bca67d5a2` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:21.318984 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b6a3ad-06b0-4386-b98f-e9f49ed33825 admin admin] RBAC: Authorizing `identity:delete_project(project_id=114624d1e8e243eaad51536bca67d5a2)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:21.321242 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b6a3ad-06b0-4386-b98f-e9f49ed33825 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:21.487370 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-96b6a3ad-06b0-4386-b98f-e9f49ed33825 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '114624d1e8e243eaad51536bca67d5a2', 'request_id': 'req-96b6a3ad-06b0-4386-b98f-e9f49ed33825'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:21.494251 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-96b6a3ad-06b0-4386-b98f-e9f49ed33825 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '114624d1e8e243eaad51536bca67d5a2', 'request_id': 'req-96b6a3ad-06b0-4386-b98f-e9f49ed33825'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:21.501684 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-96b6a3ad-06b0-4386-b98f-e9f49ed33825 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '114624d1e8e243eaad51536bca67d5a2', 'request_id': 'req-96b6a3ad-06b0-4386-b98f-e9f49ed33825'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:21.684989 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-96b6a3ad-06b0-4386-b98f-e9f49ed33825 admin admin] The token cache is being invalidate because project 114624d1e8e243eaad51536bca67d5a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:52:21.685798 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-96b6a3ad-06b0-4386-b98f-e9f49ed33825 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:21.686672 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-96b6a3ad-06b0-4386-b98f-e9f49ed33825 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:21.691427 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1130/2245] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 16:52:21 2022] DELETE /identity/v3/projects/114624d1e8e243eaad51536bca67d5a2 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:21.693453 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adac970-7f8f-419e-9334-28370e364b9b None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:21.693844 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adac970-7f8f-419e-9334-28370e364b9b None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:21.694023 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adac970-7f8f-419e-9334-28370e364b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:21.715213 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-3adac970-7f8f-419e-9334-28370e364b9b None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:21.717220 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-3adac970-7f8f-419e-9334-28370e364b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:21.812582 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1116/2246] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:52:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:52:21.820428 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d385c757-cf90-4e13-bf60-717d4b0720fd None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:21.820720 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d385c757-cf90-4e13-bf60-717d4b0720fd None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:21.821004 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d385c757-cf90-4e13-bf60-717d4b0720fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:21.829514 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:21.846099 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adac970-7f8f-419e-9334-28370e364b9b None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:21.849411 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-3adac970-7f8f-419e-9334-28370e364b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:21.850455 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-d385c757-cf90-4e13-bf60-717d4b0720fd None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:21.852511 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-d385c757-cf90-4e13-bf60-717d4b0720fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:21.863751 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1131/2247] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:52:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:52:21.866371 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d385c757-cf90-4e13-bf60-717d4b0720fd None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:21.871997 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adac970-7f8f-419e-9334-28370e364b9b None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:21.877726 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4aa58-5770-440a-a300-622153eec7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:21.878869 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4aa58-5770-440a-a300-622153eec7a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:21.879630 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4aa58-5770-440a-a300-622153eec7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:21.879985 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4aa58-5770-440a-a300-622153eec7a3 admin admin] PATH_INFO: `/v3/projects/990ae1d61a2f43f2a8346fa1a8e3cd8a` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:21.881244 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca4aa58-5770-440a-a300-622153eec7a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=990ae1d61a2f43f2a8346fa1a8e3cd8a)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:21.881802 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d385c757-cf90-4e13-bf60-717d4b0720fd None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:21.883752 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca4aa58-5770-440a-a300-622153eec7a3 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:21.891608 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b689c32c-92e2-4436-b9a3-d762124d560d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:21.893102 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689c32c-92e2-4436-b9a3-d762124d560d admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:21.893595 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689c32c-92e2-4436-b9a3-d762124d560d admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:21.894158 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689c32c-92e2-4436-b9a3-d762124d560d admin admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:21.896143 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b689c32c-92e2-4436-b9a3-d762124d560d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:52:21.897239 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b689c32c-92e2-4436-b9a3-d762124d560d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:21.901994 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b689c32c-92e2-4436-b9a3-d762124d560d admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:21.941064 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1132/2248] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Jul 18 16:52:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:52:21.942106 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b689c32c-92e2-4436-b9a3-d762124d560d admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:21.963797 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b689c32c-92e2-4436-b9a3-d762124d560d admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:21.973669 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4154dbd8-632f-4a40-8e97-06fb2760b8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:21.974468 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154dbd8-632f-4a40-8e97-06fb2760b8b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:21.974853 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154dbd8-632f-4a40-8e97-06fb2760b8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:21.975298 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154dbd8-632f-4a40-8e97-06fb2760b8b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:21.976802 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4154dbd8-632f-4a40-8e97-06fb2760b8b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:21.979154 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4154dbd8-632f-4a40-8e97-06fb2760b8b1 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:22.072445 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-cca4aa58-5770-440a-a300-622153eec7a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '990ae1d61a2f43f2a8346fa1a8e3cd8a', 'request_id': 'req-cca4aa58-5770-440a-a300-622153eec7a3'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:22.233518 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1133/2249] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:52:21 2022] POST /identity/v3/projects => generated 377 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:52:22.238122 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4154dbd8-632f-4a40-8e97-06fb2760b8b1 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:22.240665 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-cca4aa58-5770-440a-a300-622153eec7a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '990ae1d61a2f43f2a8346fa1a8e3cd8a', 'request_id': 'req-cca4aa58-5770-440a-a300-622153eec7a3'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:22.245836 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:22.250117 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-cca4aa58-5770-440a-a300-622153eec7a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '990ae1d61a2f43f2a8346fa1a8e3cd8a', 'request_id': 'req-cca4aa58-5770-440a-a300-622153eec7a3'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:22.271840 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-cca4aa58-5770-440a-a300-622153eec7a3 admin admin] The token cache is being invalidate because project 990ae1d61a2f43f2a8346fa1a8e3cd8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:52:22.272139 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-cca4aa58-5770-440a-a300-622153eec7a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:22.272822 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-cca4aa58-5770-440a-a300-622153eec7a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:22.274961 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1117/2250] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 16:52:21 2022] DELETE /identity/v3/projects/990ae1d61a2f43f2a8346fa1a8e3cd8a => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:22.278868 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4aa58-5770-440a-a300-622153eec7a3 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:22.280307 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-cca4aa58-5770-440a-a300-622153eec7a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:22.332657 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4154dbd8-632f-4a40-8e97-06fb2760b8b1 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:22.340853 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc3878-69ad-49be-b64e-39b8e6e9c7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:22.341772 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc3878-69ad-49be-b64e-39b8e6e9c7f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:22.342134 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc3878-69ad-49be-b64e-39b8e6e9c7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:22.342475 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc3878-69ad-49be-b64e-39b8e6e9c7f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:22.343182 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cc3878-69ad-49be-b64e-39b8e6e9c7f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:22.345231 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cc3878-69ad-49be-b64e-39b8e6e9c7f2 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:22.360171 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4aa58-5770-440a-a300-622153eec7a3 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:22.364981 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4381fd66-5592-48e0-82dd-2272164de72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:22.365906 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381fd66-5592-48e0-82dd-2272164de72f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:22.366153 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381fd66-5592-48e0-82dd-2272164de72f admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:22.366598 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381fd66-5592-48e0-82dd-2272164de72f admin admin] PATH_INFO: `/v3/users/681508dbe73c4488b48530dcbe1ddd49` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:22.367864 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4381fd66-5592-48e0-82dd-2272164de72f admin admin] RBAC: Authorizing `identity:delete_user(user_id=681508dbe73c4488b48530dcbe1ddd49)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:22.369937 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4381fd66-5592-48e0-82dd-2272164de72f admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:22.481053 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1134/2251] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 16:52:22 2022] POST /identity/v3/users => generated 289 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:52:22.485283 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc3878-69ad-49be-b64e-39b8e6e9c7f2 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:22.486904 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-82cc3878-69ad-49be-b64e-39b8e6e9c7f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:22.499916 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc3878-69ad-49be-b64e-39b8e6e9c7f2 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:22.505798 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c5a4a8-9eaf-4487-85a7-d5d529872473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:22.506459 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5a4a8-9eaf-4487-85a7-d5d529872473 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:22.506744 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5a4a8-9eaf-4487-85a7-d5d529872473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:22.507024 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5a4a8-9eaf-4487-85a7-d5d529872473 admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:22.508319 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c5a4a8-9eaf-4487-85a7-d5d529872473 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:22.509919 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c5a4a8-9eaf-4487-85a7-d5d529872473 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:22.520314 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1135/2252] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:52:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 16:52:22.524806 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c5a4a8-9eaf-4487-85a7-d5d529872473 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:22.534571 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c5a4a8-9eaf-4487-85a7-d5d529872473 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:22.539453 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa208d-8216-4ce0-80d4-e795136ca645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:22.540139 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa208d-8216-4ce0-80d4-e795136ca645 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:22.540426 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa208d-8216-4ce0-80d4-e795136ca645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:22.540727 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa208d-8216-4ce0-80d4-e795136ca645 admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:22.541422 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fa208d-8216-4ce0-80d4-e795136ca645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:22.543105 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fa208d-8216-4ce0-80d4-e795136ca645 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:22.555014 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1136/2253] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:52:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:52:22.559278 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa208d-8216-4ce0-80d4-e795136ca645 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:22.568947 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa208d-8216-4ce0-80d4-e795136ca645 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:22.587475 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c19d0c-7d29-4f12-a97f-7bdeadd8a5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:22.588367 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c19d0c-7d29-4f12-a97f-7bdeadd8a5c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:22.588650 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c19d0c-7d29-4f12-a97f-7bdeadd8a5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:22.588928 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c19d0c-7d29-4f12-a97f-7bdeadd8a5c2 admin admin] PATH_INFO: `/v3/projects/5393c21377cf47f09ce72bddf179d1fe/users/9850a009eb824a1dbf312e0fe0e3716c/roles/ad3a2bc7b2094a4da1a95a143c8d9436` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:22.589032 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-4381fd66-5592-48e0-82dd-2272164de72f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '681508dbe73c4488b48530dcbe1ddd49'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:22.590129 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-4381fd66-5592-48e0-82dd-2272164de72f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '681508dbe73c4488b48530dcbe1ddd49'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:22.606707 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-4381fd66-5592-48e0-82dd-2272164de72f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '681508dbe73c4488b48530dcbe1ddd49'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:22.610898 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c19d0c-7d29-4f12-a97f-7bdeadd8a5c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5393c21377cf47f09ce72bddf179d1fe, user_id=9850a009eb824a1dbf312e0fe0e3716c, role_id=ad3a2bc7b2094a4da1a95a143c8d9436)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:22.614106 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c19d0c-7d29-4f12-a97f-7bdeadd8a5c2 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:22.720144 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-4381fd66-5592-48e0-82dd-2272164de72f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '681508dbe73c4488b48530dcbe1ddd49'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:22.730908 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-4381fd66-5592-48e0-82dd-2272164de72f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '681508dbe73c4488b48530dcbe1ddd49'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:22.734465 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1137/2254] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:52:22 2022] PUT /identity/v3/projects/5393c21377cf47f09ce72bddf179d1fe/users/9850a009eb824a1dbf312e0fe0e3716c/roles/ad3a2bc7b2094a4da1a95a143c8d9436 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:52:22.746373 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1118/2255] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 16:52:22 2022] DELETE /identity/v3/users/681508dbe73c4488b48530dcbe1ddd49 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:52:22.748076 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514c9f8-7749-482a-9076-1957d094994c None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:22.748372 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514c9f8-7749-482a-9076-1957d094994c None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:22.748650 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514c9f8-7749-482a-9076-1957d094994c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:22.775893 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-d514c9f8-7749-482a-9076-1957d094994c None None] MFA Rules not processed for user `9850a009eb824a1dbf312e0fe0e3716c`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:22.777125 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-d514c9f8-7749-482a-9076-1957d094994c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:22.842219 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1119/2256] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:52:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:52:22.846711 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c19d0c-7d29-4f12-a97f-7bdeadd8a5c2 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:22.848595 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-80c19d0c-7d29-4f12-a97f-7bdeadd8a5c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:22.943299 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c19d0c-7d29-4f12-a97f-7bdeadd8a5c2 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:23.004461 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e8c2a4-bfcb-4c3f-b688-99c5712b0424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:23.005143 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8c2a4-bfcb-4c3f-b688-99c5712b0424 admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:23.005424 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8c2a4-bfcb-4c3f-b688-99c5712b0424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:23.005702 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8c2a4-bfcb-4c3f-b688-99c5712b0424 admin admin] PATH_INFO: `/v3/projects` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:23.006400 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e8c2a4-bfcb-4c3f-b688-99c5712b0424 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:23.008967 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e8c2a4-bfcb-4c3f-b688-99c5712b0424 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:23.160457 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1138/2257] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:52:22 2022] POST /identity/v3/projects => generated 375 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:52:23.164332 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d514c9f8-7749-482a-9076-1957d094994c None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:23.175359 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d514c9f8-7749-482a-9076-1957d094994c None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:23.234572 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4330c24c-2c95-4fec-b190-fc7c3bdffaa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:23.235352 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4330c24c-2c95-4fec-b190-fc7c3bdffaa7 admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:23.235636 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4330c24c-2c95-4fec-b190-fc7c3bdffaa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:23.235961 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4330c24c-2c95-4fec-b190-fc7c3bdffaa7 admin admin] PATH_INFO: `/v3/users` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:23.236663 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4330c24c-2c95-4fec-b190-fc7c3bdffaa7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:23.238703 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4330c24c-2c95-4fec-b190-fc7c3bdffaa7 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:23.277822 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e8c2a4-bfcb-4c3f-b688-99c5712b0424 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:23.279859 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-36e8c2a4-bfcb-4c3f-b688-99c5712b0424 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:23.295139 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e8c2a4-bfcb-4c3f-b688-99c5712b0424 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:23.298395 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e2657-6c46-4a60-abe1-e5273bb11bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:23.298777 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e2657-6c46-4a60-abe1-e5273bb11bb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:23.299063 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e2657-6c46-4a60-abe1-e5273bb11bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:23.300009 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e2657-6c46-4a60-abe1-e5273bb11bb8 admin admin] PATH_INFO: `/v3/projects/b96805e02d6742c8b33b57e082a755f3` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:23.300898 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0e2657-6c46-4a60-abe1-e5273bb11bb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b96805e02d6742c8b33b57e082a755f3)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:23.302886 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0e2657-6c46-4a60-abe1-e5273bb11bb8 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:23.392542 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1120/2258] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 16:52:23 2022] POST /identity/v3/users => generated 288 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:52:23.396638 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4330c24c-2c95-4fec-b190-fc7c3bdffaa7 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:23.407390 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4330c24c-2c95-4fec-b190-fc7c3bdffaa7 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:23.412347 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5459e70-89f4-4f09-9dec-cba8c25b85a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:23.413099 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5459e70-89f4-4f09-9dec-cba8c25b85a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:23.413386 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5459e70-89f4-4f09-9dec-cba8c25b85a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:23.413668 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5459e70-89f4-4f09-9dec-cba8c25b85a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:23.414403 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5459e70-89f4-4f09-9dec-cba8c25b85a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:23.416044 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5459e70-89f4-4f09-9dec-cba8c25b85a8 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:23.429082 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1121/2259] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:52:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:52:23.432555 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5459e70-89f4-4f09-9dec-cba8c25b85a8 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:23.443576 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5459e70-89f4-4f09-9dec-cba8c25b85a8 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:23.449497 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6483400-ab26-41b2-a9d5-41bac82d5489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:23.450170 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6483400-ab26-41b2-a9d5-41bac82d5489 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:23.455425 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6483400-ab26-41b2-a9d5-41bac82d5489 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:23.455425 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6483400-ab26-41b2-a9d5-41bac82d5489 admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:23.455425 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6483400-ab26-41b2-a9d5-41bac82d5489 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:23.455425 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6483400-ab26-41b2-a9d5-41bac82d5489 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:23.469225 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1122/2260] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:52:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:52:23.471427 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6483400-ab26-41b2-a9d5-41bac82d5489 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:23.481548 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6483400-ab26-41b2-a9d5-41bac82d5489 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:23.486745 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac5000a-f523-415a-9079-07d0eeb9c9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:23.489907 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5000a-f523-415a-9079-07d0eeb9c9a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:23.489907 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5000a-f523-415a-9079-07d0eeb9c9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:23.489907 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5000a-f523-415a-9079-07d0eeb9c9a8 admin admin] PATH_INFO: `/v3/projects/779844fd082142149f109f62d0e512a5/users/223f12f2d25e43fdba2fd12872db70a7/roles/ad3a2bc7b2094a4da1a95a143c8d9436` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:23.505868 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac5000a-f523-415a-9079-07d0eeb9c9a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=779844fd082142149f109f62d0e512a5, user_id=223f12f2d25e43fdba2fd12872db70a7, role_id=ad3a2bc7b2094a4da1a95a143c8d9436)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:23.510041 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac5000a-f523-415a-9079-07d0eeb9c9a8 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:23.598546 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1123/2261] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:52:23 2022] PUT /identity/v3/projects/779844fd082142149f109f62d0e512a5/users/223f12f2d25e43fdba2fd12872db70a7/roles/ad3a2bc7b2094a4da1a95a143c8d9436 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:52:23.607881 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-1f0e2657-6c46-4a60-abe1-e5273bb11bb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b96805e02d6742c8b33b57e082a755f3', 'request_id': 'req-1f0e2657-6c46-4a60-abe1-e5273bb11bb8'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:23.610249 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ed696-0f03-4918-8f1f-7d56108ff1a8 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:23.610685 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ed696-0f03-4918-8f1f-7d56108ff1a8 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:23.610906 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ed696-0f03-4918-8f1f-7d56108ff1a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:23.619625 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-1f0e2657-6c46-4a60-abe1-e5273bb11bb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b96805e02d6742c8b33b57e082a755f3', 'request_id': 'req-1f0e2657-6c46-4a60-abe1-e5273bb11bb8'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:23.628193 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-1f0e2657-6c46-4a60-abe1-e5273bb11bb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b96805e02d6742c8b33b57e082a755f3', 'request_id': 'req-1f0e2657-6c46-4a60-abe1-e5273bb11bb8'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:23.642363 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-b44ed696-0f03-4918-8f1f-7d56108ff1a8 None None] MFA Rules not processed for user `223f12f2d25e43fdba2fd12872db70a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:23.643495 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-b44ed696-0f03-4918-8f1f-7d56108ff1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:23.708548 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1124/2262] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:52:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:52:23.712953 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ed696-0f03-4918-8f1f-7d56108ff1a8 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:23.781005 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-1f0e2657-6c46-4a60-abe1-e5273bb11bb8 admin admin] The token cache is being invalidate because project b96805e02d6742c8b33b57e082a755f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:52:23.781355 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-1f0e2657-6c46-4a60-abe1-e5273bb11bb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:23.782033 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-1f0e2657-6c46-4a60-abe1-e5273bb11bb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:23.784355 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1139/2263] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 16:52:23 2022] DELETE /identity/v3/projects/b96805e02d6742c8b33b57e082a755f3 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:52:23.790633 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ed696-0f03-4918-8f1f-7d56108ff1a8 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:23.791302 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f75e99-1eaa-46d1-9aa7-45e06cf222e1 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:23.791771 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f75e99-1eaa-46d1-9aa7-45e06cf222e1 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:23.792564 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f75e99-1eaa-46d1-9aa7-45e06cf222e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:23.797350 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c162113c-f3b9-46a4-89ae-4b7dc62b8628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:23.798040 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162113c-f3b9-46a4-89ae-4b7dc62b8628 admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:23.798328 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162113c-f3b9-46a4-89ae-4b7dc62b8628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:23.798601 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162113c-f3b9-46a4-89ae-4b7dc62b8628 admin admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:23.799341 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c162113c-f3b9-46a4-89ae-4b7dc62b8628 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:23.801340 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c162113c-f3b9-46a4-89ae-4b7dc62b8628 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:23.820882 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-67f75e99-1eaa-46d1-9aa7-45e06cf222e1 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:23.822103 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-67f75e99-1eaa-46d1-9aa7-45e06cf222e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:23.830764 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1140/2264] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:52:23.841727 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a70ba-74dd-427d-b10d-50721cde82ff None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:23.842084 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a70ba-74dd-427d-b10d-50721cde82ff None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:23.842412 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a70ba-74dd-427d-b10d-50721cde82ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:23.863089 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-689a70ba-74dd-427d-b10d-50721cde82ff None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:23.864361 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-689a70ba-74dd-427d-b10d-50721cde82ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:23.874664 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1141/2265] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:52:23.879985 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a70ba-74dd-427d-b10d-50721cde82ff None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:23.891639 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a70ba-74dd-427d-b10d-50721cde82ff None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:23.897288 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac913b3-224a-456b-92c0-5f2864b98088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:23.897969 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac913b3-224a-456b-92c0-5f2864b98088 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:23.898380 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac913b3-224a-456b-92c0-5f2864b98088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:23.898662 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac913b3-224a-456b-92c0-5f2864b98088 admin admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:23.899453 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac913b3-224a-456b-92c0-5f2864b98088 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:52:23.899781 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac913b3-224a-456b-92c0-5f2864b98088 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:23.901481 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac913b3-224a-456b-92c0-5f2864b98088 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:23.917391 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1142/2266] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Jul 18 16:52:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:52:23.922497 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac913b3-224a-456b-92c0-5f2864b98088 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:23.936251 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac913b3-224a-456b-92c0-5f2864b98088 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:23.943090 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01844645-f1cb-4057-8e8b-a543afbf554b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:23.943789 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01844645-f1cb-4057-8e8b-a543afbf554b admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:23.944348 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01844645-f1cb-4057-8e8b-a543afbf554b admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:23.944348 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01844645-f1cb-4057-8e8b-a543afbf554b admin admin] PATH_INFO: `/v3/projects` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:23.945697 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01844645-f1cb-4057-8e8b-a543afbf554b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:23.947643 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01844645-f1cb-4057-8e8b-a543afbf554b admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:23.998067 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1125/2267] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:52:23 2022] POST /identity/v3/projects => generated 371 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:52:24.001877 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c162113c-f3b9-46a4-89ae-4b7dc62b8628 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:24.004867 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-c162113c-f3b9-46a4-89ae-4b7dc62b8628 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:24.087284 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1143/2268] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:52:23 2022] POST /identity/v3/projects => generated 385 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:52:24.092234 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01844645-f1cb-4057-8e8b-a543afbf554b admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:24.095342 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c162113c-f3b9-46a4-89ae-4b7dc62b8628 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:24.180357 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce36f25-2fd8-4b02-aeff-781771fec9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:24.181850 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce36f25-2fd8-4b02-aeff-781771fec9db admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:24.182355 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce36f25-2fd8-4b02-aeff-781771fec9db admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:24.182862 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce36f25-2fd8-4b02-aeff-781771fec9db admin admin] PATH_INFO: `/v3/users` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:24.184279 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce36f25-2fd8-4b02-aeff-781771fec9db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:24.188244 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce36f25-2fd8-4b02-aeff-781771fec9db admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:24.269431 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:24.311599 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01844645-f1cb-4057-8e8b-a543afbf554b admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:24.316597 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed99f7cd-843b-4294-b59d-cf9937d82efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:24.317274 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99f7cd-843b-4294-b59d-cf9937d82efa admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:24.317626 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99f7cd-843b-4294-b59d-cf9937d82efa admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:24.317898 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99f7cd-843b-4294-b59d-cf9937d82efa admin admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:24.318596 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed99f7cd-843b-4294-b59d-cf9937d82efa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:24.320716 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed99f7cd-843b-4294-b59d-cf9937d82efa admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:24.332995 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1126/2269] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 16:52:24 2022] POST /identity/v3/users => generated 292 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:52:24.337599 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce36f25-2fd8-4b02-aeff-781771fec9db admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:24.348589 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce36f25-2fd8-4b02-aeff-781771fec9db admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:24.354540 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4ab0db-711b-4d0c-a463-1caab6b5c17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:24.355223 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ab0db-711b-4d0c-a463-1caab6b5c17d admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:24.355557 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ab0db-711b-4d0c-a463-1caab6b5c17d admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:24.355937 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ab0db-711b-4d0c-a463-1caab6b5c17d admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:24.356603 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4ab0db-711b-4d0c-a463-1caab6b5c17d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:24.358240 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4ab0db-711b-4d0c-a463-1caab6b5c17d admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:24.369072 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1127/2270] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 16:52:24.373380 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4ab0db-711b-4d0c-a463-1caab6b5c17d admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:24.383763 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4ab0db-711b-4d0c-a463-1caab6b5c17d admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:24.389704 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e342a-d7d0-408f-9bfa-f87e0ed88908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:24.390600 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e342a-d7d0-408f-9bfa-f87e0ed88908 admin admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:24.390879 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e342a-d7d0-408f-9bfa-f87e0ed88908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:24.391157 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e342a-d7d0-408f-9bfa-f87e0ed88908 admin admin] PATH_INFO: `/v3/projects/2dd6651fdaa942e5b7c2b9131cb47002/users/e67dbf6b8a924f1e841b2c52653c1f0c/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:24.409372 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426e342a-d7d0-408f-9bfa-f87e0ed88908 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dd6651fdaa942e5b7c2b9131cb47002, user_id=e67dbf6b8a924f1e841b2c52653c1f0c, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:24.412108 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426e342a-d7d0-408f-9bfa-f87e0ed88908 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:24.455272 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1144/2271] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 16:52:24 2022] POST /identity/v3/users => generated 293 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:52:24.459497 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed99f7cd-843b-4294-b59d-cf9937d82efa admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:24.471120 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed99f7cd-843b-4294-b59d-cf9937d82efa admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:24.478720 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd79b97-d438-4d27-8c60-a555a6bd6283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:24.479402 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd79b97-d438-4d27-8c60-a555a6bd6283 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:24.479681 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd79b97-d438-4d27-8c60-a555a6bd6283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:24.479981 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd79b97-d438-4d27-8c60-a555a6bd6283 admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:24.480728 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd79b97-d438-4d27-8c60-a555a6bd6283 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:24.482337 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd79b97-d438-4d27-8c60-a555a6bd6283 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:24.492630 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1145/2272] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 16:52:24.497529 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd79b97-d438-4d27-8c60-a555a6bd6283 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:24.508493 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd79b97-d438-4d27-8c60-a555a6bd6283 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:24.513424 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9309c6b-1147-4829-9cf0-1a8342d4b2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:24.514132 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9309c6b-1147-4829-9cf0-1a8342d4b2bf admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:24.514742 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9309c6b-1147-4829-9cf0-1a8342d4b2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:24.514961 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9309c6b-1147-4829-9cf0-1a8342d4b2bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:24.515625 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9309c6b-1147-4829-9cf0-1a8342d4b2bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:24.517251 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9309c6b-1147-4829-9cf0-1a8342d4b2bf admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:24.528928 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1128/2273] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:52:24 2022] PUT /identity/v3/projects/2dd6651fdaa942e5b7c2b9131cb47002/users/e67dbf6b8a924f1e841b2c52653c1f0c/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:24.529107 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1146/2274] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 16:52:24.532503 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e342a-d7d0-408f-9bfa-f87e0ed88908 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:24.532784 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9309c6b-1147-4829-9cf0-1a8342d4b2bf admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:24.543960 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9309c6b-1147-4829-9cf0-1a8342d4b2bf admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:24.601906 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e342a-d7d0-408f-9bfa-f87e0ed88908 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:24.607402 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5da5aa-ab68-408d-bd7f-0a5013a5ce5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:24.608396 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3caf7d-2636-46f1-887f-3cb7961cf8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:24.608554 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5da5aa-ab68-408d-bd7f-0a5013a5ce5c admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:24.608875 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5da5aa-ab68-408d-bd7f-0a5013a5ce5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:24.609228 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5da5aa-ab68-408d-bd7f-0a5013a5ce5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:24.609453 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3caf7d-2636-46f1-887f-3cb7961cf8b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:24.609737 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3caf7d-2636-46f1-887f-3cb7961cf8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:24.610247 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3caf7d-2636-46f1-887f-3cb7961cf8b5 admin admin] PATH_INFO: `/v3/projects/a1a96a6e35e04a0a812ab72947f8ab38/users/830287a2fc744eeab78211bf57239b7c/roles/ad3a2bc7b2094a4da1a95a143c8d9436` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:24.610723 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5da5aa-ab68-408d-bd7f-0a5013a5ce5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:24.612482 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5da5aa-ab68-408d-bd7f-0a5013a5ce5c admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:24.617220 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:24.627703 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1129/2275] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:52:24.633170 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5da5aa-ab68-408d-bd7f-0a5013a5ce5c admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:24.635192 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3caf7d-2636-46f1-887f-3cb7961cf8b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1a96a6e35e04a0a812ab72947f8ab38, user_id=830287a2fc744eeab78211bf57239b7c, role_id=ad3a2bc7b2094a4da1a95a143c8d9436)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:24.640095 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3caf7d-2636-46f1-887f-3cb7961cf8b5 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:24.649734 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5da5aa-ab68-408d-bd7f-0a5013a5ce5c admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:24.654996 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb69faff-f477-473c-8305-0afc87744a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:24.659074 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69faff-f477-473c-8305-0afc87744a05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:24.659074 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69faff-f477-473c-8305-0afc87744a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:24.659074 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69faff-f477-473c-8305-0afc87744a05 admin admin] PATH_INFO: `/v3/projects/2dd6651fdaa942e5b7c2b9131cb47002/users/e67dbf6b8a924f1e841b2c52653c1f0c/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:24.659074 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb69faff-f477-473c-8305-0afc87744a05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dd6651fdaa942e5b7c2b9131cb47002, user_id=e67dbf6b8a924f1e841b2c52653c1f0c, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:24.661505 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb69faff-f477-473c-8305-0afc87744a05 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:24.677914 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1130/2276] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:52:24 2022] PUT /identity/v3/projects/2dd6651fdaa942e5b7c2b9131cb47002/users/e67dbf6b8a924f1e841b2c52653c1f0c/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:52:24.688267 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233e291-5216-4d12-8d7b-4ef7be563d8f None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:24.688628 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233e291-5216-4d12-8d7b-4ef7be563d8f None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:24.688830 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233e291-5216-4d12-8d7b-4ef7be563d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:24.721974 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-5233e291-5216-4d12-8d7b-4ef7be563d8f None None] MFA Rules not processed for user `e67dbf6b8a924f1e841b2c52653c1f0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:24.723198 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-5233e291-5216-4d12-8d7b-4ef7be563d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:24.761418 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1147/2277] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:52:24 2022] PUT /identity/v3/projects/a1a96a6e35e04a0a812ab72947f8ab38/users/830287a2fc744eeab78211bf57239b7c/roles/ad3a2bc7b2094a4da1a95a143c8d9436 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:52:24.771981 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ee90e-20f9-4d6b-a9cc-3f0f892865e9 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:24.772788 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ee90e-20f9-4d6b-a9cc-3f0f892865e9 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:24.773648 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ee90e-20f9-4d6b-a9cc-3f0f892865e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:24.801547 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1131/2278] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:52:24 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:52:24.803298 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-5c8ee90e-20f9-4d6b-a9cc-3f0f892865e9 None None] MFA Rules not processed for user `830287a2fc744eeab78211bf57239b7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:24.804638 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-5c8ee90e-20f9-4d6b-a9cc-3f0f892865e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:24.814296 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5233e291-5216-4d12-8d7b-4ef7be563d8f None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:24.815801 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-5233e291-5216-4d12-8d7b-4ef7be563d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:24.885994 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5233e291-5216-4d12-8d7b-4ef7be563d8f None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:24.912465 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1148/2279] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:52:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:52:24.917360 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8ee90e-20f9-4d6b-a9cc-3f0f892865e9 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:24.944062 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b340f6be-bdcf-4321-a36d-776e942fdc41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:24.945504 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b340f6be-bdcf-4321-a36d-776e942fdc41 service cinder] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:24.945806 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b340f6be-bdcf-4321-a36d-776e942fdc41 service cinder] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:24.946094 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b340f6be-bdcf-4321-a36d-776e942fdc41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:24.948081 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-b340f6be-bdcf-4321-a36d-776e942fdc41 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:24.997795 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8ee90e-20f9-4d6b-a9cc-3f0f892865e9 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:25.004699 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74c9f3b-9395-4821-b7d2-e0da98f0585c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:25.005381 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c9f3b-9395-4821-b7d2-e0da98f0585c admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:25.005655 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c9f3b-9395-4821-b7d2-e0da98f0585c admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:25.005924 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c9f3b-9395-4821-b7d2-e0da98f0585c admin admin] PATH_INFO: `/v3/projects` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:25.006699 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74c9f3b-9395-4821-b7d2-e0da98f0585c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:25.009935 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74c9f3b-9395-4821-b7d2-e0da98f0585c admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:25.043152 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b340f6be-bdcf-4321-a36d-776e942fdc41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:25.046430 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b340f6be-bdcf-4321-a36d-776e942fdc41 service cinder] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:25.059262 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1132/2280] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:52:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 16:52:25.220517 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1149/2281] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:52:24 2022] POST /identity/v3/projects => generated 387 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:52:25.227960 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b340f6be-bdcf-4321-a36d-776e942fdc41 service cinder] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:25.245510 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b340f6be-bdcf-4321-a36d-776e942fdc41 service cinder] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:25.334104 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8580e077-9baf-42db-be31-86635430d646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:25.335320 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580e077-9baf-42db-be31-86635430d646 admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:25.335936 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580e077-9baf-42db-be31-86635430d646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:25.336444 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580e077-9baf-42db-be31-86635430d646 admin admin] PATH_INFO: `/v3/users` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:25.337879 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8580e077-9baf-42db-be31-86635430d646 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:25.341889 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8580e077-9baf-42db-be31-86635430d646 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:25.497175 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1133/2282] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 16:52:25 2022] POST /identity/v3/users => generated 294 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:52:25.503971 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74c9f3b-9395-4821-b7d2-e0da98f0585c admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:25.524571 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74c9f3b-9395-4821-b7d2-e0da98f0585c admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:25.544885 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97208817-6e08-4ae1-afa8-89c1a5048af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:25.545704 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97208817-6e08-4ae1-afa8-89c1a5048af5 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:25.546310 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97208817-6e08-4ae1-afa8-89c1a5048af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:25.546902 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97208817-6e08-4ae1-afa8-89c1a5048af5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:25.548481 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97208817-6e08-4ae1-afa8-89c1a5048af5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:25.551219 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97208817-6e08-4ae1-afa8-89c1a5048af5 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:25.565860 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1150/2283] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:52:25.570792 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8580e077-9baf-42db-be31-86635430d646 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:25.585613 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8580e077-9baf-42db-be31-86635430d646 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:25.591506 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67573d43-4789-4e86-a8d4-c0feee967b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:25.592270 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67573d43-4789-4e86-a8d4-c0feee967b92 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:25.594930 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67573d43-4789-4e86-a8d4-c0feee967b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:25.594930 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67573d43-4789-4e86-a8d4-c0feee967b92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:25.594930 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67573d43-4789-4e86-a8d4-c0feee967b92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:25.597955 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67573d43-4789-4e86-a8d4-c0feee967b92 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:25.622087 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1134/2284] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:52:25.627119 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97208817-6e08-4ae1-afa8-89c1a5048af5 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:25.638801 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97208817-6e08-4ae1-afa8-89c1a5048af5 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:25.643609 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8539ad16-1cc1-464c-bb3c-de012b20f1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:25.646869 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8539ad16-1cc1-464c-bb3c-de012b20f1bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:25.646869 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8539ad16-1cc1-464c-bb3c-de012b20f1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:25.646869 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8539ad16-1cc1-464c-bb3c-de012b20f1bb admin admin] PATH_INFO: `/v3/projects/c867a02d3edc4ce9bfaf0dee472dd818/users/af1c686ea9aa4a55bb67a4182525ab08/roles/ad3a2bc7b2094a4da1a95a143c8d9436` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:25.663141 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8539ad16-1cc1-464c-bb3c-de012b20f1bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c867a02d3edc4ce9bfaf0dee472dd818, user_id=af1c686ea9aa4a55bb67a4182525ab08, role_id=ad3a2bc7b2094a4da1a95a143c8d9436)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:25.666429 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8539ad16-1cc1-464c-bb3c-de012b20f1bb admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:25.890574 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1151/2285] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:52:25 2022] PUT /identity/v3/projects/c867a02d3edc4ce9bfaf0dee472dd818/users/af1c686ea9aa4a55bb67a4182525ab08/roles/ad3a2bc7b2094a4da1a95a143c8d9436 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:25.909711 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908292e-9e47-400b-9b84-1795b651fdad None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:25.910297 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908292e-9e47-400b-9b84-1795b651fdad None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:25.910428 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908292e-9e47-400b-9b84-1795b651fdad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:25.953436 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-8908292e-9e47-400b-9b84-1795b651fdad None None] MFA Rules not processed for user `af1c686ea9aa4a55bb67a4182525ab08`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:25.956862 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-8908292e-9e47-400b-9b84-1795b651fdad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:26.048875 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1135/2286] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:52:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:52:26.066231 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8539ad16-1cc1-464c-bb3c-de012b20f1bb admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:26.182555 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8539ad16-1cc1-464c-bb3c-de012b20f1bb admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:26.188253 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14b0379-3b73-4f26-8f6f-8c4cbf7d1023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:26.189046 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b0379-3b73-4f26-8f6f-8c4cbf7d1023 admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:26.189587 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b0379-3b73-4f26-8f6f-8c4cbf7d1023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:26.189587 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b0379-3b73-4f26-8f6f-8c4cbf7d1023 admin admin] PATH_INFO: `/v3/projects` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:26.190821 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14b0379-3b73-4f26-8f6f-8c4cbf7d1023 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:26.192873 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14b0379-3b73-4f26-8f6f-8c4cbf7d1023 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:26.236280 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:26.387401 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1152/2287] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:52:26 2022] POST /identity/v3/projects => generated 387 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:52:26.393427 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8908292e-9e47-400b-9b84-1795b651fdad None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:26.406252 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8908292e-9e47-400b-9b84-1795b651fdad None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:26.546056 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3470689a-419e-4c87-bf75-8b5263f2c4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:26.546894 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3470689a-419e-4c87-bf75-8b5263f2c4e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:26.547268 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3470689a-419e-4c87-bf75-8b5263f2c4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:26.548151 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3470689a-419e-4c87-bf75-8b5263f2c4e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:26.551133 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3470689a-419e-4c87-bf75-8b5263f2c4e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:26.553360 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3470689a-419e-4c87-bf75-8b5263f2c4e7 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:26.688806 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:26.698783 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1136/2288] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 16:52:26 2022] POST /identity/v3/users => generated 300 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:52:26.702854 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14b0379-3b73-4f26-8f6f-8c4cbf7d1023 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:26.713830 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14b0379-3b73-4f26-8f6f-8c4cbf7d1023 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:26.719291 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab5f4b6-db50-4f00-b472-c3b451af03b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:26.720224 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5f4b6-db50-4f00-b472-c3b451af03b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:26.720621 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5f4b6-db50-4f00-b472-c3b451af03b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:26.720876 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5f4b6-db50-4f00-b472-c3b451af03b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:26.721862 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab5f4b6-db50-4f00-b472-c3b451af03b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:26.723610 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab5f4b6-db50-4f00-b472-c3b451af03b7 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:26.735944 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1153/2289] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:52:26.740287 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3470689a-419e-4c87-bf75-8b5263f2c4e7 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:26.751934 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3470689a-419e-4c87-bf75-8b5263f2c4e7 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:26.758169 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d85dc4-347f-4ac8-b6c0-f53796c31a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:26.759095 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d85dc4-347f-4ac8-b6c0-f53796c31a7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:26.759095 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d85dc4-347f-4ac8-b6c0-f53796c31a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:26.759738 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d85dc4-347f-4ac8-b6c0-f53796c31a7e admin admin] PATH_INFO: `/v3/projects/d80b9c211d634ea0a6067a035ef713da/users/a2f8e000c99644028fe0e5e966b060bd/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:26.776649 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d85dc4-347f-4ac8-b6c0-f53796c31a7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d80b9c211d634ea0a6067a035ef713da, user_id=a2f8e000c99644028fe0e5e966b060bd, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:26.779312 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d85dc4-347f-4ac8-b6c0-f53796c31a7e admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:26.912887 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1137/2290] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:52:26 2022] PUT /identity/v3/projects/d80b9c211d634ea0a6067a035ef713da/users/a2f8e000c99644028fe0e5e966b060bd/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:26.917888 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab5f4b6-db50-4f00-b472-c3b451af03b7 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:26.936760 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab5f4b6-db50-4f00-b472-c3b451af03b7 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:27.012336 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4729c9-bd3c-4bbb-8443-8eb4399c3431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:27.013298 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4729c9-bd3c-4bbb-8443-8eb4399c3431 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:27.013650 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4729c9-bd3c-4bbb-8443-8eb4399c3431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:27.014003 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4729c9-bd3c-4bbb-8443-8eb4399c3431 admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:27.014887 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4729c9-bd3c-4bbb-8443-8eb4399c3431 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:27.016663 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4729c9-bd3c-4bbb-8443-8eb4399c3431 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:27.028492 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1154/2291] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 16:52:27.032885 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d85dc4-347f-4ac8-b6c0-f53796c31a7e admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:27.045034 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d85dc4-347f-4ac8-b6c0-f53796c31a7e admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:27.050236 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b68b64-1e5a-4fbf-820a-09cb7e3bc5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:27.051417 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b68b64-1e5a-4fbf-820a-09cb7e3bc5c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:27.051614 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b68b64-1e5a-4fbf-820a-09cb7e3bc5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:27.051861 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b68b64-1e5a-4fbf-820a-09cb7e3bc5c5 admin admin] PATH_INFO: `/v3/projects/d80b9c211d634ea0a6067a035ef713da/users/a2f8e000c99644028fe0e5e966b060bd/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:27.054153 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b68b64-1e5a-4fbf-820a-09cb7e3bc5c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d80b9c211d634ea0a6067a035ef713da, user_id=a2f8e000c99644028fe0e5e966b060bd, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:27.057749 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b68b64-1e5a-4fbf-820a-09cb7e3bc5c5 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:27.069263 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1138/2292] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:52:27 2022] PUT /identity/v3/projects/d80b9c211d634ea0a6067a035ef713da/users/a2f8e000c99644028fe0e5e966b060bd/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:27.080506 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb636ef-5e76-46ea-b458-08e34a49741d None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:27.081386 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb636ef-5e76-46ea-b458-08e34a49741d None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:27.081386 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb636ef-5e76-46ea-b458-08e34a49741d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:27.116213 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-cdb636ef-5e76-46ea-b458-08e34a49741d None None] MFA Rules not processed for user `a2f8e000c99644028fe0e5e966b060bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:27.118155 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-cdb636ef-5e76-46ea-b458-08e34a49741d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:27.209493 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1155/2293] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:52:27 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:52:27.222131 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b68b64-1e5a-4fbf-820a-09cb7e3bc5c5 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:27.224003 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-08b68b64-1e5a-4fbf-820a-09cb7e3bc5c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:27.294159 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b68b64-1e5a-4fbf-820a-09cb7e3bc5c5 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:27.297936 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ca266-c7ea-4ad6-8340-cc95a212369a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:27.298621 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ca266-c7ea-4ad6-8340-cc95a212369a service cinder] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:27.298904 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ca266-c7ea-4ad6-8340-cc95a212369a service cinder] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:27.299181 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ca266-c7ea-4ad6-8340-cc95a212369a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:27.309792 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428ca266-c7ea-4ad6-8340-cc95a212369a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:27.311337 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428ca266-c7ea-4ad6-8340-cc95a212369a service cinder] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:27.322200 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1139/2294] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:52:27 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 16:52:28.506424 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:29.036667 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb636ef-5e76-46ea-b458-08e34a49741d None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:29.061022 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb636ef-5e76-46ea-b458-08e34a49741d None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:29.074542 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d47897b-48e3-4867-9c33-e06f28bd8f2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:29.075170 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d47897b-48e3-4867-9c33-e06f28bd8f2d service cinder] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:29.075460 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d47897b-48e3-4867-9c33-e06f28bd8f2d service cinder] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:29.075893 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d47897b-48e3-4867-9c33-e06f28bd8f2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:29.095477 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-7d47897b-48e3-4867-9c33-e06f28bd8f2d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:29.191738 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ca266-c7ea-4ad6-8340-cc95a212369a service cinder] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:29.222656 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ca266-c7ea-4ad6-8340-cc95a212369a service cinder] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:29.233679 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6779341d-0639-4614-9dbe-073f37654950 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:29.236361 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779341d-0639-4614-9dbe-073f37654950 service cinder] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:29.237503 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d47897b-48e3-4867-9c33-e06f28bd8f2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:29.239179 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d47897b-48e3-4867-9c33-e06f28bd8f2d service cinder] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:29.239579 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779341d-0639-4614-9dbe-073f37654950 service cinder] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:29.241183 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779341d-0639-4614-9dbe-073f37654950 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:29.259815 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1156/2295] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:52:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:52:29.324157 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:29.370499 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6779341d-0639-4614-9dbe-073f37654950 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:29.374903 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6779341d-0639-4614-9dbe-073f37654950 service cinder] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:29.401577 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1140/2296] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:52:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 16:52:30.800665 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:32.652922 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:33.060245 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d47897b-48e3-4867-9c33-e06f28bd8f2d service cinder] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:33.071002 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d47897b-48e3-4867-9c33-e06f28bd8f2d service cinder] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:33.075061 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee990a48-1d12-4771-b268-8f57ffbd30e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:33.075765 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee990a48-1d12-4771-b268-8f57ffbd30e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:33.076198 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee990a48-1d12-4771-b268-8f57ffbd30e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:33.076506 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee990a48-1d12-4771-b268-8f57ffbd30e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:33.167375 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee990a48-1d12-4771-b268-8f57ffbd30e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:33.167375 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee990a48-1d12-4771-b268-8f57ffbd30e2 service cinder] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:33.178723 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1157/2297] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:52:33 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:52:36.606660 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:37.078159 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:38.330197 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:38.461663 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:38.715823 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6779341d-0639-4614-9dbe-073f37654950 service cinder] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:38.724518 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6779341d-0639-4614-9dbe-073f37654950 service cinder] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:38.729079 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da34540-f432-40f7-838a-4d9267cdadea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:38.729796 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da34540-f432-40f7-838a-4d9267cdadea service cinder] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:38.730073 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da34540-f432-40f7-838a-4d9267cdadea service cinder] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:38.730348 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da34540-f432-40f7-838a-4d9267cdadea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:38.789159 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da34540-f432-40f7-838a-4d9267cdadea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:38.790647 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da34540-f432-40f7-838a-4d9267cdadea service cinder] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:38.800012 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1141/2298] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:52:38 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:52:39.507987 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee990a48-1d12-4771-b268-8f57ffbd30e2 service cinder] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:39.592107 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee990a48-1d12-4771-b268-8f57ffbd30e2 service cinder] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:39.596936 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33723006-63be-43fb-9f63-237b896f0421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:39.597907 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33723006-63be-43fb-9f63-237b896f0421 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:39.598189 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33723006-63be-43fb-9f63-237b896f0421 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:39.598467 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33723006-63be-43fb-9f63-237b896f0421 admin admin] PATH_INFO: `/v3/users/9850a009eb824a1dbf312e0fe0e3716c` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:39.599756 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33723006-63be-43fb-9f63-237b896f0421 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9850a009eb824a1dbf312e0fe0e3716c)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:39.602244 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33723006-63be-43fb-9f63-237b896f0421 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:40.037103 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-33723006-63be-43fb-9f63-237b896f0421 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9850a009eb824a1dbf312e0fe0e3716c'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:40.050315 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-33723006-63be-43fb-9f63-237b896f0421 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9850a009eb824a1dbf312e0fe0e3716c'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:40.057420 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-33723006-63be-43fb-9f63-237b896f0421 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9850a009eb824a1dbf312e0fe0e3716c'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:40.058718 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-33723006-63be-43fb-9f63-237b896f0421 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9850a009eb824a1dbf312e0fe0e3716c'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:40.082231 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:40.171926 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-33723006-63be-43fb-9f63-237b896f0421 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9850a009eb824a1dbf312e0fe0e3716c'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:40.180667 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1158/2299] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 16:52:39 2022] DELETE /identity/v3/users/9850a009eb824a1dbf312e0fe0e3716c => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:40.186802 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccab5ca-3941-409c-890c-b7f5a8387dd9 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:40.187482 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccab5ca-3941-409c-890c-b7f5a8387dd9 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:40.187854 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccab5ca-3941-409c-890c-b7f5a8387dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:40.219153 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-4ccab5ca-3941-409c-890c-b7f5a8387dd9 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:40.221320 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-4ccab5ca-3941-409c-890c-b7f5a8387dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:40.301205 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1142/2300] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:52:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:52:40.311818 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33723006-63be-43fb-9f63-237b896f0421 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:40.314195 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-33723006-63be-43fb-9f63-237b896f0421 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:40.363914 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:40.390243 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33723006-63be-43fb-9f63-237b896f0421 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:40.396743 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee40491-f38b-4546-bc88-51b12aa1681c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:40.397488 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee40491-f38b-4546-bc88-51b12aa1681c service neutron] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:40.398358 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee40491-f38b-4546-bc88-51b12aa1681c service neutron] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:40.400631 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee40491-f38b-4546-bc88-51b12aa1681c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:40.409905 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee40491-f38b-4546-bc88-51b12aa1681c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:40.411519 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee40491-f38b-4546-bc88-51b12aa1681c service neutron] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:40.422889 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1159/2301] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:52:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:52:40.720741 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:40.997141 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccab5ca-3941-409c-890c-b7f5a8387dd9 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:40.998608 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-4ccab5ca-3941-409c-890c-b7f5a8387dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:41.024011 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccab5ca-3941-409c-890c-b7f5a8387dd9 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:41.035175 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d20c3a-fe74-4a33-9063-d6195ca17dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:41.035175 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d20c3a-fe74-4a33-9063-d6195ca17dee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:41.035175 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d20c3a-fe74-4a33-9063-d6195ca17dee admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:41.035175 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d20c3a-fe74-4a33-9063-d6195ca17dee admin admin] PATH_INFO: `/v3/projects/5393c21377cf47f09ce72bddf179d1fe` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:41.035518 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d20c3a-fe74-4a33-9063-d6195ca17dee admin admin] RBAC: Authorizing `identity:delete_project(project_id=5393c21377cf47f09ce72bddf179d1fe)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:41.035518 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d20c3a-fe74-4a33-9063-d6195ca17dee admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:41.170195 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-80d20c3a-fe74-4a33-9063-d6195ca17dee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5393c21377cf47f09ce72bddf179d1fe', 'request_id': 'req-80d20c3a-fe74-4a33-9063-d6195ca17dee'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:41.266204 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-80d20c3a-fe74-4a33-9063-d6195ca17dee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5393c21377cf47f09ce72bddf179d1fe', 'request_id': 'req-80d20c3a-fe74-4a33-9063-d6195ca17dee'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:41.274527 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-80d20c3a-fe74-4a33-9063-d6195ca17dee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5393c21377cf47f09ce72bddf179d1fe', 'request_id': 'req-80d20c3a-fe74-4a33-9063-d6195ca17dee'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:41.286453 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-80d20c3a-fe74-4a33-9063-d6195ca17dee admin admin] The token cache is being invalidate because project 5393c21377cf47f09ce72bddf179d1fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:52:41.286735 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-80d20c3a-fe74-4a33-9063-d6195ca17dee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:41.287411 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-80d20c3a-fe74-4a33-9063-d6195ca17dee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:41.289072 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1143/2302] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 16:52:40 2022] DELETE /identity/v3/projects/5393c21377cf47f09ce72bddf179d1fe => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:41.293113 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee40491-f38b-4546-bc88-51b12aa1681c service neutron] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:41.303497 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee40491-f38b-4546-bc88-51b12aa1681c service neutron] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:41.380251 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad194df-208f-404c-97ea-746db214e2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:41.381135 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad194df-208f-404c-97ea-746db214e2e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:41.381414 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad194df-208f-404c-97ea-746db214e2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:41.382486 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad194df-208f-404c-97ea-746db214e2e5 admin admin] PATH_INFO: `/v3/users/223f12f2d25e43fdba2fd12872db70a7` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:41.384107 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad194df-208f-404c-97ea-746db214e2e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=223f12f2d25e43fdba2fd12872db70a7)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:41.386349 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad194df-208f-404c-97ea-746db214e2e5 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:41.431338 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:41.632113 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-1ad194df-208f-404c-97ea-746db214e2e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '223f12f2d25e43fdba2fd12872db70a7'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:41.647224 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-1ad194df-208f-404c-97ea-746db214e2e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '223f12f2d25e43fdba2fd12872db70a7'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:41.648197 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-1ad194df-208f-404c-97ea-746db214e2e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '223f12f2d25e43fdba2fd12872db70a7'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:41.655675 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-1ad194df-208f-404c-97ea-746db214e2e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '223f12f2d25e43fdba2fd12872db70a7'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:41.748680 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-1ad194df-208f-404c-97ea-746db214e2e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '223f12f2d25e43fdba2fd12872db70a7'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:41.757929 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1160/2303] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 16:52:41 2022] DELETE /identity/v3/users/223f12f2d25e43fdba2fd12872db70a7 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:42.275064 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d20c3a-fe74-4a33-9063-d6195ca17dee admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:42.277517 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-80d20c3a-fe74-4a33-9063-d6195ca17dee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:42.309919 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d20c3a-fe74-4a33-9063-d6195ca17dee admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:42.349298 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:42.396000 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833e3474-596f-4ce9-af12-2cc17e8600af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:42.397377 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833e3474-596f-4ce9-af12-2cc17e8600af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:42.397939 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833e3474-596f-4ce9-af12-2cc17e8600af admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:42.398217 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833e3474-596f-4ce9-af12-2cc17e8600af admin admin] PATH_INFO: `/v3/projects/779844fd082142149f109f62d0e512a5` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:42.399588 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833e3474-596f-4ce9-af12-2cc17e8600af admin admin] RBAC: Authorizing `identity:delete_project(project_id=779844fd082142149f109f62d0e512a5)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:42.402027 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833e3474-596f-4ce9-af12-2cc17e8600af admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:42.745262 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-833e3474-596f-4ce9-af12-2cc17e8600af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '779844fd082142149f109f62d0e512a5', 'request_id': 'req-833e3474-596f-4ce9-af12-2cc17e8600af'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:42.994128 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-833e3474-596f-4ce9-af12-2cc17e8600af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '779844fd082142149f109f62d0e512a5', 'request_id': 'req-833e3474-596f-4ce9-af12-2cc17e8600af'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:43.000817 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-833e3474-596f-4ce9-af12-2cc17e8600af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '779844fd082142149f109f62d0e512a5', 'request_id': 'req-833e3474-596f-4ce9-af12-2cc17e8600af'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:43.012443 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-833e3474-596f-4ce9-af12-2cc17e8600af admin admin] The token cache is being invalidate because project 779844fd082142149f109f62d0e512a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:52:43.012733 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-833e3474-596f-4ce9-af12-2cc17e8600af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:43.013474 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-833e3474-596f-4ce9-af12-2cc17e8600af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:43.015033 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1144/2304] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 16:52:42 2022] DELETE /identity/v3/projects/779844fd082142149f109f62d0e512a5 => generated 0 bytes in 741 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:43.019029 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad194df-208f-404c-97ea-746db214e2e5 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:43.020568 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-1ad194df-208f-404c-97ea-746db214e2e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:43.034357 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad194df-208f-404c-97ea-746db214e2e5 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:43.099351 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcf587b-8c3f-4d6d-86e3-f1a2561ee229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:43.100192 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf587b-8c3f-4d6d-86e3-f1a2561ee229 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:43.100476 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf587b-8c3f-4d6d-86e3-f1a2561ee229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:43.100798 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf587b-8c3f-4d6d-86e3-f1a2561ee229 admin admin] PATH_INFO: `/v3/users/e67dbf6b8a924f1e841b2c52653c1f0c` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:43.102027 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcf587b-8c3f-4d6d-86e3-f1a2561ee229 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e67dbf6b8a924f1e841b2c52653c1f0c)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:43.103988 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcf587b-8c3f-4d6d-86e3-f1a2561ee229 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:43.219336 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:43.326472 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-dfcf587b-8c3f-4d6d-86e3-f1a2561ee229 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e67dbf6b8a924f1e841b2c52653c1f0c'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:43.338234 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-dfcf587b-8c3f-4d6d-86e3-f1a2561ee229 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e67dbf6b8a924f1e841b2c52653c1f0c'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:43.338925 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-dfcf587b-8c3f-4d6d-86e3-f1a2561ee229 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e67dbf6b8a924f1e841b2c52653c1f0c'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:43.348479 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-dfcf587b-8c3f-4d6d-86e3-f1a2561ee229 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e67dbf6b8a924f1e841b2c52653c1f0c'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:43.444526 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-dfcf587b-8c3f-4d6d-86e3-f1a2561ee229 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e67dbf6b8a924f1e841b2c52653c1f0c'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:43.454771 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1161/2305] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 16:52:43 2022] DELETE /identity/v3/users/e67dbf6b8a924f1e841b2c52653c1f0c => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:44.017560 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833e3474-596f-4ce9-af12-2cc17e8600af admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:44.019098 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-833e3474-596f-4ce9-af12-2cc17e8600af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:44.033448 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833e3474-596f-4ce9-af12-2cc17e8600af admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:44.092343 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fa81ab-913f-4b36-b083-dfe6f897092c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:44.093215 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa81ab-913f-4b36-b083-dfe6f897092c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:44.093497 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa81ab-913f-4b36-b083-dfe6f897092c admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:44.093775 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa81ab-913f-4b36-b083-dfe6f897092c admin admin] PATH_INFO: `/v3/projects/2dd6651fdaa942e5b7c2b9131cb47002` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:44.095006 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fa81ab-913f-4b36-b083-dfe6f897092c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2dd6651fdaa942e5b7c2b9131cb47002)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:44.096965 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fa81ab-913f-4b36-b083-dfe6f897092c admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:44.253058 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:44.339204 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-26fa81ab-913f-4b36-b083-dfe6f897092c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2dd6651fdaa942e5b7c2b9131cb47002', 'request_id': 'req-26fa81ab-913f-4b36-b083-dfe6f897092c'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:44.409816 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcf587b-8c3f-4d6d-86e3-f1a2561ee229 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:44.412707 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-dfcf587b-8c3f-4d6d-86e3-f1a2561ee229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:44.447198 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcf587b-8c3f-4d6d-86e3-f1a2561ee229 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:44.469532 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-26fa81ab-913f-4b36-b083-dfe6f897092c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2dd6651fdaa942e5b7c2b9131cb47002', 'request_id': 'req-26fa81ab-913f-4b36-b083-dfe6f897092c'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:44.480864 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-26fa81ab-913f-4b36-b083-dfe6f897092c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2dd6651fdaa942e5b7c2b9131cb47002', 'request_id': 'req-26fa81ab-913f-4b36-b083-dfe6f897092c'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:44.494214 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-26fa81ab-913f-4b36-b083-dfe6f897092c admin admin] The token cache is being invalidate because project 2dd6651fdaa942e5b7c2b9131cb47002 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:52:44.494606 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-26fa81ab-913f-4b36-b083-dfe6f897092c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:44.495469 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-26fa81ab-913f-4b36-b083-dfe6f897092c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:44.508278 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1145/2306] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 16:52:44 2022] DELETE /identity/v3/projects/2dd6651fdaa942e5b7c2b9131cb47002 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:44.510393 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e8b0d-af80-46ac-bc33-789d2777a29b None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:44.510884 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e8b0d-af80-46ac-bc33-789d2777a29b None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:44.511314 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e8b0d-af80-46ac-bc33-789d2777a29b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:44.513201 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a256a-2576-424c-b1d5-490a4121d329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:44.514221 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a256a-2576-424c-b1d5-490a4121d329 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:44.514509 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a256a-2576-424c-b1d5-490a4121d329 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:44.514784 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a256a-2576-424c-b1d5-490a4121d329 admin admin] PATH_INFO: `/v3/users/830287a2fc744eeab78211bf57239b7c` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:44.516114 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890a256a-2576-424c-b1d5-490a4121d329 admin admin] RBAC: Authorizing `identity:delete_user(user_id=830287a2fc744eeab78211bf57239b7c)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:44.518065 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890a256a-2576-424c-b1d5-490a4121d329 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:44.534426 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-361e8b0d-af80-46ac-bc33-789d2777a29b None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:44.535817 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-361e8b0d-af80-46ac-bc33-789d2777a29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:44.547465 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1146/2307] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:52:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:52:44.557171 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06dbf21-e260-4aee-8dcf-353f33cb74ba None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:44.557490 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06dbf21-e260-4aee-8dcf-353f33cb74ba None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:44.558751 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06dbf21-e260-4aee-8dcf-353f33cb74ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:44.584062 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-f06dbf21-e260-4aee-8dcf-353f33cb74ba None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:44.586596 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-f06dbf21-e260-4aee-8dcf-353f33cb74ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:44.598384 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1147/2308] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:52:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:52:44.605078 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06dbf21-e260-4aee-8dcf-353f33cb74ba None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:44.614643 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06dbf21-e260-4aee-8dcf-353f33cb74ba None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:44.621473 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e2ef51-e081-4f99-ae5a-973d8f93c5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:44.622293 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2ef51-e081-4f99-ae5a-973d8f93c5ff admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:44.622798 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2ef51-e081-4f99-ae5a-973d8f93c5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:44.623079 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2ef51-e081-4f99-ae5a-973d8f93c5ff admin admin] PATH_INFO: `/v3/domains` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:44.624192 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e2ef51-e081-4f99-ae5a-973d8f93c5ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:52:44.624498 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e2ef51-e081-4f99-ae5a-973d8f93c5ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:44.626778 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e2ef51-e081-4f99-ae5a-973d8f93c5ff admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:44.640090 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1148/2309] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Jul 18 16:52:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:52:44.644565 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e2ef51-e081-4f99-ae5a-973d8f93c5ff admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:44.655317 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e2ef51-e081-4f99-ae5a-973d8f93c5ff admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:44.660551 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f54ab4-5d2e-4729-b8b7-6eb8fd672831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:44.660849 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f54ab4-5d2e-4729-b8b7-6eb8fd672831 admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:44.661002 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f54ab4-5d2e-4729-b8b7-6eb8fd672831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:44.661282 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f54ab4-5d2e-4729-b8b7-6eb8fd672831 admin admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:44.661972 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f54ab4-5d2e-4729-b8b7-6eb8fd672831 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:44.664866 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f54ab4-5d2e-4729-b8b7-6eb8fd672831 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:44.774535 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-890a256a-2576-424c-b1d5-490a4121d329 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '830287a2fc744eeab78211bf57239b7c'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:44.786403 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-890a256a-2576-424c-b1d5-490a4121d329 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '830287a2fc744eeab78211bf57239b7c'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:44.787087 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-890a256a-2576-424c-b1d5-490a4121d329 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '830287a2fc744eeab78211bf57239b7c'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:44.794960 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-890a256a-2576-424c-b1d5-490a4121d329 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '830287a2fc744eeab78211bf57239b7c'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:44.799909 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1149/2310] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:52:44 2022] POST /identity/v3/projects => generated 373 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:52:44.800605 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f54ab4-5d2e-4729-b8b7-6eb8fd672831 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:44.802382 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-58f54ab4-5d2e-4729-b8b7-6eb8fd672831 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:44.878586 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f54ab4-5d2e-4729-b8b7-6eb8fd672831 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:44.882664 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcac287b-dcc7-4839-a092-5d3d1122c61c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:44.883308 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac287b-dcc7-4839-a092-5d3d1122c61c service neutron] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:44.883578 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac287b-dcc7-4839-a092-5d3d1122c61c service neutron] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:44.883920 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac287b-dcc7-4839-a092-5d3d1122c61c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:44.885544 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-890a256a-2576-424c-b1d5-490a4121d329 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '830287a2fc744eeab78211bf57239b7c'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:44.894923 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-fcac287b-dcc7-4839-a092-5d3d1122c61c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:44.895062 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1162/2311] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 16:52:44 2022] DELETE /identity/v3/users/830287a2fc744eeab78211bf57239b7c => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:44.895062 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a256a-2576-424c-b1d5-490a4121d329 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:44.895062 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-890a256a-2576-424c-b1d5-490a4121d329 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:44.951473 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcac287b-dcc7-4839-a092-5d3d1122c61c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:44.953058 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcac287b-dcc7-4839-a092-5d3d1122c61c service neutron] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:44.959982 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a256a-2576-424c-b1d5-490a4121d329 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:44.963555 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1150/2312] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:52:44 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:52:44.964985 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd67028-b2e9-41d6-87ff-b8080634e9c5 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:44.965468 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd67028-b2e9-41d6-87ff-b8080634e9c5 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:44.965716 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd67028-b2e9-41d6-87ff-b8080634e9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:44.966051 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00811e89-3a4b-4f5a-a554-893cf94c97fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:44.966724 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00811e89-3a4b-4f5a-a554-893cf94c97fb admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:44.967004 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00811e89-3a4b-4f5a-a554-893cf94c97fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:44.968052 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00811e89-3a4b-4f5a-a554-893cf94c97fb admin admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:44.969008 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00811e89-3a4b-4f5a-a554-893cf94c97fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:44.971199 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00811e89-3a4b-4f5a-a554-893cf94c97fb admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:44.984061 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-3dd67028-b2e9-41d6-87ff-b8080634e9c5 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:44.985383 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-3dd67028-b2e9-41d6-87ff-b8080634e9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:44.993548 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1151/2313] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:52:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:52:45.004038 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd67028-b2e9-41d6-87ff-b8080634e9c5 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:45.005534 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-3dd67028-b2e9-41d6-87ff-b8080634e9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:45.063953 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1163/2314] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 16:52:44 2022] POST /identity/v3/users => generated 287 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:52:45.068099 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00811e89-3a4b-4f5a-a554-893cf94c97fb admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:45.073037 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd67028-b2e9-41d6-87ff-b8080634e9c5 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:45.077784 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ffef5d-cd64-40fe-806c-11a1fd38b6b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:45.078547 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ffef5d-cd64-40fe-806c-11a1fd38b6b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:45.078839 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ffef5d-cd64-40fe-806c-11a1fd38b6b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:45.079109 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ffef5d-cd64-40fe-806c-11a1fd38b6b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:45.083394 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00811e89-3a4b-4f5a-a554-893cf94c97fb admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:45.090030 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4132279-9f8c-4740-905f-7fcda043923b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:45.090238 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ffef5d-cd64-40fe-806c-11a1fd38b6b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:45.090875 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4132279-9f8c-4740-905f-7fcda043923b admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:45.091226 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4132279-9f8c-4740-905f-7fcda043923b admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:45.091573 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4132279-9f8c-4740-905f-7fcda043923b admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:45.091784 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ffef5d-cd64-40fe-806c-11a1fd38b6b2 service neutron] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:45.092477 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4132279-9f8c-4740-905f-7fcda043923b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:45.094171 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4132279-9f8c-4740-905f-7fcda043923b admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:45.102287 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1152/2315] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:52:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 16:52:45.107482 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1164/2316] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:52:45 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:52:45.111044 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ffef5d-cd64-40fe-806c-11a1fd38b6b2 service neutron] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:45.121190 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ffef5d-cd64-40fe-806c-11a1fd38b6b2 service neutron] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:45.126286 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837d082e-9a0c-4bff-a6c5-40173d35b5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:45.126971 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d082e-9a0c-4bff-a6c5-40173d35b5ab admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:45.127260 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d082e-9a0c-4bff-a6c5-40173d35b5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:45.127536 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d082e-9a0c-4bff-a6c5-40173d35b5ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:45.128556 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837d082e-9a0c-4bff-a6c5-40173d35b5ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:45.130217 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837d082e-9a0c-4bff-a6c5-40173d35b5ab admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:45.141746 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1153/2317] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:52:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:52:45.146162 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4132279-9f8c-4740-905f-7fcda043923b admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:45.159260 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4132279-9f8c-4740-905f-7fcda043923b admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:45.166274 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea39fe1-4545-4706-91a8-c567b60f6361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:45.167065 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea39fe1-4545-4706-91a8-c567b60f6361 admin admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:45.167345 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea39fe1-4545-4706-91a8-c567b60f6361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:45.167619 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea39fe1-4545-4706-91a8-c567b60f6361 admin admin] PATH_INFO: `/v3/projects/a796216c159e437abc7515f0abb558fb/users/60f5a94486a74d31a195adf28367dc9b/roles/ad3a2bc7b2094a4da1a95a143c8d9436` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:45.178402 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a054c-2ec6-4132-a06e-72490b77e0b7 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:45.178733 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a054c-2ec6-4132-a06e-72490b77e0b7 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:45.179005 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a054c-2ec6-4132-a06e-72490b77e0b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:45.188089 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea39fe1-4545-4706-91a8-c567b60f6361 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a796216c159e437abc7515f0abb558fb, user_id=60f5a94486a74d31a195adf28367dc9b, role_id=ad3a2bc7b2094a4da1a95a143c8d9436)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:45.191057 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea39fe1-4545-4706-91a8-c567b60f6361 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:45.202561 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-9d5a054c-2ec6-4132-a06e-72490b77e0b7 None None] MFA Rules not processed for user `ea2a096c4b964f03aed533d1e5e96db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:45.204090 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-9d5a054c-2ec6-4132-a06e-72490b77e0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:45.264763 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1154/2318] 10.222.0.81 () {58 vars in 1009 bytes} [Mon Jul 18 16:52:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:52:45.288271 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5a054c-2ec6-4132-a06e-72490b77e0b7 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:45.290753 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-9d5a054c-2ec6-4132-a06e-72490b77e0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:45.359118 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1165/2319] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:52:45 2022] PUT /identity/v3/projects/a796216c159e437abc7515f0abb558fb/users/60f5a94486a74d31a195adf28367dc9b/roles/ad3a2bc7b2094a4da1a95a143c8d9436 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:45.364741 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319c2f8-87a1-4341-89b9-eaf0e9e1e6d4 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:45.365039 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319c2f8-87a1-4341-89b9-eaf0e9e1e6d4 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:45.365489 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319c2f8-87a1-4341-89b9-eaf0e9e1e6d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:45.378883 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5a054c-2ec6-4132-a06e-72490b77e0b7 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:45.395318 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-a319c2f8-87a1-4341-89b9-eaf0e9e1e6d4 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:45.396758 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-a319c2f8-87a1-4341-89b9-eaf0e9e1e6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:45.432998 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:45.529830 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3923a064-8afe-40ea-a48a-feb11b016799 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251475c53ac64cd48ae84567d8c2ee87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:45.529830 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923a064-8afe-40ea-a48a-feb11b016799 service swift] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:45.529830 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923a064-8afe-40ea-a48a-feb11b016799 service swift] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:45.529830 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923a064-8afe-40ea-a48a-feb11b016799 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:45.554882 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1166/2320] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:52:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:52:45.594278 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a319c2f8-87a1-4341-89b9-eaf0e9e1e6d4 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:45.741620 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3923a064-8afe-40ea-a48a-feb11b016799 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:45.742604 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a319c2f8-87a1-4341-89b9-eaf0e9e1e6d4 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:45.743088 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3923a064-8afe-40ea-a48a-feb11b016799 service swift] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:45.748548 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd24c0ac-d522-40bb-9fa5-92c6be3c4b88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:45.749586 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24c0ac-d522-40bb-9fa5-92c6be3c4b88 service neutron] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:45.750180 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24c0ac-d522-40bb-9fa5-92c6be3c4b88 service neutron] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:45.750754 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24c0ac-d522-40bb-9fa5-92c6be3c4b88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:45.763126 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1155/2321] 10.222.0.81 () {60 vars in 1384 bytes} [Mon Jul 18 16:52:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 18 16:52:45.771218 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd24c0ac-d522-40bb-9fa5-92c6be3c4b88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:45.771218 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd24c0ac-d522-40bb-9fa5-92c6be3c4b88 service neutron] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:45.785110 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1167/2322] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:52:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:52:46.095589 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3923a064-8afe-40ea-a48a-feb11b016799 service swift] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:46.097554 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-3923a064-8afe-40ea-a48a-feb11b016799 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:46.134107 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3923a064-8afe-40ea-a48a-feb11b016799 service swift] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:46.156864 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a74690-c3dc-43de-99a4-28b5e10eeb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:46.159108 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a74690-c3dc-43de-99a4-28b5e10eeb94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:46.159905 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a74690-c3dc-43de-99a4-28b5e10eeb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:46.160606 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a74690-c3dc-43de-99a4-28b5e10eeb94 admin admin] PATH_INFO: `/v3/projects/a1a96a6e35e04a0a812ab72947f8ab38` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:46.164173 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a74690-c3dc-43de-99a4-28b5e10eeb94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1a96a6e35e04a0a812ab72947f8ab38)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:46.170770 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a74690-c3dc-43de-99a4-28b5e10eeb94 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:46.394085 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-a5a74690-c3dc-43de-99a4-28b5e10eeb94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1a96a6e35e04a0a812ab72947f8ab38', 'request_id': 'req-a5a74690-c3dc-43de-99a4-28b5e10eeb94'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:46.527658 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-a5a74690-c3dc-43de-99a4-28b5e10eeb94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1a96a6e35e04a0a812ab72947f8ab38', 'request_id': 'req-a5a74690-c3dc-43de-99a4-28b5e10eeb94'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:46.543889 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-a5a74690-c3dc-43de-99a4-28b5e10eeb94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1a96a6e35e04a0a812ab72947f8ab38', 'request_id': 'req-a5a74690-c3dc-43de-99a4-28b5e10eeb94'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:46.562161 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-a5a74690-c3dc-43de-99a4-28b5e10eeb94 admin admin] The token cache is being invalidate because project a1a96a6e35e04a0a812ab72947f8ab38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:52:46.562461 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-a5a74690-c3dc-43de-99a4-28b5e10eeb94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:46.563881 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-a5a74690-c3dc-43de-99a4-28b5e10eeb94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:46.586690 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1156/2323] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 16:52:46 2022] DELETE /identity/v3/projects/a1a96a6e35e04a0a812ab72947f8ab38 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:46.587421 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd24c0ac-d522-40bb-9fa5-92c6be3c4b88 service neutron] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:46.598536 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd24c0ac-d522-40bb-9fa5-92c6be3c4b88 service neutron] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:46.813615 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d3294-a45f-4b10-a2b0-f2de6e28c850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:46.815702 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d3294-a45f-4b10-a2b0-f2de6e28c850 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:46.816257 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d3294-a45f-4b10-a2b0-f2de6e28c850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:46.816689 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d3294-a45f-4b10-a2b0-f2de6e28c850 admin admin] PATH_INFO: `/v3/users/af1c686ea9aa4a55bb67a4182525ab08` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:46.818413 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3d3294-a45f-4b10-a2b0-f2de6e28c850 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af1c686ea9aa4a55bb67a4182525ab08)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:46.821342 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3d3294-a45f-4b10-a2b0-f2de6e28c850 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:47.117436 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-0b3d3294-a45f-4b10-a2b0-f2de6e28c850 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af1c686ea9aa4a55bb67a4182525ab08'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:47.155640 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-0b3d3294-a45f-4b10-a2b0-f2de6e28c850 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af1c686ea9aa4a55bb67a4182525ab08'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:47.155640 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-0b3d3294-a45f-4b10-a2b0-f2de6e28c850 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af1c686ea9aa4a55bb67a4182525ab08'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:47.162831 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf09d7-3cee-491c-a7a6-59a50578d86e None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:47.164383 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf09d7-3cee-491c-a7a6-59a50578d86e None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:47.164865 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf09d7-3cee-491c-a7a6-59a50578d86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:47.172158 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-0b3d3294-a45f-4b10-a2b0-f2de6e28c850 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af1c686ea9aa4a55bb67a4182525ab08'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:47.190584 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-a8bf09d7-3cee-491c-a7a6-59a50578d86e None None] MFA Rules not processed for user `ea2a096c4b964f03aed533d1e5e96db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:47.192459 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-a8bf09d7-3cee-491c-a7a6-59a50578d86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:47.267027 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-0b3d3294-a45f-4b10-a2b0-f2de6e28c850 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af1c686ea9aa4a55bb67a4182525ab08'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:47.273768 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1157/2324] 10.222.0.81 () {58 vars in 967 bytes} [Mon Jul 18 16:52:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:52:47.294399 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1168/2325] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 16:52:46 2022] DELETE /identity/v3/users/af1c686ea9aa4a55bb67a4182525ab08 => generated 0 bytes in 704 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:47.296875 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bf09d7-3cee-491c-a7a6-59a50578d86e None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:47.298438 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-a8bf09d7-3cee-491c-a7a6-59a50578d86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:47.380915 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bf09d7-3cee-491c-a7a6-59a50578d86e None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:47.454588 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe112ed-758a-4651-848a-275df02e54c5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251475c53ac64cd48ae84567d8c2ee87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:47.455408 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe112ed-758a-4651-848a-275df02e54c5 service swift] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:47.455691 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe112ed-758a-4651-848a-275df02e54c5 service swift] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:47.464532 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe112ed-758a-4651-848a-275df02e54c5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:47.529422 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe112ed-758a-4651-848a-275df02e54c5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:47.529422 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe112ed-758a-4651-848a-275df02e54c5 service swift] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:47.537831 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1158/2326] 10.222.0.81 () {60 vars in 1384 bytes} [Mon Jul 18 16:52:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 16:52:47.638040 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:47.871805 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d3294-a45f-4b10-a2b0-f2de6e28c850 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:47.873463 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-0b3d3294-a45f-4b10-a2b0-f2de6e28c850 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:47.959344 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d3294-a45f-4b10-a2b0-f2de6e28c850 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:47.978111 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71071da9-900b-477a-993a-01d63b761a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:47.980287 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71071da9-900b-477a-993a-01d63b761a8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:47.980856 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71071da9-900b-477a-993a-01d63b761a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:47.981142 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71071da9-900b-477a-993a-01d63b761a8b admin admin] PATH_INFO: `/v3/projects/c867a02d3edc4ce9bfaf0dee472dd818` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:47.982460 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71071da9-900b-477a-993a-01d63b761a8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c867a02d3edc4ce9bfaf0dee472dd818)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:47.984560 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71071da9-900b-477a-993a-01d63b761a8b admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:48.127816 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9a7018-4a57-46c9-8270-170206ec31e4 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:48.128744 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9a7018-4a57-46c9-8270-170206ec31e4 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:48.129875 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9a7018-4a57-46c9-8270-170206ec31e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:48.163876 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-71071da9-900b-477a-993a-01d63b761a8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c867a02d3edc4ce9bfaf0dee472dd818', 'request_id': 'req-71071da9-900b-477a-993a-01d63b761a8b'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:48.184611 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-cc9a7018-4a57-46c9-8270-170206ec31e4 None None] MFA Rules not processed for user `60f5a94486a74d31a195adf28367dc9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:48.185949 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-cc9a7018-4a57-46c9-8270-170206ec31e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:48.188706 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-71071da9-900b-477a-993a-01d63b761a8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c867a02d3edc4ce9bfaf0dee472dd818', 'request_id': 'req-71071da9-900b-477a-993a-01d63b761a8b'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:48.221833 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-71071da9-900b-477a-993a-01d63b761a8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c867a02d3edc4ce9bfaf0dee472dd818', 'request_id': 'req-71071da9-900b-477a-993a-01d63b761a8b'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:48.252985 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:48.342405 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-71071da9-900b-477a-993a-01d63b761a8b admin admin] The token cache is being invalidate because project c867a02d3edc4ce9bfaf0dee472dd818 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:52:48.343250 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-71071da9-900b-477a-993a-01d63b761a8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:48.346919 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1159/2327] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:52:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:52:48.348438 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-71071da9-900b-477a-993a-01d63b761a8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:48.350999 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1169/2328] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 16:52:47 2022] DELETE /identity/v3/projects/c867a02d3edc4ce9bfaf0dee472dd818 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:48.361231 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71071da9-900b-477a-993a-01d63b761a8b admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:48.363018 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9a7018-4a57-46c9-8270-170206ec31e4 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:48.364693 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-71071da9-900b-477a-993a-01d63b761a8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:48.570754 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71071da9-900b-477a-993a-01d63b761a8b admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:48.571955 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9a7018-4a57-46c9-8270-170206ec31e4 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:48.574497 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c07071f-3958-4e21-9296-ad4de4cfce4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:48.575319 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07071f-3958-4e21-9296-ad4de4cfce4e service cinder] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:48.575598 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07071f-3958-4e21-9296-ad4de4cfce4e service cinder] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:48.575954 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07071f-3958-4e21-9296-ad4de4cfce4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:48.577733 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-9c07071f-3958-4e21-9296-ad4de4cfce4e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:48.578368 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a83061-ed6a-49de-82c6-c4841cd693d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:48.579592 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a83061-ed6a-49de-82c6-c4841cd693d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:48.579742 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a83061-ed6a-49de-82c6-c4841cd693d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:48.580091 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a83061-ed6a-49de-82c6-c4841cd693d5 admin admin] PATH_INFO: `/v3/users/a2f8e000c99644028fe0e5e966b060bd` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:48.581392 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a83061-ed6a-49de-82c6-c4841cd693d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2f8e000c99644028fe0e5e966b060bd)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:48.584085 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a83061-ed6a-49de-82c6-c4841cd693d5 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:48.590713 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c07071f-3958-4e21-9296-ad4de4cfce4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:48.598515 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c07071f-3958-4e21-9296-ad4de4cfce4e service cinder] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:48.603495 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1170/2329] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:52:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:52:48.606802 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70640c-84fe-4df3-ad4c-5a2d3e3826a7 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:48.616069 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70640c-84fe-4df3-ad4c-5a2d3e3826a7 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:48.618063 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70640c-84fe-4df3-ad4c-5a2d3e3826a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:48.644880 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-8a70640c-84fe-4df3-ad4c-5a2d3e3826a7 None None] MFA Rules not processed for user `ea2a096c4b964f03aed533d1e5e96db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:48.646411 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-8a70640c-84fe-4df3-ad4c-5a2d3e3826a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:48.728326 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1171/2330] 10.222.0.81 () {58 vars in 1009 bytes} [Mon Jul 18 16:52:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:52:48.736563 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70640c-84fe-4df3-ad4c-5a2d3e3826a7 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:48.739450 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-8a70640c-84fe-4df3-ad4c-5a2d3e3826a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:48.835929 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70640c-84fe-4df3-ad4c-5a2d3e3826a7 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:48.841790 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae9f268-09db-4054-9fe6-623c51807107 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251475c53ac64cd48ae84567d8c2ee87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:48.842453 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9f268-09db-4054-9fe6-623c51807107 service swift] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:48.842736 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9f268-09db-4054-9fe6-623c51807107 service swift] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:48.843112 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9f268-09db-4054-9fe6-623c51807107 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:48.853281 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae9f268-09db-4054-9fe6-623c51807107 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:48.856545 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae9f268-09db-4054-9fe6-623c51807107 service swift] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:48.869047 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1172/2331] 10.222.0.81 () {60 vars in 1384 bytes} [Mon Jul 18 16:52:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 16:52:48.885518 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-86a83061-ed6a-49de-82c6-c4841cd693d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2f8e000c99644028fe0e5e966b060bd'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:48.886600 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-86a83061-ed6a-49de-82c6-c4841cd693d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2f8e000c99644028fe0e5e966b060bd'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:48.904801 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-86a83061-ed6a-49de-82c6-c4841cd693d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2f8e000c99644028fe0e5e966b060bd'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:49.097637 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-86a83061-ed6a-49de-82c6-c4841cd693d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2f8e000c99644028fe0e5e966b060bd'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:49.112253 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-86a83061-ed6a-49de-82c6-c4841cd693d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2f8e000c99644028fe0e5e966b060bd'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:49.128799 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1160/2332] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 16:52:48 2022] DELETE /identity/v3/users/a2f8e000c99644028fe0e5e966b060bd => generated 0 bytes in 761 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:49.890981 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa9708-7d72-47c8-b2ca-f931f40845cf None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:49.890981 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa9708-7d72-47c8-b2ca-f931f40845cf None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:49.891642 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa9708-7d72-47c8-b2ca-f931f40845cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:49.942216 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-6dfa9708-7d72-47c8-b2ca-f931f40845cf None None] MFA Rules not processed for user `ea2a096c4b964f03aed533d1e5e96db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:49.943478 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-6dfa9708-7d72-47c8-b2ca-f931f40845cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:50.074822 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1173/2333] 10.222.0.81 () {58 vars in 967 bytes} [Mon Jul 18 16:52:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:52:50.091255 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a83061-ed6a-49de-82c6-c4841cd693d5 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:50.092837 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-86a83061-ed6a-49de-82c6-c4841cd693d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:50.176917 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfa9708-7d72-47c8-b2ca-f931f40845cf None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:50.179322 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-6dfa9708-7d72-47c8-b2ca-f931f40845cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:50.186409 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a83061-ed6a-49de-82c6-c4841cd693d5 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:50.199943 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ca0e8-f263-4587-9385-2ec77bb422aa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251475c53ac64cd48ae84567d8c2ee87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:50.200841 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ca0e8-f263-4587-9385-2ec77bb422aa service swift] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:50.201228 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ca0e8-f263-4587-9385-2ec77bb422aa service swift] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:50.203474 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ca0e8-f263-4587-9385-2ec77bb422aa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:50.227401 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0ca0e8-f263-4587-9385-2ec77bb422aa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:50.227401 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0ca0e8-f263-4587-9385-2ec77bb422aa service swift] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:50.233135 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1161/2334] 10.222.0.81 () {60 vars in 1384 bytes} [Mon Jul 18 16:52:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 16:52:50.309160 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfa9708-7d72-47c8-b2ca-f931f40845cf None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:50.313812 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baab23e-6bae-4e44-830a-59bb261172dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:50.314679 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baab23e-6bae-4e44-830a-59bb261172dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:50.314965 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baab23e-6bae-4e44-830a-59bb261172dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:50.315241 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baab23e-6bae-4e44-830a-59bb261172dc admin admin] PATH_INFO: `/v3/projects/d80b9c211d634ea0a6067a035ef713da` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:50.316409 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baab23e-6bae-4e44-830a-59bb261172dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d80b9c211d634ea0a6067a035ef713da)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:50.318311 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baab23e-6bae-4e44-830a-59bb261172dc admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:50.489931 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-1baab23e-6bae-4e44-830a-59bb261172dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd80b9c211d634ea0a6067a035ef713da', 'request_id': 'req-1baab23e-6bae-4e44-830a-59bb261172dc'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:50.495957 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-1baab23e-6bae-4e44-830a-59bb261172dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd80b9c211d634ea0a6067a035ef713da', 'request_id': 'req-1baab23e-6bae-4e44-830a-59bb261172dc'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:50.502863 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-1baab23e-6bae-4e44-830a-59bb261172dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd80b9c211d634ea0a6067a035ef713da', 'request_id': 'req-1baab23e-6bae-4e44-830a-59bb261172dc'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:50.650055 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-1baab23e-6bae-4e44-830a-59bb261172dc admin admin] The token cache is being invalidate because project d80b9c211d634ea0a6067a035ef713da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:52:50.650293 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-1baab23e-6bae-4e44-830a-59bb261172dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:50.651427 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-1baab23e-6bae-4e44-830a-59bb261172dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:50.653932 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1174/2335] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 16:52:50 2022] DELETE /identity/v3/projects/d80b9c211d634ea0a6067a035ef713da => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:50.658785 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f82ff00-ce7a-4a75-95cf-d3693f0c486d None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:50.659065 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f82ff00-ce7a-4a75-95cf-d3693f0c486d None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:50.659517 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f82ff00-ce7a-4a75-95cf-d3693f0c486d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:50.679388 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-8f82ff00-ce7a-4a75-95cf-d3693f0c486d None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:50.680733 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-8f82ff00-ce7a-4a75-95cf-d3693f0c486d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:50.783266 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1162/2336] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:52:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:52:50.798056 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4732d-02a0-4d61-8ec8-141ff506f05c None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:50.798695 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4732d-02a0-4d61-8ec8-141ff506f05c None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:50.799184 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4732d-02a0-4d61-8ec8-141ff506f05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:50.820981 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-e8b4732d-02a0-4d61-8ec8-141ff506f05c None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:50.822201 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-e8b4732d-02a0-4d61-8ec8-141ff506f05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:50.830421 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1175/2337] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:52:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:52:50.834717 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f82ff00-ce7a-4a75-95cf-d3693f0c486d None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:50.845944 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f82ff00-ce7a-4a75-95cf-d3693f0c486d None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:50.853384 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee27813-322b-4c4b-a638-7a7e4bb85225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:50.853384 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee27813-322b-4c4b-a638-7a7e4bb85225 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:50.853384 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee27813-322b-4c4b-a638-7a7e4bb85225 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:50.853384 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee27813-322b-4c4b-a638-7a7e4bb85225 admin admin] PATH_INFO: `/v3/domains` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:50.853790 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee27813-322b-4c4b-a638-7a7e4bb85225 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:52:50.853790 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee27813-322b-4c4b-a638-7a7e4bb85225 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:50.854831 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee27813-322b-4c4b-a638-7a7e4bb85225 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:50.867726 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1163/2338] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Jul 18 16:52:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:52:50.872630 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b4732d-02a0-4d61-8ec8-141ff506f05c None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:50.882845 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b4732d-02a0-4d61-8ec8-141ff506f05c None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:50.891195 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf0207-858d-478b-9f03-bd43105af82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:50.891944 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf0207-858d-478b-9f03-bd43105af82f admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:50.892431 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf0207-858d-478b-9f03-bd43105af82f admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:50.892863 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf0207-858d-478b-9f03-bd43105af82f admin admin] PATH_INFO: `/v3/projects` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:50.893884 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdf0207-858d-478b-9f03-bd43105af82f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:50.896167 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdf0207-858d-478b-9f03-bd43105af82f admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:51.113721 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1176/2339] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:52:50 2022] POST /identity/v3/projects => generated 389 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:52:51.117531 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee27813-322b-4c4b-a638-7a7e4bb85225 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:51.129091 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee27813-322b-4c4b-a638-7a7e4bb85225 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:51.214767 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caa8cc0-36ad-456e-a610-b2cbc2c84d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:51.215534 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa8cc0-36ad-456e-a610-b2cbc2c84d98 admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:51.216332 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa8cc0-36ad-456e-a610-b2cbc2c84d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:51.216627 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa8cc0-36ad-456e-a610-b2cbc2c84d98 admin admin] PATH_INFO: `/v3/users` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:51.217436 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caa8cc0-36ad-456e-a610-b2cbc2c84d98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:51.219381 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caa8cc0-36ad-456e-a610-b2cbc2c84d98 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:51.331338 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:51.364534 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1164/2340] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 16:52:51 2022] POST /identity/v3/users => generated 295 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:52:51.369000 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf0207-858d-478b-9f03-bd43105af82f admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:51.382929 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf0207-858d-478b-9f03-bd43105af82f admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:51.398220 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90a523a-9b5e-4e8e-bad0-fd008fd3aba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:51.399037 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a523a-9b5e-4e8e-bad0-fd008fd3aba3 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:51.399418 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a523a-9b5e-4e8e-bad0-fd008fd3aba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:51.399822 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a523a-9b5e-4e8e-bad0-fd008fd3aba3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:51.400655 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90a523a-9b5e-4e8e-bad0-fd008fd3aba3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:51.402502 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90a523a-9b5e-4e8e-bad0-fd008fd3aba3 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:51.422828 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1177/2341] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:52:51.432699 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caa8cc0-36ad-456e-a610-b2cbc2c84d98 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:51.451692 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caa8cc0-36ad-456e-a610-b2cbc2c84d98 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:51.468930 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af10ef55-93d0-44d9-901c-7e241bb01742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:51.469203 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10ef55-93d0-44d9-901c-7e241bb01742 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:51.469493 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10ef55-93d0-44d9-901c-7e241bb01742 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:51.469741 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10ef55-93d0-44d9-901c-7e241bb01742 admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:51.470536 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af10ef55-93d0-44d9-901c-7e241bb01742 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:51.472220 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af10ef55-93d0-44d9-901c-7e241bb01742 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:51.498356 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1165/2342] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:52:51.501978 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90a523a-9b5e-4e8e-bad0-fd008fd3aba3 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:51.514412 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90a523a-9b5e-4e8e-bad0-fd008fd3aba3 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:51.521091 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27717841-64d9-419a-b80d-5f6b3977a15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:51.522230 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27717841-64d9-419a-b80d-5f6b3977a15e admin admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:51.522683 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27717841-64d9-419a-b80d-5f6b3977a15e admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:51.523159 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27717841-64d9-419a-b80d-5f6b3977a15e admin admin] PATH_INFO: `/v3/projects/a34ddc31468b40d98bbc6486eb9140b0/users/d6a83419f485478ea33cbe50bdd2e7f6/roles/ad3a2bc7b2094a4da1a95a143c8d9436` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:51.544466 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27717841-64d9-419a-b80d-5f6b3977a15e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a34ddc31468b40d98bbc6486eb9140b0, user_id=d6a83419f485478ea33cbe50bdd2e7f6, role_id=ad3a2bc7b2094a4da1a95a143c8d9436)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:51.548267 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27717841-64d9-419a-b80d-5f6b3977a15e admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:51.679415 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1178/2343] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:52:51 2022] PUT /identity/v3/projects/a34ddc31468b40d98bbc6486eb9140b0/users/d6a83419f485478ea33cbe50bdd2e7f6/roles/ad3a2bc7b2094a4da1a95a143c8d9436 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:51.691746 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fdaaf6-2bde-4341-b00f-6be1158889cd None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:51.692045 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fdaaf6-2bde-4341-b00f-6be1158889cd None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:51.692323 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fdaaf6-2bde-4341-b00f-6be1158889cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:51.720893 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-00fdaaf6-2bde-4341-b00f-6be1158889cd None None] MFA Rules not processed for user `d6a83419f485478ea33cbe50bdd2e7f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:51.724818 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-00fdaaf6-2bde-4341-b00f-6be1158889cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:51.859185 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1166/2344] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:52:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:52:51.869217 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27717841-64d9-419a-b80d-5f6b3977a15e admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:51.874981 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df235205-8563-4d44-8fc0-2385580ad0e2 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:51.875596 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df235205-8563-4d44-8fc0-2385580ad0e2 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:51.875596 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df235205-8563-4d44-8fc0-2385580ad0e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:51.895396 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-df235205-8563-4d44-8fc0-2385580ad0e2 None None] MFA Rules not processed for user `60f5a94486a74d31a195adf28367dc9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:51.897257 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-df235205-8563-4d44-8fc0-2385580ad0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:51.942013 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27717841-64d9-419a-b80d-5f6b3977a15e admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:51.954803 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3932b8-22af-48c8-abb2-9e6507f222a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:51.955527 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3932b8-22af-48c8-abb2-9e6507f222a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:51.955853 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3932b8-22af-48c8-abb2-9e6507f222a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:51.957015 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3932b8-22af-48c8-abb2-9e6507f222a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:51.957261 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3932b8-22af-48c8-abb2-9e6507f222a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:51.959505 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3932b8-22af-48c8-abb2-9e6507f222a3 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:51.973268 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1167/2345] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:52:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:52:52.085394 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:52.131479 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1179/2346] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:52:51 2022] POST /identity/v3/projects => generated 387 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:52:52.137630 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df235205-8563-4d44-8fc0-2385580ad0e2 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:52.154449 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df235205-8563-4d44-8fc0-2385580ad0e2 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:52.274574 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b02dd1d-b283-4919-947c-401ad88323d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:52.275507 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b02dd1d-b283-4919-947c-401ad88323d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:52.275835 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b02dd1d-b283-4919-947c-401ad88323d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:52.276114 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b02dd1d-b283-4919-947c-401ad88323d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:52.276958 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b02dd1d-b283-4919-947c-401ad88323d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:52.280136 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b02dd1d-b283-4919-947c-401ad88323d5 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:52.422465 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1168/2347] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 16:52:52 2022] POST /identity/v3/users => generated 300 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:52:52.428035 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3932b8-22af-48c8-abb2-9e6507f222a3 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:52.454048 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3932b8-22af-48c8-abb2-9e6507f222a3 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:52.462076 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1204736f-46b7-4d9c-bb04-acfe0263fafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:52.462773 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204736f-46b7-4d9c-bb04-acfe0263fafd admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:52.463502 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204736f-46b7-4d9c-bb04-acfe0263fafd admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:52.464943 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204736f-46b7-4d9c-bb04-acfe0263fafd admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:52.464943 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1204736f-46b7-4d9c-bb04-acfe0263fafd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:52.466675 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1204736f-46b7-4d9c-bb04-acfe0263fafd admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:52.486597 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1180/2348] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:52:52.492212 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b02dd1d-b283-4919-947c-401ad88323d5 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:52.505010 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b02dd1d-b283-4919-947c-401ad88323d5 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:52.511956 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251ead04-5d9f-4eca-8962-19b8f00d07ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:52.513518 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ead04-5d9f-4eca-8962-19b8f00d07ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:52.514760 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ead04-5d9f-4eca-8962-19b8f00d07ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:52.515328 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ead04-5d9f-4eca-8962-19b8f00d07ba admin admin] PATH_INFO: `/v3/projects/058bf6ec4092448d8338ebf7ee766e93/users/8c92dc2483fc47d1aa6bb65a83ce7f89/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:52.537544 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251ead04-5d9f-4eca-8962-19b8f00d07ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=058bf6ec4092448d8338ebf7ee766e93, user_id=8c92dc2483fc47d1aa6bb65a83ce7f89, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:52.541540 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251ead04-5d9f-4eca-8962-19b8f00d07ba admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:52.726641 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1169/2349] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:52:52 2022] PUT /identity/v3/projects/058bf6ec4092448d8338ebf7ee766e93/users/8c92dc2483fc47d1aa6bb65a83ce7f89/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:52.730721 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1204736f-46b7-4d9c-bb04-acfe0263fafd admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:52.741211 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1204736f-46b7-4d9c-bb04-acfe0263fafd admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:52.885354 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a5259-4366-4b3f-9a0b-f210656c3a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:52.886049 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a5259-4366-4b3f-9a0b-f210656c3a16 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:52.886338 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a5259-4366-4b3f-9a0b-f210656c3a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:52.886615 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a5259-4366-4b3f-9a0b-f210656c3a16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:52.887347 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0a5259-4366-4b3f-9a0b-f210656c3a16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:52.889002 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0a5259-4366-4b3f-9a0b-f210656c3a16 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:52.907335 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1181/2350] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:52:52.911433 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251ead04-5d9f-4eca-8962-19b8f00d07ba admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:52.932652 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251ead04-5d9f-4eca-8962-19b8f00d07ba admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:52.948029 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ec10f-9cb7-4707-b373-f201c353f474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:52.949040 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ec10f-9cb7-4707-b373-f201c353f474 admin admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:52.949423 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ec10f-9cb7-4707-b373-f201c353f474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:52.949720 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ec10f-9cb7-4707-b373-f201c353f474 admin admin] PATH_INFO: `/v3/projects/058bf6ec4092448d8338ebf7ee766e93/users/8c92dc2483fc47d1aa6bb65a83ce7f89/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:52.956338 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9ec10f-9cb7-4707-b373-f201c353f474 admin admin] RBAC: Authorizing `identity:create_grant(project_id=058bf6ec4092448d8338ebf7ee766e93, user_id=8c92dc2483fc47d1aa6bb65a83ce7f89, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:52.961718 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9ec10f-9cb7-4707-b373-f201c353f474 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:52.974454 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1170/2351] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:52:52 2022] PUT /identity/v3/projects/058bf6ec4092448d8338ebf7ee766e93/users/8c92dc2483fc47d1aa6bb65a83ce7f89/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:52.985335 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1972e7-6545-4f4a-925b-cf073225272f None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:52.985882 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1972e7-6545-4f4a-925b-cf073225272f None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:52.987480 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1972e7-6545-4f4a-925b-cf073225272f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:53.030609 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-fc1972e7-6545-4f4a-925b-cf073225272f None None] MFA Rules not processed for user `8c92dc2483fc47d1aa6bb65a83ce7f89`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:53.032172 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-fc1972e7-6545-4f4a-925b-cf073225272f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:53.111465 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1182/2352] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:52:52 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:52:53.125770 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ec10f-9cb7-4707-b373-f201c353f474 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:53.127822 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-ec9ec10f-9cb7-4707-b373-f201c353f474 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:53.207790 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ec10f-9cb7-4707-b373-f201c353f474 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:53.212216 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6188efcb-52b1-4dd3-b2ca-4e444c652a8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:53.212908 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188efcb-52b1-4dd3-b2ca-4e444c652a8a service cinder] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:53.213189 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188efcb-52b1-4dd3-b2ca-4e444c652a8a service cinder] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:53.213461 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188efcb-52b1-4dd3-b2ca-4e444c652a8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:53.223929 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6188efcb-52b1-4dd3-b2ca-4e444c652a8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:53.225648 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6188efcb-52b1-4dd3-b2ca-4e444c652a8a service cinder] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:53.241744 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1171/2353] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:52:53 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:52:53.437456 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1972e7-6545-4f4a-925b-cf073225272f None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:53.540678 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1972e7-6545-4f4a-925b-cf073225272f None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:53.545598 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3639c62d-1c5f-4693-a625-582d13a02c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:53.546501 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639c62d-1c5f-4693-a625-582d13a02c63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:53.546903 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639c62d-1c5f-4693-a625-582d13a02c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:53.547091 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639c62d-1c5f-4693-a625-582d13a02c63 admin admin] PATH_INFO: `/v3/users/d6a83419f485478ea33cbe50bdd2e7f6` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:53.548394 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3639c62d-1c5f-4693-a625-582d13a02c63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6a83419f485478ea33cbe50bdd2e7f6)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:53.550381 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3639c62d-1c5f-4693-a625-582d13a02c63 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:53.880117 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6188efcb-52b1-4dd3-b2ca-4e444c652a8a service cinder] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:53.881536 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-6188efcb-52b1-4dd3-b2ca-4e444c652a8a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:53.896616 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6188efcb-52b1-4dd3-b2ca-4e444c652a8a service cinder] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:53.900013 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-3639c62d-1c5f-4693-a625-582d13a02c63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6a83419f485478ea33cbe50bdd2e7f6'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:53.902263 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff88370c-1b60-4091-805d-13ee3e41bc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:53.903131 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88370c-1b60-4091-805d-13ee3e41bc1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:53.903505 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88370c-1b60-4091-805d-13ee3e41bc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:53.903706 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88370c-1b60-4091-805d-13ee3e41bc1e admin admin] PATH_INFO: `/v3/users/5456d05816e1477cab284976ea490adb` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:53.905108 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff88370c-1b60-4091-805d-13ee3e41bc1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5456d05816e1477cab284976ea490adb)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:53.907116 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff88370c-1b60-4091-805d-13ee3e41bc1e admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:53.918082 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-3639c62d-1c5f-4693-a625-582d13a02c63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6a83419f485478ea33cbe50bdd2e7f6'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:53.918992 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-3639c62d-1c5f-4693-a625-582d13a02c63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6a83419f485478ea33cbe50bdd2e7f6'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:53.929601 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-3639c62d-1c5f-4693-a625-582d13a02c63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6a83419f485478ea33cbe50bdd2e7f6'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:54.074910 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-3639c62d-1c5f-4693-a625-582d13a02c63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6a83419f485478ea33cbe50bdd2e7f6'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:54.084598 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1183/2354] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 16:52:53 2022] DELETE /identity/v3/users/d6a83419f485478ea33cbe50bdd2e7f6 => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:54.089570 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd062c-e659-4dc1-bc8b-3a03324ee6c4 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:54.090159 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd062c-e659-4dc1-bc8b-3a03324ee6c4 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:54.090621 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd062c-e659-4dc1-bc8b-3a03324ee6c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:54.136337 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-58cd062c-e659-4dc1-bc8b-3a03324ee6c4 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:54.144783 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-58cd062c-e659-4dc1-bc8b-3a03324ee6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:54.266061 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-ff88370c-1b60-4091-805d-13ee3e41bc1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5456d05816e1477cab284976ea490adb'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:54.268864 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-ff88370c-1b60-4091-805d-13ee3e41bc1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5456d05816e1477cab284976ea490adb'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:54.304662 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-ff88370c-1b60-4091-805d-13ee3e41bc1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5456d05816e1477cab284976ea490adb'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:54.309324 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1184/2355] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:52:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:52:54.324914 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd062c-e659-4dc1-bc8b-3a03324ee6c4 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:54.329062 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-58cd062c-e659-4dc1-bc8b-3a03324ee6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:54.359899 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:54.403651 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-ff88370c-1b60-4091-805d-13ee3e41bc1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5456d05816e1477cab284976ea490adb'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:54.416321 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-ff88370c-1b60-4091-805d-13ee3e41bc1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5456d05816e1477cab284976ea490adb'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:54.429834 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd062c-e659-4dc1-bc8b-3a03324ee6c4 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:54.435761 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1172/2356] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 16:52:53 2022] DELETE /identity/v3/users/5456d05816e1477cab284976ea490adb => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:52:54.437931 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4962a62-1650-43ab-a3a7-ead18395d0e7 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:54.438924 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4962a62-1650-43ab-a3a7-ead18395d0e7 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:54.439483 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4962a62-1650-43ab-a3a7-ead18395d0e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:54.472922 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-e4962a62-1650-43ab-a3a7-ead18395d0e7 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:54.474650 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-e4962a62-1650-43ab-a3a7-ead18395d0e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:54.502828 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50af913d-3fe0-4dbb-a41a-649dc26eba37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:54.504023 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af913d-3fe0-4dbb-a41a-649dc26eba37 service neutron] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:54.504419 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af913d-3fe0-4dbb-a41a-649dc26eba37 service neutron] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:54.504971 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af913d-3fe0-4dbb-a41a-649dc26eba37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:54.507303 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-50af913d-3fe0-4dbb-a41a-649dc26eba37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:54.596169 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1173/2357] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:52:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:52:54.612260 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4962a62-1650-43ab-a3a7-ead18395d0e7 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:54.613837 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-e4962a62-1650-43ab-a3a7-ead18395d0e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:54.637032 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4962a62-1650-43ab-a3a7-ead18395d0e7 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:54.638550 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50af913d-3fe0-4dbb-a41a-649dc26eba37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:54.640768 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50af913d-3fe0-4dbb-a41a-649dc26eba37 service neutron] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:54.646744 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abcf703-f781-425a-a905-37ad1de0855c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:54.652091 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abcf703-f781-425a-a905-37ad1de0855c service neutron] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:54.652091 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abcf703-f781-425a-a905-37ad1de0855c service neutron] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:54.653215 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abcf703-f781-425a-a905-37ad1de0855c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:54.654948 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1185/2358] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:52:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:52:54.676060 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abcf703-f781-425a-a905-37ad1de0855c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:54.679493 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abcf703-f781-425a-a905-37ad1de0855c service neutron] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:54.744181 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1174/2359] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:52:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 16:52:54.810497 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:55.085851 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50af913d-3fe0-4dbb-a41a-649dc26eba37 service neutron] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:55.088186 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-50af913d-3fe0-4dbb-a41a-649dc26eba37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:55.106002 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50af913d-3fe0-4dbb-a41a-649dc26eba37 service neutron] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:55.127126 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38359cfa-bf8b-4c46-a43d-3eb45cc60e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:55.129339 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38359cfa-bf8b-4c46-a43d-3eb45cc60e1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:55.129631 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38359cfa-bf8b-4c46-a43d-3eb45cc60e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:55.130331 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38359cfa-bf8b-4c46-a43d-3eb45cc60e1a admin admin] PATH_INFO: `/v3/projects/66d46465b66145fb98fae02dee13b758` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:55.132657 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38359cfa-bf8b-4c46-a43d-3eb45cc60e1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=66d46465b66145fb98fae02dee13b758)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:55.135493 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38359cfa-bf8b-4c46-a43d-3eb45cc60e1a admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:55.249102 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abcf703-f781-425a-a905-37ad1de0855c service neutron] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:55.251854 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-4abcf703-f781-425a-a905-37ad1de0855c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:55.284345 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-38359cfa-bf8b-4c46-a43d-3eb45cc60e1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66d46465b66145fb98fae02dee13b758', 'request_id': 'req-38359cfa-bf8b-4c46-a43d-3eb45cc60e1a'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:55.310045 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-38359cfa-bf8b-4c46-a43d-3eb45cc60e1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66d46465b66145fb98fae02dee13b758', 'request_id': 'req-38359cfa-bf8b-4c46-a43d-3eb45cc60e1a'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:55.317531 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-38359cfa-bf8b-4c46-a43d-3eb45cc60e1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66d46465b66145fb98fae02dee13b758', 'request_id': 'req-38359cfa-bf8b-4c46-a43d-3eb45cc60e1a'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:55.351794 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abcf703-f781-425a-a905-37ad1de0855c service neutron] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:55.405899 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-38359cfa-bf8b-4c46-a43d-3eb45cc60e1a admin admin] The token cache is being invalidate because project 66d46465b66145fb98fae02dee13b758 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:52:55.406906 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-38359cfa-bf8b-4c46-a43d-3eb45cc60e1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:55.412411 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-38359cfa-bf8b-4c46-a43d-3eb45cc60e1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:55.412411 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1186/2360] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 16:52:55 2022] DELETE /identity/v3/projects/66d46465b66145fb98fae02dee13b758 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:55.412411 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38359cfa-bf8b-4c46-a43d-3eb45cc60e1a admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:55.412411 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-38359cfa-bf8b-4c46-a43d-3eb45cc60e1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:55.425666 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54147482-0724-4bdf-805f-356e36959dbe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700ad7df774415b89737c7dddcc5b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:55.426779 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54147482-0724-4bdf-805f-356e36959dbe service placement] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:55.427056 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54147482-0724-4bdf-805f-356e36959dbe service placement] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:55.427401 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54147482-0724-4bdf-805f-356e36959dbe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:55.430462 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-54147482-0724-4bdf-805f-356e36959dbe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:55.443507 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54147482-0724-4bdf-805f-356e36959dbe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:55.445203 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54147482-0724-4bdf-805f-356e36959dbe service placement] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:55.456321 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1175/2361] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:52:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 16:52:55.457795 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb72bf-3231-4ed9-b04d-61cc065457d0 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:55.458074 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb72bf-3231-4ed9-b04d-61cc065457d0 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:55.458354 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb72bf-3231-4ed9-b04d-61cc065457d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:55.481690 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-45cb72bf-3231-4ed9-b04d-61cc065457d0 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:55.483536 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-45cb72bf-3231-4ed9-b04d-61cc065457d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:55.493013 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1176/2362] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:52:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:52:55.496336 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38359cfa-bf8b-4c46-a43d-3eb45cc60e1a admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:55.500791 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11be6f6-7abd-4059-b64f-601c28a4bc07 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:55.501101 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11be6f6-7abd-4059-b64f-601c28a4bc07 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:55.501367 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11be6f6-7abd-4059-b64f-601c28a4bc07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:55.504074 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb046cd-ba43-4d28-8730-7eb0405d2514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:55.505770 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb046cd-ba43-4d28-8730-7eb0405d2514 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:55.506169 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb046cd-ba43-4d28-8730-7eb0405d2514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:55.506492 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb046cd-ba43-4d28-8730-7eb0405d2514 admin admin] PATH_INFO: `/v3/projects/a34ddc31468b40d98bbc6486eb9140b0` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:55.509818 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb046cd-ba43-4d28-8730-7eb0405d2514 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a34ddc31468b40d98bbc6486eb9140b0)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:55.512469 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb046cd-ba43-4d28-8730-7eb0405d2514 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:55.524163 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-b11be6f6-7abd-4059-b64f-601c28a4bc07 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:55.525446 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-b11be6f6-7abd-4059-b64f-601c28a4bc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:55.534483 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1177/2363] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:52:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:52:55.539487 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11be6f6-7abd-4059-b64f-601c28a4bc07 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:55.549593 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11be6f6-7abd-4059-b64f-601c28a4bc07 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:55.556136 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aabe454-f08c-4cb1-8454-7f963018fa6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:55.556818 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aabe454-f08c-4cb1-8454-7f963018fa6c admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:55.557098 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aabe454-f08c-4cb1-8454-7f963018fa6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:55.557380 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aabe454-f08c-4cb1-8454-7f963018fa6c admin admin] PATH_INFO: `/v3/domains` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:55.558142 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aabe454-f08c-4cb1-8454-7f963018fa6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:52:55.558446 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aabe454-f08c-4cb1-8454-7f963018fa6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:55.560097 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aabe454-f08c-4cb1-8454-7f963018fa6c admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:55.572748 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1178/2364] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Jul 18 16:52:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:52:55.577077 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aabe454-f08c-4cb1-8454-7f963018fa6c admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:55.587319 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aabe454-f08c-4cb1-8454-7f963018fa6c admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:55.592218 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21969f78-a31a-4a39-95bf-956b3907bff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:55.592910 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21969f78-a31a-4a39-95bf-956b3907bff3 admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:55.593190 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21969f78-a31a-4a39-95bf-956b3907bff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:55.593461 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21969f78-a31a-4a39-95bf-956b3907bff3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:55.594150 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21969f78-a31a-4a39-95bf-956b3907bff3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:55.596086 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21969f78-a31a-4a39-95bf-956b3907bff3 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:55.668847 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-ceb046cd-ba43-4d28-8730-7eb0405d2514 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a34ddc31468b40d98bbc6486eb9140b0', 'request_id': 'req-ceb046cd-ba43-4d28-8730-7eb0405d2514'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:55.674918 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-ceb046cd-ba43-4d28-8730-7eb0405d2514 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a34ddc31468b40d98bbc6486eb9140b0', 'request_id': 'req-ceb046cd-ba43-4d28-8730-7eb0405d2514'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:55.684863 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-ceb046cd-ba43-4d28-8730-7eb0405d2514 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a34ddc31468b40d98bbc6486eb9140b0', 'request_id': 'req-ceb046cd-ba43-4d28-8730-7eb0405d2514'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:55.737471 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1179/2365] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:52:55 2022] POST /identity/v3/projects => generated 391 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:52:55.741770 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21969f78-a31a-4a39-95bf-956b3907bff3 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:55.830916 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21969f78-a31a-4a39-95bf-956b3907bff3 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:55.836937 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55616382-aeee-4c44-99af-2142339a611d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:55.837643 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55616382-aeee-4c44-99af-2142339a611d admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:55.837927 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55616382-aeee-4c44-99af-2142339a611d admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:55.838205 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55616382-aeee-4c44-99af-2142339a611d admin admin] PATH_INFO: `/v3/users` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:55.838962 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55616382-aeee-4c44-99af-2142339a611d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:55.840974 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55616382-aeee-4c44-99af-2142339a611d admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:55.879775 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-ceb046cd-ba43-4d28-8730-7eb0405d2514 admin admin] The token cache is being invalidate because project a34ddc31468b40d98bbc6486eb9140b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:52:55.880044 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-ceb046cd-ba43-4d28-8730-7eb0405d2514 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:55.880682 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-ceb046cd-ba43-4d28-8730-7eb0405d2514 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:55.882285 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1187/2366] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 16:52:55 2022] DELETE /identity/v3/projects/a34ddc31468b40d98bbc6486eb9140b0 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:55.883062 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb046cd-ba43-4d28-8730-7eb0405d2514 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:55.884425 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-ceb046cd-ba43-4d28-8730-7eb0405d2514 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:55.955956 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb046cd-ba43-4d28-8730-7eb0405d2514 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:55.961302 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c776f736-d122-4a2a-844b-19f62c472ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:55.962228 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776f736-d122-4a2a-844b-19f62c472ac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:55.962509 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776f736-d122-4a2a-844b-19f62c472ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:55.962783 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776f736-d122-4a2a-844b-19f62c472ac5 admin admin] PATH_INFO: `/v3/users/25e8fc147a2641179495291820557874` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:55.964050 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c776f736-d122-4a2a-844b-19f62c472ac5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25e8fc147a2641179495291820557874)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:55.965989 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c776f736-d122-4a2a-844b-19f62c472ac5 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:55.987867 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1180/2367] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 16:52:55 2022] POST /identity/v3/users => generated 296 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:52:55.989430 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55616382-aeee-4c44-99af-2142339a611d admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:55.992121 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-55616382-aeee-4c44-99af-2142339a611d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:56.005374 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55616382-aeee-4c44-99af-2142339a611d admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:56.010287 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da9bdd-210f-48cb-a653-7665fb48f125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:56.011167 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da9bdd-210f-48cb-a653-7665fb48f125 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:56.011451 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da9bdd-210f-48cb-a653-7665fb48f125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:56.011754 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da9bdd-210f-48cb-a653-7665fb48f125 admin admin] PATH_INFO: `/v3/users/8c92dc2483fc47d1aa6bb65a83ce7f89` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:56.013032 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1da9bdd-210f-48cb-a653-7665fb48f125 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c92dc2483fc47d1aa6bb65a83ce7f89)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:56.014985 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1da9bdd-210f-48cb-a653-7665fb48f125 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:56.225566 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-c776f736-d122-4a2a-844b-19f62c472ac5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25e8fc147a2641179495291820557874'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:56.237974 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-c776f736-d122-4a2a-844b-19f62c472ac5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25e8fc147a2641179495291820557874'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:56.238834 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-c776f736-d122-4a2a-844b-19f62c472ac5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25e8fc147a2641179495291820557874'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:56.247345 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-c776f736-d122-4a2a-844b-19f62c472ac5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25e8fc147a2641179495291820557874'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:56.273236 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-d1da9bdd-210f-48cb-a653-7665fb48f125 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c92dc2483fc47d1aa6bb65a83ce7f89'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:56.273899 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-d1da9bdd-210f-48cb-a653-7665fb48f125 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c92dc2483fc47d1aa6bb65a83ce7f89'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:56.286177 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-d1da9bdd-210f-48cb-a653-7665fb48f125 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c92dc2483fc47d1aa6bb65a83ce7f89'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:56.441082 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-c776f736-d122-4a2a-844b-19f62c472ac5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25e8fc147a2641179495291820557874'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:56.453146 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1188/2368] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 16:52:55 2022] DELETE /identity/v3/users/25e8fc147a2641179495291820557874 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:56.454370 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c776f736-d122-4a2a-844b-19f62c472ac5 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:56.456566 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-c776f736-d122-4a2a-844b-19f62c472ac5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:56.531737 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-d1da9bdd-210f-48cb-a653-7665fb48f125 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c92dc2483fc47d1aa6bb65a83ce7f89'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:56.542477 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-d1da9bdd-210f-48cb-a653-7665fb48f125 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c92dc2483fc47d1aa6bb65a83ce7f89'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:56.549358 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1181/2369] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 16:52:55 2022] DELETE /identity/v3/users/8c92dc2483fc47d1aa6bb65a83ce7f89 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:56.549543 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c776f736-d122-4a2a-844b-19f62c472ac5 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:56.550772 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3388e94-7615-47cc-83e8-2f600c060eb3 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:56.551065 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3388e94-7615-47cc-83e8-2f600c060eb3 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:56.551344 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3388e94-7615-47cc-83e8-2f600c060eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:56.585900 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-b3388e94-7615-47cc-83e8-2f600c060eb3 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:56.587355 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-b3388e94-7615-47cc-83e8-2f600c060eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:56.630330 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bf73ec-1d2c-4af5-a446-5eca0b28b960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:56.631473 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf73ec-1d2c-4af5-a446-5eca0b28b960 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:56.631854 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf73ec-1d2c-4af5-a446-5eca0b28b960 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:56.632334 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf73ec-1d2c-4af5-a446-5eca0b28b960 admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:56.633118 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bf73ec-1d2c-4af5-a446-5eca0b28b960 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:56.636665 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bf73ec-1d2c-4af5-a446-5eca0b28b960 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:56.648701 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1189/2370] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:52:56 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:52:56.652629 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bf73ec-1d2c-4af5-a446-5eca0b28b960 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:56.655423 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-67bf73ec-1d2c-4af5-a446-5eca0b28b960 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:56.663864 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1182/2371] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:52:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:52:56.672626 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3388e94-7615-47cc-83e8-2f600c060eb3 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:56.686688 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bf73ec-1d2c-4af5-a446-5eca0b28b960 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:56.686994 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-b3388e94-7615-47cc-83e8-2f600c060eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:56.687095 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49713492-d60a-4886-a435-062abaea6482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:56.687095 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49713492-d60a-4886-a435-062abaea6482 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:56.687095 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49713492-d60a-4886-a435-062abaea6482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:56.687095 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49713492-d60a-4886-a435-062abaea6482 admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:56.687448 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49713492-d60a-4886-a435-062abaea6482 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:56.687448 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49713492-d60a-4886-a435-062abaea6482 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:56.699751 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1190/2372] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:52:56 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:52:56.701031 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49713492-d60a-4886-a435-062abaea6482 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:56.711675 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49713492-d60a-4886-a435-062abaea6482 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:56.717876 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382e372f-2861-4b94-99d8-0e9f3283fa5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:56.719145 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e372f-2861-4b94-99d8-0e9f3283fa5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:56.719499 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e372f-2861-4b94-99d8-0e9f3283fa5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:56.719816 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e372f-2861-4b94-99d8-0e9f3283fa5a admin admin] PATH_INFO: `/v3/projects/c713ff77a82942088095cb6c19de8c2c/users/14ee8efa14fd4442a35cf0e7a78388d6/roles/ad3a2bc7b2094a4da1a95a143c8d9436` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:56.736785 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382e372f-2861-4b94-99d8-0e9f3283fa5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c713ff77a82942088095cb6c19de8c2c, user_id=14ee8efa14fd4442a35cf0e7a78388d6, role_id=ad3a2bc7b2094a4da1a95a143c8d9436)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:56.739537 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382e372f-2861-4b94-99d8-0e9f3283fa5a admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:56.750910 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3388e94-7615-47cc-83e8-2f600c060eb3 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:56.755236 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c38b67-7099-41af-98ce-77655779d55c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:56.756041 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c38b67-7099-41af-98ce-77655779d55c service neutron] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:56.756334 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c38b67-7099-41af-98ce-77655779d55c service neutron] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:56.756665 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c38b67-7099-41af-98ce-77655779d55c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:56.767151 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c38b67-7099-41af-98ce-77655779d55c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:56.768803 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c38b67-7099-41af-98ce-77655779d55c service neutron] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:56.779807 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1183/2373] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:52:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:52:56.876909 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1191/2374] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:52:56 2022] PUT /identity/v3/projects/c713ff77a82942088095cb6c19de8c2c/users/14ee8efa14fd4442a35cf0e7a78388d6/roles/ad3a2bc7b2094a4da1a95a143c8d9436 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:56.888958 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2fd39-a15a-46f3-a897-b2e2de032872 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:56.889300 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2fd39-a15a-46f3-a897-b2e2de032872 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:56.889638 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2fd39-a15a-46f3-a897-b2e2de032872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:56.922265 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-b8c2fd39-a15a-46f3-a897-b2e2de032872 None None] MFA Rules not processed for user `14ee8efa14fd4442a35cf0e7a78388d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:56.923442 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-b8c2fd39-a15a-46f3-a897-b2e2de032872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:56.999690 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1184/2375] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:52:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:52:57.016943 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382e372f-2861-4b94-99d8-0e9f3283fa5a admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:57.018646 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-382e372f-2861-4b94-99d8-0e9f3283fa5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:57.091493 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382e372f-2861-4b94-99d8-0e9f3283fa5a admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:57.100020 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d4e494-220c-4e24-9ac5-1201f7277c06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:57.100020 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d4e494-220c-4e24-9ac5-1201f7277c06 service cinder] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:57.100020 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d4e494-220c-4e24-9ac5-1201f7277c06 service cinder] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:57.100020 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d4e494-220c-4e24-9ac5-1201f7277c06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:57.106389 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d4e494-220c-4e24-9ac5-1201f7277c06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:57.107968 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d4e494-220c-4e24-9ac5-1201f7277c06 service cinder] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:57.118075 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1192/2376] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:52:57 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:52:57.130262 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c2fd39-a15a-46f3-a897-b2e2de032872 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:57.136954 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-b8c2fd39-a15a-46f3-a897-b2e2de032872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:57.268705 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c2fd39-a15a-46f3-a897-b2e2de032872 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:57.274987 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a159427-5dba-40d7-81db-490e933c8fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:57.276022 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a159427-5dba-40d7-81db-490e933c8fed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:57.276510 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a159427-5dba-40d7-81db-490e933c8fed admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:57.276655 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a159427-5dba-40d7-81db-490e933c8fed admin admin] PATH_INFO: `/v3/projects/058bf6ec4092448d8338ebf7ee766e93` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:57.278756 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a159427-5dba-40d7-81db-490e933c8fed admin admin] RBAC: Authorizing `identity:delete_project(project_id=058bf6ec4092448d8338ebf7ee766e93)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:57.281385 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a159427-5dba-40d7-81db-490e933c8fed admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:57.352968 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:57.434292 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-8a159427-5dba-40d7-81db-490e933c8fed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '058bf6ec4092448d8338ebf7ee766e93', 'request_id': 'req-8a159427-5dba-40d7-81db-490e933c8fed'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:57.464254 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d4e494-220c-4e24-9ac5-1201f7277c06 service cinder] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:57.467313 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-50d4e494-220c-4e24-9ac5-1201f7277c06 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:57.488772 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d4e494-220c-4e24-9ac5-1201f7277c06 service cinder] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:57.542578 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-8a159427-5dba-40d7-81db-490e933c8fed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '058bf6ec4092448d8338ebf7ee766e93', 'request_id': 'req-8a159427-5dba-40d7-81db-490e933c8fed'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:57.550045 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-8a159427-5dba-40d7-81db-490e933c8fed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '058bf6ec4092448d8338ebf7ee766e93', 'request_id': 'req-8a159427-5dba-40d7-81db-490e933c8fed'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:57.566153 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-8a159427-5dba-40d7-81db-490e933c8fed admin admin] The token cache is being invalidate because project 058bf6ec4092448d8338ebf7ee766e93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:52:57.566153 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-8a159427-5dba-40d7-81db-490e933c8fed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:57.566943 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-8a159427-5dba-40d7-81db-490e933c8fed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:57.568631 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1185/2377] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 16:52:57 2022] DELETE /identity/v3/projects/058bf6ec4092448d8338ebf7ee766e93 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:57.574279 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06466fd0-0469-49d0-9950-cba77b5aa4c3 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:57.574674 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06466fd0-0469-49d0-9950-cba77b5aa4c3 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:57.578885 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06466fd0-0469-49d0-9950-cba77b5aa4c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:57.584374 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4638e37c-d824-4140-bd92-09024a475fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:57.585293 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4638e37c-d824-4140-bd92-09024a475fb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:57.585569 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4638e37c-d824-4140-bd92-09024a475fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:57.585845 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4638e37c-d824-4140-bd92-09024a475fb2 admin admin] PATH_INFO: `/v3/projects/0ee1bd22a4a541f79b0eb08acd752bea` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:57.588059 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4638e37c-d824-4140-bd92-09024a475fb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ee1bd22a4a541f79b0eb08acd752bea)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:57.589889 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4638e37c-d824-4140-bd92-09024a475fb2 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:57.605131 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-06466fd0-0469-49d0-9950-cba77b5aa4c3 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:57.606701 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-06466fd0-0469-49d0-9950-cba77b5aa4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:57.636839 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1186/2378] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:52:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:52:57.644874 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd48201-7788-40be-990e-08b8cdad690b None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:57.645164 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd48201-7788-40be-990e-08b8cdad690b None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:57.645443 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd48201-7788-40be-990e-08b8cdad690b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:57.664764 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-8bd48201-7788-40be-990e-08b8cdad690b None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:57.665960 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-8bd48201-7788-40be-990e-08b8cdad690b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:57.674318 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1187/2379] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:52:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:52:57.678733 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd48201-7788-40be-990e-08b8cdad690b None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:57.688626 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd48201-7788-40be-990e-08b8cdad690b None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:57.694587 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9331c4d0-4d67-431a-8f5e-7a970ded7e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:57.695257 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331c4d0-4d67-431a-8f5e-7a970ded7e2c admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:57.695536 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331c4d0-4d67-431a-8f5e-7a970ded7e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:57.695844 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331c4d0-4d67-431a-8f5e-7a970ded7e2c admin admin] PATH_INFO: `/v3/domains` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:57.696645 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9331c4d0-4d67-431a-8f5e-7a970ded7e2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:52:57.696952 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9331c4d0-4d67-431a-8f5e-7a970ded7e2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:57.698705 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9331c4d0-4d67-431a-8f5e-7a970ded7e2c admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:57.713439 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1188/2380] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Jul 18 16:52:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:52:57.718058 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9331c4d0-4d67-431a-8f5e-7a970ded7e2c admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:57.728198 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9331c4d0-4d67-431a-8f5e-7a970ded7e2c admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:57.732845 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53bae72-45ab-44d7-ba8e-bce55247ef57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:57.733482 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53bae72-45ab-44d7-ba8e-bce55247ef57 admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:57.733767 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53bae72-45ab-44d7-ba8e-bce55247ef57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:57.734043 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53bae72-45ab-44d7-ba8e-bce55247ef57 admin admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:57.734727 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53bae72-45ab-44d7-ba8e-bce55247ef57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:57.736811 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53bae72-45ab-44d7-ba8e-bce55247ef57 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:57.820201 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:57.835645 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-4638e37c-d824-4140-bd92-09024a475fb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ee1bd22a4a541f79b0eb08acd752bea', 'request_id': 'req-4638e37c-d824-4140-bd92-09024a475fb2'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:57.844461 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-4638e37c-d824-4140-bd92-09024a475fb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ee1bd22a4a541f79b0eb08acd752bea', 'request_id': 'req-4638e37c-d824-4140-bd92-09024a475fb2'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:57.851537 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-4638e37c-d824-4140-bd92-09024a475fb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ee1bd22a4a541f79b0eb08acd752bea', 'request_id': 'req-4638e37c-d824-4140-bd92-09024a475fb2'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:57.901609 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1189/2381] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:52:57 2022] POST /identity/v3/projects => generated 385 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:52:57.904459 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53bae72-45ab-44d7-ba8e-bce55247ef57 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:57.986731 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53bae72-45ab-44d7-ba8e-bce55247ef57 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:57.992598 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d290236a-eb32-49ca-bc79-6a38dcd53dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:57.993282 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290236a-eb32-49ca-bc79-6a38dcd53dec admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:57.993568 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290236a-eb32-49ca-bc79-6a38dcd53dec admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:57.999032 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290236a-eb32-49ca-bc79-6a38dcd53dec admin admin] PATH_INFO: `/v3/users` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:57.999032 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d290236a-eb32-49ca-bc79-6a38dcd53dec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:57.999032 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d290236a-eb32-49ca-bc79-6a38dcd53dec admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:58.032286 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-4638e37c-d824-4140-bd92-09024a475fb2 admin admin] The token cache is being invalidate because project 0ee1bd22a4a541f79b0eb08acd752bea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:52:58.032643 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-4638e37c-d824-4140-bd92-09024a475fb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:58.033436 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-4638e37c-d824-4140-bd92-09024a475fb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:58.035086 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1193/2382] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 16:52:57 2022] DELETE /identity/v3/projects/0ee1bd22a4a541f79b0eb08acd752bea => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:58.040322 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f97228-f44e-44bf-8742-13a5feaaa07b None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:58.040614 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f97228-f44e-44bf-8742-13a5feaaa07b None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:58.040889 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f97228-f44e-44bf-8742-13a5feaaa07b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:58.062178 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-f1f97228-f44e-44bf-8742-13a5feaaa07b None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:58.062891 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-f1f97228-f44e-44bf-8742-13a5feaaa07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:58.072366 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1194/2383] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:52:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:52:58.082839 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f46db7-f676-4f15-aa0c-a606af12e86b None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:58.083128 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f46db7-f676-4f15-aa0c-a606af12e86b None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:58.083439 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f46db7-f676-4f15-aa0c-a606af12e86b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:58.104210 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-71f46db7-f676-4f15-aa0c-a606af12e86b None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:58.105627 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-71f46db7-f676-4f15-aa0c-a606af12e86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:58.112533 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1190/2384] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 16:52:57 2022] POST /identity/v3/users => generated 293 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:52:58.117091 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d290236a-eb32-49ca-bc79-6a38dcd53dec admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:58.117975 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1195/2385] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:52:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:52:58.119277 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-d290236a-eb32-49ca-bc79-6a38dcd53dec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:58.122588 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f46db7-f676-4f15-aa0c-a606af12e86b None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:58.141639 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f46db7-f676-4f15-aa0c-a606af12e86b None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:58.149149 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73927a93-77c9-4d86-a9d3-5c294a156d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:58.151755 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d290236a-eb32-49ca-bc79-6a38dcd53dec admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:58.152174 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73927a93-77c9-4d86-a9d3-5c294a156d6d admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:58.152510 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73927a93-77c9-4d86-a9d3-5c294a156d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:58.153008 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73927a93-77c9-4d86-a9d3-5c294a156d6d admin admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:58.153956 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73927a93-77c9-4d86-a9d3-5c294a156d6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:52:58.154460 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73927a93-77c9-4d86-a9d3-5c294a156d6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:58.156497 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73927a93-77c9-4d86-a9d3-5c294a156d6d admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:58.160025 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd4f28a-5850-457a-b601-4b59286978e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:58.160826 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4f28a-5850-457a-b601-4b59286978e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:58.161009 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4f28a-5850-457a-b601-4b59286978e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:58.161287 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4f28a-5850-457a-b601-4b59286978e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:58.165169 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd4f28a-5850-457a-b601-4b59286978e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:58.165169 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd4f28a-5850-457a-b601-4b59286978e5 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:58.176605 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1191/2386] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:52:58 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:52:58.180673 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd4f28a-5850-457a-b601-4b59286978e5 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:58.180902 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1196/2387] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Jul 18 16:52:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:52:58.184964 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73927a93-77c9-4d86-a9d3-5c294a156d6d admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:58.194162 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd4f28a-5850-457a-b601-4b59286978e5 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:58.196175 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73927a93-77c9-4d86-a9d3-5c294a156d6d admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:58.201807 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c738b677-98fe-4ab5-a141-503e58182283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:58.202549 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c738b677-98fe-4ab5-a141-503e58182283 admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:58.202834 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c738b677-98fe-4ab5-a141-503e58182283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:58.208036 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c738b677-98fe-4ab5-a141-503e58182283 admin admin] PATH_INFO: `/v3/projects` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:58.208036 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c738b677-98fe-4ab5-a141-503e58182283 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:58.208036 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c738b677-98fe-4ab5-a141-503e58182283 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:58.208381 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8195539-3608-428a-973d-77f84f722890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:58.208381 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8195539-3608-428a-973d-77f84f722890 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:58.208381 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8195539-3608-428a-973d-77f84f722890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:58.208381 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8195539-3608-428a-973d-77f84f722890 admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:58.209256 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8195539-3608-428a-973d-77f84f722890 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:58.211093 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8195539-3608-428a-973d-77f84f722890 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:58.223012 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1192/2388] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:52:58 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:52:58.227768 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8195539-3608-428a-973d-77f84f722890 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:58.239693 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8195539-3608-428a-973d-77f84f722890 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:58.245208 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3fc829-eca4-4e1a-aaee-05465be7e6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:58.246118 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3fc829-eca4-4e1a-aaee-05465be7e6e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:58.246395 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3fc829-eca4-4e1a-aaee-05465be7e6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:58.246673 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3fc829-eca4-4e1a-aaee-05465be7e6e4 admin admin] PATH_INFO: `/v3/projects/f7dd91c04b5640ef9e5100689439d7c4/users/b57e09765f0041b081d5ab023084762c/roles/ad3a2bc7b2094a4da1a95a143c8d9436` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:58.271645 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3fc829-eca4-4e1a-aaee-05465be7e6e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7dd91c04b5640ef9e5100689439d7c4, user_id=b57e09765f0041b081d5ab023084762c, role_id=ad3a2bc7b2094a4da1a95a143c8d9436)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:58.274622 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3fc829-eca4-4e1a-aaee-05465be7e6e4 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:58.319130 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1197/2389] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:52:58 2022] POST /identity/v3/projects => generated 383 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:52:58.319130 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c738b677-98fe-4ab5-a141-503e58182283 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:58.385899 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c738b677-98fe-4ab5-a141-503e58182283 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:58.391015 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27576a7a-1567-4544-8566-58c1c9fc21da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:58.391731 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27576a7a-1567-4544-8566-58c1c9fc21da admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:58.392015 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27576a7a-1567-4544-8566-58c1c9fc21da admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:58.392302 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27576a7a-1567-4544-8566-58c1c9fc21da admin admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:58.393187 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27576a7a-1567-4544-8566-58c1c9fc21da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:58.395774 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27576a7a-1567-4544-8566-58c1c9fc21da admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:58.461736 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1193/2390] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:52:58 2022] PUT /identity/v3/projects/f7dd91c04b5640ef9e5100689439d7c4/users/b57e09765f0041b081d5ab023084762c/roles/ad3a2bc7b2094a4da1a95a143c8d9436 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:52:58.533677 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a6514e-3173-4cfd-8bac-140b410b6738 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:58.534282 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a6514e-3173-4cfd-8bac-140b410b6738 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:58.534560 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a6514e-3173-4cfd-8bac-140b410b6738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:58.567899 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-24a6514e-3173-4cfd-8bac-140b410b6738 None None] MFA Rules not processed for user `b57e09765f0041b081d5ab023084762c`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:58.569884 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-24a6514e-3173-4cfd-8bac-140b410b6738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:58.620008 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1198/2391] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 16:52:58 2022] POST /identity/v3/users => generated 292 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:52:58.620008 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27576a7a-1567-4544-8566-58c1c9fc21da admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:58.635467 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27576a7a-1567-4544-8566-58c1c9fc21da admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:58.668268 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1194/2392] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:52:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:52:58.681786 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a6514e-3173-4cfd-8bac-140b410b6738 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:58.685852 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-24a6514e-3173-4cfd-8bac-140b410b6738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:58.734511 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b596afb-ada1-4831-b80a-a0f700912a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:58.735193 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b596afb-ada1-4831-b80a-a0f700912a87 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:58.735485 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b596afb-ada1-4831-b80a-a0f700912a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:58.735937 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b596afb-ada1-4831-b80a-a0f700912a87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:58.737088 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b596afb-ada1-4831-b80a-a0f700912a87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:58.738746 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b596afb-ada1-4831-b80a-a0f700912a87 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:58.749906 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1199/2393] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:52:58 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:52:58.754840 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b596afb-ada1-4831-b80a-a0f700912a87 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:58.759361 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a6514e-3173-4cfd-8bac-140b410b6738 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:58.763182 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fe7bd3-24ee-44d4-bdd2-b4db2c796cf3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:58.764180 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe7bd3-24ee-44d4-bdd2-b4db2c796cf3 service cinder] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:58.764465 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe7bd3-24ee-44d4-bdd2-b4db2c796cf3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:58.764741 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe7bd3-24ee-44d4-bdd2-b4db2c796cf3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:58.766987 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b596afb-ada1-4831-b80a-a0f700912a87 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:58.772838 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c99db-3d15-465e-9e90-133340689569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:58.773114 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c99db-3d15-465e-9e90-133340689569 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:58.773398 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c99db-3d15-465e-9e90-133340689569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:58.773704 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c99db-3d15-465e-9e90-133340689569 admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:58.774442 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792c99db-3d15-465e-9e90-133340689569 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:58.774808 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fe7bd3-24ee-44d4-bdd2-b4db2c796cf3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:58.776138 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792c99db-3d15-465e-9e90-133340689569 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:58.776318 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fe7bd3-24ee-44d4-bdd2-b4db2c796cf3 service cinder] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:58.786537 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1195/2394] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:52:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:52:58.787001 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1200/2395] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:52:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:52:58.794921 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fe7bd3-24ee-44d4-bdd2-b4db2c796cf3 service cinder] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:58.810248 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fe7bd3-24ee-44d4-bdd2-b4db2c796cf3 service cinder] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:58.810519 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c99db-3d15-465e-9e90-133340689569 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:58.815523 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d97541-0c2d-420e-9815-a68d2f971137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:58.816497 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d97541-0c2d-420e-9815-a68d2f971137 admin admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:58.816779 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d97541-0c2d-420e-9815-a68d2f971137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:58.817055 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d97541-0c2d-420e-9815-a68d2f971137 admin admin] PATH_INFO: `/v3/projects/a013a342f25846be913682d2f925ca01/users/1243241885654b7283cc678febc40c41/roles/ad3a2bc7b2094a4da1a95a143c8d9436` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:58.821400 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c99db-3d15-465e-9e90-133340689569 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:58.826203 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953bf25-f080-4296-be9e-c1e3c835140f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:58.827260 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953bf25-f080-4296-be9e-c1e3c835140f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:58.827544 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953bf25-f080-4296-be9e-c1e3c835140f admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:58.827868 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953bf25-f080-4296-be9e-c1e3c835140f admin admin] PATH_INFO: `/v3/users/b57e09765f0041b081d5ab023084762c` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:58.829220 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7953bf25-f080-4296-be9e-c1e3c835140f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b57e09765f0041b081d5ab023084762c)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:58.831243 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7953bf25-f080-4296-be9e-c1e3c835140f admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:58.839265 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d97541-0c2d-420e-9815-a68d2f971137 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a013a342f25846be913682d2f925ca01, user_id=1243241885654b7283cc678febc40c41, role_id=ad3a2bc7b2094a4da1a95a143c8d9436)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:58.842957 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d97541-0c2d-420e-9815-a68d2f971137 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:58.976632 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1196/2396] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:52:58 2022] PUT /identity/v3/projects/a013a342f25846be913682d2f925ca01/users/1243241885654b7283cc678febc40c41/roles/ad3a2bc7b2094a4da1a95a143c8d9436 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:52:58.983208 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc371d62-5235-4f24-a682-36a100647d5f None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:58.983472 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc371d62-5235-4f24-a682-36a100647d5f None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:58.983774 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc371d62-5235-4f24-a682-36a100647d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:59.005796 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-dc371d62-5235-4f24-a682-36a100647d5f None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:59.007049 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-dc371d62-5235-4f24-a682-36a100647d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:59.074685 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1197/2397] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:52:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:52:59.085780 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc371d62-5235-4f24-a682-36a100647d5f None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:59.088620 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-dc371d62-5235-4f24-a682-36a100647d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:59.154017 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc371d62-5235-4f24-a682-36a100647d5f None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:59.158667 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f07035-9a93-4ead-b1a3-c3d2aafe4de3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:59.159339 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f07035-9a93-4ead-b1a3-c3d2aafe4de3 service neutron] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:59.159641 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f07035-9a93-4ead-b1a3-c3d2aafe4de3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:59.159936 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f07035-9a93-4ead-b1a3-c3d2aafe4de3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:59.166815 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:59.170856 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-7953bf25-f080-4296-be9e-c1e3c835140f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b57e09765f0041b081d5ab023084762c'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:59.177292 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f07035-9a93-4ead-b1a3-c3d2aafe4de3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:59.178507 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f07035-9a93-4ead-b1a3-c3d2aafe4de3 service neutron] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:59.188659 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-7953bf25-f080-4296-be9e-c1e3c835140f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b57e09765f0041b081d5ab023084762c'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:59.189391 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-7953bf25-f080-4296-be9e-c1e3c835140f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b57e09765f0041b081d5ab023084762c'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:59.190469 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1198/2398] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:52:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 16:52:59.198241 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-7953bf25-f080-4296-be9e-c1e3c835140f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b57e09765f0041b081d5ab023084762c'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:59.277347 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-7953bf25-f080-4296-be9e-c1e3c835140f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b57e09765f0041b081d5ab023084762c'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:59.284276 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1201/2399] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 16:52:58 2022] DELETE /identity/v3/users/b57e09765f0041b081d5ab023084762c => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:52:59.290087 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd1fe6-8821-401b-9169-b5f4cdcd6a42 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:59.290370 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd1fe6-8821-401b-9169-b5f4cdcd6a42 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:59.290644 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd1fe6-8821-401b-9169-b5f4cdcd6a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:59.317200 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-10cd1fe6-8821-401b-9169-b5f4cdcd6a42 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:59.323337 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-10cd1fe6-8821-401b-9169-b5f4cdcd6a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:59.391777 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1199/2400] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:52:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:52:59.404675 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953bf25-f080-4296-be9e-c1e3c835140f admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:59.406422 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-7953bf25-f080-4296-be9e-c1e3c835140f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:59.494925 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953bf25-f080-4296-be9e-c1e3c835140f admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:59.498533 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec673acd-c85e-4b47-ab2d-b2caad3c8ad6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:59.499448 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec673acd-c85e-4b47-ab2d-b2caad3c8ad6 service neutron] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:59.499763 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec673acd-c85e-4b47-ab2d-b2caad3c8ad6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:59.500047 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec673acd-c85e-4b47-ab2d-b2caad3c8ad6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:59.510153 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec673acd-c85e-4b47-ab2d-b2caad3c8ad6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:59.511629 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec673acd-c85e-4b47-ab2d-b2caad3c8ad6 service neutron] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:59.523890 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1202/2401] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:52:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:52:59.560839 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:00.277767 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cd1fe6-8821-401b-9169-b5f4cdcd6a42 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:53:00.279749 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-10cd1fe6-8821-401b-9169-b5f4cdcd6a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:53:00.292048 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cd1fe6-8821-401b-9169-b5f4cdcd6a42 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:53:00.297849 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c2d30-a973-47a6-b7dc-32043bdbf978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:53:00.298781 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c2d30-a973-47a6-b7dc-32043bdbf978 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:00.299070 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c2d30-a973-47a6-b7dc-32043bdbf978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:00.299347 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c2d30-a973-47a6-b7dc-32043bdbf978 admin admin] PATH_INFO: `/v3/projects/f7dd91c04b5640ef9e5100689439d7c4` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:00.313243 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135c2d30-a973-47a6-b7dc-32043bdbf978 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7dd91c04b5640ef9e5100689439d7c4)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:53:00.315307 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135c2d30-a973-47a6-b7dc-32043bdbf978 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:53:00.503214 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-135c2d30-a973-47a6-b7dc-32043bdbf978 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7dd91c04b5640ef9e5100689439d7c4', 'request_id': 'req-135c2d30-a973-47a6-b7dc-32043bdbf978'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:00.634925 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-135c2d30-a973-47a6-b7dc-32043bdbf978 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7dd91c04b5640ef9e5100689439d7c4', 'request_id': 'req-135c2d30-a973-47a6-b7dc-32043bdbf978'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:00.644395 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-135c2d30-a973-47a6-b7dc-32043bdbf978 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7dd91c04b5640ef9e5100689439d7c4', 'request_id': 'req-135c2d30-a973-47a6-b7dc-32043bdbf978'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:00.660038 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-135c2d30-a973-47a6-b7dc-32043bdbf978 admin admin] The token cache is being invalidate because project f7dd91c04b5640ef9e5100689439d7c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:53:00.660554 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-135c2d30-a973-47a6-b7dc-32043bdbf978 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:00.661646 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-135c2d30-a973-47a6-b7dc-32043bdbf978 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:00.664981 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1200/2402] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 16:53:00 2022] DELETE /identity/v3/projects/f7dd91c04b5640ef9e5100689439d7c4 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:53:00.673348 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1971e9-c57b-4ffa-ad58-54662261d647 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:00.678460 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1971e9-c57b-4ffa-ad58-54662261d647 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:00.678460 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1971e9-c57b-4ffa-ad58-54662261d647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:00.696909 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-af1971e9-c57b-4ffa-ad58-54662261d647 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:53:00.698125 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-af1971e9-c57b-4ffa-ad58-54662261d647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:53:00.760975 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1203/2403] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:53:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:53:00.769062 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c595e-a50b-4b3c-871a-742780760202 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:00.769463 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c595e-a50b-4b3c-871a-742780760202 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:00.769894 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c595e-a50b-4b3c-871a-742780760202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:00.789729 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-574c595e-a50b-4b3c-871a-742780760202 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:53:00.790959 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-574c595e-a50b-4b3c-871a-742780760202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:53:00.802815 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1201/2404] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:53:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:53:00.806746 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1971e9-c57b-4ffa-ad58-54662261d647 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:53:00.819314 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1971e9-c57b-4ffa-ad58-54662261d647 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:53:00.824296 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc68660-2b0c-45a2-ae25-5d430241b939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:53:00.824966 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc68660-2b0c-45a2-ae25-5d430241b939 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:00.825282 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc68660-2b0c-45a2-ae25-5d430241b939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:00.825568 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc68660-2b0c-45a2-ae25-5d430241b939 admin admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:00.826359 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc68660-2b0c-45a2-ae25-5d430241b939 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:53:00.826653 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc68660-2b0c-45a2-ae25-5d430241b939 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:53:00.828337 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc68660-2b0c-45a2-ae25-5d430241b939 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:53:00.845565 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1204/2405] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Jul 18 16:53:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:53:00.846747 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c595e-a50b-4b3c-871a-742780760202 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:53:00.857755 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c595e-a50b-4b3c-871a-742780760202 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:53:00.863260 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb819545-516b-4b10-8842-9cb016d5b17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:53:00.863957 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb819545-516b-4b10-8842-9cb016d5b17b admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:00.864235 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb819545-516b-4b10-8842-9cb016d5b17b admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:00.864502 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb819545-516b-4b10-8842-9cb016d5b17b admin admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:00.865188 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb819545-516b-4b10-8842-9cb016d5b17b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:53:00.867869 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb819545-516b-4b10-8842-9cb016d5b17b admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:53:00.973020 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1202/2406] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:53:00 2022] POST /identity/v3/projects => generated 375 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:53:00.984051 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc68660-2b0c-45a2-ae25-5d430241b939 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:53:01.017313 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc68660-2b0c-45a2-ae25-5d430241b939 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:53:01.048667 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65fadc1-58c8-440a-bdf9-6db1fef4e3f8 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:01.049257 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65fadc1-58c8-440a-bdf9-6db1fef4e3f8 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:01.049561 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65fadc1-58c8-440a-bdf9-6db1fef4e3f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:01.080118 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-b65fadc1-58c8-440a-bdf9-6db1fef4e3f8 None None] MFA Rules not processed for user `1243241885654b7283cc678febc40c41`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:53:01.081328 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-b65fadc1-58c8-440a-bdf9-6db1fef4e3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:53:01.103168 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb6fe7-54c9-4fac-9c4e-fa5db8e3cc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:53:01.104304 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb6fe7-54c9-4fac-9c4e-fa5db8e3cc3b admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:01.104759 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb6fe7-54c9-4fac-9c4e-fa5db8e3cc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:01.107164 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb6fe7-54c9-4fac-9c4e-fa5db8e3cc3b admin admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:01.107164 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cb6fe7-54c9-4fac-9c4e-fa5db8e3cc3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:53:01.108598 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cb6fe7-54c9-4fac-9c4e-fa5db8e3cc3b admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:53:01.164360 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1203/2407] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:53:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:53:01.177916 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65fadc1-58c8-440a-bdf9-6db1fef4e3f8 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:53:01.180025 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-b65fadc1-58c8-440a-bdf9-6db1fef4e3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:53:01.232278 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1205/2408] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 16:53:00 2022] POST /identity/v3/users => generated 288 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:53:01.232391 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb6fe7-54c9-4fac-9c4e-fa5db8e3cc3b admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:53:01.242692 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb6fe7-54c9-4fac-9c4e-fa5db8e3cc3b admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:53:01.247284 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65fadc1-58c8-440a-bdf9-6db1fef4e3f8 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:53:01.249578 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caacf370-3b26-4422-b52a-07175c610f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:53:01.249947 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caacf370-3b26-4422-b52a-07175c610f1a admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:01.250224 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caacf370-3b26-4422-b52a-07175c610f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:01.250502 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caacf370-3b26-4422-b52a-07175c610f1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:01.251227 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caacf370-3b26-4422-b52a-07175c610f1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:53:01.251890 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ff01d-f2c7-4601-946a-f796cf36db90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:53:01.252572 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ff01d-f2c7-4601-946a-f796cf36db90 service cinder] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:01.252880 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ff01d-f2c7-4601-946a-f796cf36db90 service cinder] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:01.253003 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caacf370-3b26-4422-b52a-07175c610f1a admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:53:01.253161 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ff01d-f2c7-4601-946a-f796cf36db90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:01.262403 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145ff01d-f2c7-4601-946a-f796cf36db90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:53:01.263875 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145ff01d-f2c7-4601-946a-f796cf36db90 service cinder] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:53:01.267953 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1206/2409] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:53:01 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:53:01.268864 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caacf370-3b26-4422-b52a-07175c610f1a admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:53:01.274549 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1204/2410] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:53:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 16:53:01.279273 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caacf370-3b26-4422-b52a-07175c610f1a admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:53:01.284059 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95c9cac-5ec3-4af4-bac9-279da190ff6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:53:01.284789 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c9cac-5ec3-4af4-bac9-279da190ff6d admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:01.285073 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c9cac-5ec3-4af4-bac9-279da190ff6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:01.285346 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c9cac-5ec3-4af4-bac9-279da190ff6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:01.286058 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95c9cac-5ec3-4af4-bac9-279da190ff6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:53:01.287681 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95c9cac-5ec3-4af4-bac9-279da190ff6d admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:53:01.299427 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1207/2411] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:53:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:53:01.306275 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ff01d-f2c7-4601-946a-f796cf36db90 service cinder] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:53:01.323015 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ff01d-f2c7-4601-946a-f796cf36db90 service cinder] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:53:01.328409 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0159bf5a-a8f5-44a8-ae91-4f2c724d3be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:53:01.329658 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0159bf5a-a8f5-44a8-ae91-4f2c724d3be8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:01.329658 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0159bf5a-a8f5-44a8-ae91-4f2c724d3be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:01.330036 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0159bf5a-a8f5-44a8-ae91-4f2c724d3be8 admin admin] PATH_INFO: `/v3/projects/26afc374f41046ce85b498c0bd391bee/users/9d3c36b20e2e4b4d993bdd7d5692a11b/roles/ad3a2bc7b2094a4da1a95a143c8d9436` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:01.346562 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:01.347586 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0159bf5a-a8f5-44a8-ae91-4f2c724d3be8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26afc374f41046ce85b498c0bd391bee, user_id=9d3c36b20e2e4b4d993bdd7d5692a11b, role_id=ad3a2bc7b2094a4da1a95a143c8d9436)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:53:01.350690 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0159bf5a-a8f5-44a8-ae91-4f2c724d3be8 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:53:01.449456 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1205/2412] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:53:01 2022] PUT /identity/v3/projects/26afc374f41046ce85b498c0bd391bee/users/9d3c36b20e2e4b4d993bdd7d5692a11b/roles/ad3a2bc7b2094a4da1a95a143c8d9436 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:53:01.462280 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc7d065-c4a8-4a94-8315-db961516f587 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:01.462662 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc7d065-c4a8-4a94-8315-db961516f587 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:01.463009 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc7d065-c4a8-4a94-8315-db961516f587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:01.492136 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-edc7d065-c4a8-4a94-8315-db961516f587 None None] MFA Rules not processed for user `9d3c36b20e2e4b4d993bdd7d5692a11b`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:53:01.493394 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-edc7d065-c4a8-4a94-8315-db961516f587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:53:01.572427 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1208/2413] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:53:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:53:01.580440 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0159bf5a-a8f5-44a8-ae91-4f2c724d3be8 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:53:01.582286 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-0159bf5a-a8f5-44a8-ae91-4f2c724d3be8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:53:01.606401 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:01.641942 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0159bf5a-a8f5-44a8-ae91-4f2c724d3be8 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:53:01.646034 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a06467-8d50-409c-8612-c2ee30c7f799 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:53:01.646685 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a06467-8d50-409c-8612-c2ee30c7f799 service cinder] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:01.646967 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a06467-8d50-409c-8612-c2ee30c7f799 service cinder] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:01.647891 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a06467-8d50-409c-8612-c2ee30c7f799 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:01.657107 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a06467-8d50-409c-8612-c2ee30c7f799 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:53:01.658555 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a06467-8d50-409c-8612-c2ee30c7f799 service cinder] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:53:01.668172 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1206/2414] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:53:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:53:02.106643 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:04.340043 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e032fb-35a5-4e63-86a9-27890c91e69c None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:04.340723 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e032fb-35a5-4e63-86a9-27890c91e69c None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:04.340723 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e032fb-35a5-4e63-86a9-27890c91e69c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:04.360029 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-55e032fb-35a5-4e63-86a9-27890c91e69c None None] MFA Rules not processed for user `1243241885654b7283cc678febc40c41`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:53:04.361297 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-55e032fb-35a5-4e63-86a9-27890c91e69c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:53:04.419456 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1209/2415] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:53:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:53:05.267606 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:07.094652 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:09.986199 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:10.906751 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:12.496829 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:12.683378 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:13.922301 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:14.360086 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:15.353425 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:15.809443 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:17.125799 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:17.565728 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:17.676544 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a06467-8d50-409c-8612-c2ee30c7f799 service cinder] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:53:17.678050 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-10a06467-8d50-409c-8612-c2ee30c7f799 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:53:17.761794 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a06467-8d50-409c-8612-c2ee30c7f799 service cinder] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:53:17.768577 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ac628-2f19-4fd7-847b-7e3470320c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:53:17.769514 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ac628-2f19-4fd7-847b-7e3470320c57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:17.769797 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ac628-2f19-4fd7-847b-7e3470320c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:17.770106 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ac628-2f19-4fd7-847b-7e3470320c57 admin admin] PATH_INFO: `/v3/users/14ee8efa14fd4442a35cf0e7a78388d6` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:17.771331 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6ac628-2f19-4fd7-847b-7e3470320c57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14ee8efa14fd4442a35cf0e7a78388d6)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:53:17.773407 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6ac628-2f19-4fd7-847b-7e3470320c57 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:53:18.047294 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-9c6ac628-2f19-4fd7-847b-7e3470320c57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14ee8efa14fd4442a35cf0e7a78388d6'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:18.048128 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-9c6ac628-2f19-4fd7-847b-7e3470320c57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14ee8efa14fd4442a35cf0e7a78388d6'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:18.060680 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-9c6ac628-2f19-4fd7-847b-7e3470320c57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14ee8efa14fd4442a35cf0e7a78388d6'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:18.135636 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-9c6ac628-2f19-4fd7-847b-7e3470320c57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14ee8efa14fd4442a35cf0e7a78388d6'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:18.144163 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-9c6ac628-2f19-4fd7-847b-7e3470320c57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14ee8efa14fd4442a35cf0e7a78388d6'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:18.150957 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1207/2416] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 16:53:17 2022] DELETE /identity/v3/users/14ee8efa14fd4442a35cf0e7a78388d6 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:53:18.155378 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd124ab9-c0db-4cfb-b1ab-fa4c9faa5e9d None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:18.155667 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd124ab9-c0db-4cfb-b1ab-fa4c9faa5e9d None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:18.155997 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd124ab9-c0db-4cfb-b1ab-fa4c9faa5e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:18.175816 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-cd124ab9-c0db-4cfb-b1ab-fa4c9faa5e9d None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:53:18.177056 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-cd124ab9-c0db-4cfb-b1ab-fa4c9faa5e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:53:18.246520 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1210/2417] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:53:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:53:18.256003 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ac628-2f19-4fd7-847b-7e3470320c57 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:53:18.258925 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-9c6ac628-2f19-4fd7-847b-7e3470320c57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:53:18.336334 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ac628-2f19-4fd7-847b-7e3470320c57 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:53:18.341155 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b124e-9e6d-40f8-abb2-7a71dff8c355 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:53:18.341853 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b124e-9e6d-40f8-abb2-7a71dff8c355 service neutron] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:18.342133 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b124e-9e6d-40f8-abb2-7a71dff8c355 service neutron] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:18.342409 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b124e-9e6d-40f8-abb2-7a71dff8c355 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:18.352416 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0b124e-9e6d-40f8-abb2-7a71dff8c355 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:53:18.353861 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0b124e-9e6d-40f8-abb2-7a71dff8c355 service neutron] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:53:18.364193 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1208/2418] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:53:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:53:18.700862 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:18.865113 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd124ab9-c0db-4cfb-b1ab-fa4c9faa5e9d None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:53:18.866586 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-cd124ab9-c0db-4cfb-b1ab-fa4c9faa5e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:53:18.883847 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd124ab9-c0db-4cfb-b1ab-fa4c9faa5e9d None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:53:18.889431 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e482db7-dd0b-468e-aeb6-f97bfeb4f5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:53:18.890452 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e482db7-dd0b-468e-aeb6-f97bfeb4f5a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:18.890735 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e482db7-dd0b-468e-aeb6-f97bfeb4f5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:18.891010 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e482db7-dd0b-468e-aeb6-f97bfeb4f5a8 admin admin] PATH_INFO: `/v3/projects/c713ff77a82942088095cb6c19de8c2c` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:18.893252 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e482db7-dd0b-468e-aeb6-f97bfeb4f5a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c713ff77a82942088095cb6c19de8c2c)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:53:18.895815 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e482db7-dd0b-468e-aeb6-f97bfeb4f5a8 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:53:19.076894 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-9e482db7-dd0b-468e-aeb6-f97bfeb4f5a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c713ff77a82942088095cb6c19de8c2c', 'request_id': 'req-9e482db7-dd0b-468e-aeb6-f97bfeb4f5a8'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:19.088891 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-9e482db7-dd0b-468e-aeb6-f97bfeb4f5a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c713ff77a82942088095cb6c19de8c2c', 'request_id': 'req-9e482db7-dd0b-468e-aeb6-f97bfeb4f5a8'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:19.096715 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-9e482db7-dd0b-468e-aeb6-f97bfeb4f5a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c713ff77a82942088095cb6c19de8c2c', 'request_id': 'req-9e482db7-dd0b-468e-aeb6-f97bfeb4f5a8'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:19.296677 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:19.301026 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-9e482db7-dd0b-468e-aeb6-f97bfeb4f5a8 admin admin] The token cache is being invalidate because project c713ff77a82942088095cb6c19de8c2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:53:19.301316 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-9e482db7-dd0b-468e-aeb6-f97bfeb4f5a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:19.301949 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-9e482db7-dd0b-468e-aeb6-f97bfeb4f5a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:19.303472 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1211/2419] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 16:53:18 2022] DELETE /identity/v3/projects/c713ff77a82942088095cb6c19de8c2c => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:53:19.474528 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:20.516306 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58a447-71be-4e1c-aff3-a16900442d75 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:20.516938 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58a447-71be-4e1c-aff3-a16900442d75 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:20.516938 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58a447-71be-4e1c-aff3-a16900442d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:20.537588 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-9a58a447-71be-4e1c-aff3-a16900442d75 None None] MFA Rules not processed for user `60f5a94486a74d31a195adf28367dc9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:53:20.539368 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-9a58a447-71be-4e1c-aff3-a16900442d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:53:20.595356 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1209/2420] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:53:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:53:22.031920 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:22.188698 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:23.177004 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:23.586521 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:23.811698 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:24.086256 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:24.248848 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:24.605714 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:24.731639 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:25.032363 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:25.313861 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=85,keystone:INSERT=4,keystone:DELETE=11 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:25.377146 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:25.634582 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:25.725478 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:26.000570 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:26.199684 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:26.816762 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:27.077607 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:27.137317 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:27.660534 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:27.857304 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:27.889104 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:28.005916 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:28.091816 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:28.239858 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:28.329136 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:29.238373 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:29.352737 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:29.828497 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:30.188347 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:30.257412 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:30.689409 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:30.721275 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e482db7-dd0b-468e-aeb6-f97bfeb4f5a8 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:53:30.722672 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-9e482db7-dd0b-468e-aeb6-f97bfeb4f5a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:53:30.782506 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:30.787078 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e482db7-dd0b-468e-aeb6-f97bfeb4f5a8 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:53:30.792238 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3af7eb-f6ed-48bc-a812-53b8b78c1ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:53:30.793105 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3af7eb-f6ed-48bc-a812-53b8b78c1ffa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:30.793382 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3af7eb-f6ed-48bc-a812-53b8b78c1ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:30.793685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3af7eb-f6ed-48bc-a812-53b8b78c1ffa admin admin] PATH_INFO: `/v3/users/9d3c36b20e2e4b4d993bdd7d5692a11b` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:30.794862 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3af7eb-f6ed-48bc-a812-53b8b78c1ffa admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d3c36b20e2e4b4d993bdd7d5692a11b)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:53:30.796777 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3af7eb-f6ed-48bc-a812-53b8b78c1ffa admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:53:31.052008 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-dd3af7eb-f6ed-48bc-a812-53b8b78c1ffa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d3c36b20e2e4b4d993bdd7d5692a11b'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:31.063928 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-dd3af7eb-f6ed-48bc-a812-53b8b78c1ffa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d3c36b20e2e4b4d993bdd7d5692a11b'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:31.064678 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-dd3af7eb-f6ed-48bc-a812-53b8b78c1ffa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d3c36b20e2e4b4d993bdd7d5692a11b'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:31.071812 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-dd3af7eb-f6ed-48bc-a812-53b8b78c1ffa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d3c36b20e2e4b4d993bdd7d5692a11b'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:31.151667 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-dd3af7eb-f6ed-48bc-a812-53b8b78c1ffa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d3c36b20e2e4b4d993bdd7d5692a11b'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:31.158292 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1212/2421] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 16:53:30 2022] DELETE /identity/v3/users/9d3c36b20e2e4b4d993bdd7d5692a11b => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:53:31.164890 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005ff06-db15-4753-9cb1-f771a8e58dc4 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:31.165469 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005ff06-db15-4753-9cb1-f771a8e58dc4 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:31.165952 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005ff06-db15-4753-9cb1-f771a8e58dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:31.185039 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-7005ff06-db15-4753-9cb1-f771a8e58dc4 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:53:31.186361 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-7005ff06-db15-4753-9cb1-f771a8e58dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:53:31.195405 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:31.251867 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1210/2422] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:53:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:53:31.266096 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3af7eb-f6ed-48bc-a812-53b8b78c1ffa admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:53:31.267705 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-dd3af7eb-f6ed-48bc-a812-53b8b78c1ffa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:53:31.279950 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:31.330717 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3af7eb-f6ed-48bc-a812-53b8b78c1ffa admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:53:31.340016 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e690dd3c-fa96-4d1a-99dc-f9c60342a41e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:53:31.340683 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e690dd3c-fa96-4d1a-99dc-f9c60342a41e service neutron] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:31.340964 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e690dd3c-fa96-4d1a-99dc-f9c60342a41e service neutron] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:31.341240 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e690dd3c-fa96-4d1a-99dc-f9c60342a41e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:31.351479 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e690dd3c-fa96-4d1a-99dc-f9c60342a41e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:53:31.352977 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e690dd3c-fa96-4d1a-99dc-f9c60342a41e service neutron] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:53:31.362465 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1213/2423] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:53:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:53:31.824653 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7005ff06-db15-4753-9cb1-f771a8e58dc4 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:53:31.826184 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-7005ff06-db15-4753-9cb1-f771a8e58dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:53:31.832038 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:31.839843 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7005ff06-db15-4753-9cb1-f771a8e58dc4 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:53:31.845240 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b47ec1-683d-4a8e-87ad-5e2a89bc6b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:53:31.846123 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b47ec1-683d-4a8e-87ad-5e2a89bc6b32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:31.846497 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b47ec1-683d-4a8e-87ad-5e2a89bc6b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:31.846777 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b47ec1-683d-4a8e-87ad-5e2a89bc6b32 admin admin] PATH_INFO: `/v3/projects/26afc374f41046ce85b498c0bd391bee` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:31.848238 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b47ec1-683d-4a8e-87ad-5e2a89bc6b32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26afc374f41046ce85b498c0bd391bee)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:53:31.850179 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b47ec1-683d-4a8e-87ad-5e2a89bc6b32 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:53:31.894935 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:32.010625 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-d8b47ec1-683d-4a8e-87ad-5e2a89bc6b32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26afc374f41046ce85b498c0bd391bee', 'request_id': 'req-d8b47ec1-683d-4a8e-87ad-5e2a89bc6b32'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:32.126158 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-d8b47ec1-683d-4a8e-87ad-5e2a89bc6b32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26afc374f41046ce85b498c0bd391bee', 'request_id': 'req-d8b47ec1-683d-4a8e-87ad-5e2a89bc6b32'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:32.132624 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-d8b47ec1-683d-4a8e-87ad-5e2a89bc6b32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26afc374f41046ce85b498c0bd391bee', 'request_id': 'req-d8b47ec1-683d-4a8e-87ad-5e2a89bc6b32'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:32.144639 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-d8b47ec1-683d-4a8e-87ad-5e2a89bc6b32 admin admin] The token cache is being invalidate because project 26afc374f41046ce85b498c0bd391bee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:53:32.144963 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-d8b47ec1-683d-4a8e-87ad-5e2a89bc6b32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:32.145609 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-d8b47ec1-683d-4a8e-87ad-5e2a89bc6b32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:32.147208 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1211/2424] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 16:53:31 2022] DELETE /identity/v3/projects/26afc374f41046ce85b498c0bd391bee => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:53:33.209392 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:33.740148 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:34.577298 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:34.871928 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:35.114191 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:35.331827 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:35.496619 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:45.079485 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=4 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:45.610817 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=14,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:46.591510 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbe318-a08c-4f1d-bd8e-9b201153a0c8 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:46.592036 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbe318-a08c-4f1d-bd8e-9b201153a0c8 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:46.592215 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbe318-a08c-4f1d-bd8e-9b201153a0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:46.610862 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-aefbe318-a08c-4f1d-bd8e-9b201153a0c8 None None] MFA Rules not processed for user `ea2a096c4b964f03aed533d1e5e96db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:53:46.612100 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-aefbe318-a08c-4f1d-bd8e-9b201153a0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:53:46.668436 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1214/2425] 10.222.0.81 () {58 vars in 1009 bytes} [Mon Jul 18 16:53:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:53:46.693481 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b47ec1-683d-4a8e-87ad-5e2a89bc6b32 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:53:46.696354 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-d8b47ec1-683d-4a8e-87ad-5e2a89bc6b32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:53:46.768840 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b47ec1-683d-4a8e-87ad-5e2a89bc6b32 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:53:46.774160 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e30647-4d7e-4cd4-b673-76dfd6521982 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251475c53ac64cd48ae84567d8c2ee87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:53:46.774810 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e30647-4d7e-4cd4-b673-76dfd6521982 service swift] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:46.775091 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e30647-4d7e-4cd4-b673-76dfd6521982 service swift] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:46.775365 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e30647-4d7e-4cd4-b673-76dfd6521982 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:46.784346 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e30647-4d7e-4cd4-b673-76dfd6521982 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:53:46.786049 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e30647-4d7e-4cd4-b673-76dfd6521982 service swift] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:53:46.794198 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1212/2426] 10.222.0.81 () {60 vars in 1384 bytes} [Mon Jul 18 16:53:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 16:53:50.171345 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a53e53-fd36-4829-bc7f-5ee97dc82dc4 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:50.172100 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a53e53-fd36-4829-bc7f-5ee97dc82dc4 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:50.172100 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a53e53-fd36-4829-bc7f-5ee97dc82dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:50.191277 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-d6a53e53-fd36-4829-bc7f-5ee97dc82dc4 None None] MFA Rules not processed for user `ea2a096c4b964f03aed533d1e5e96db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:53:50.192667 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-d6a53e53-fd36-4829-bc7f-5ee97dc82dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:53:50.202174 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1215/2427] 10.222.0.81 () {58 vars in 1009 bytes} [Mon Jul 18 16:53:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:53:50.257221 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e30647-4d7e-4cd4-b673-76dfd6521982 service swift] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:53:50.275922 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e30647-4d7e-4cd4-b673-76dfd6521982 service swift] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:53:50.282934 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f25e0e4-faca-44a4-b1c3-d8d8dfc685a1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251475c53ac64cd48ae84567d8c2ee87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:53:50.283592 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25e0e4-faca-44a4-b1c3-d8d8dfc685a1 service swift] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:50.284899 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25e0e4-faca-44a4-b1c3-d8d8dfc685a1 service swift] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:50.285348 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25e0e4-faca-44a4-b1c3-d8d8dfc685a1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:50.297767 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f25e0e4-faca-44a4-b1c3-d8d8dfc685a1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:53:50.299366 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f25e0e4-faca-44a4-b1c3-d8d8dfc685a1 service swift] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:53:50.310007 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1213/2428] 10.222.0.81 () {60 vars in 1384 bytes} [Mon Jul 18 16:53:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 16:53:59.547736 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6cb57d-bb25-4d93-9e07-67829286ea67 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:59.550857 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6cb57d-bb25-4d93-9e07-67829286ea67 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:59.552723 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6cb57d-bb25-4d93-9e07-67829286ea67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:59.625564 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-db6cb57d-bb25-4d93-9e07-67829286ea67 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:53:59.634259 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-db6cb57d-bb25-4d93-9e07-67829286ea67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:53:59.816284 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1216/2429] 10.222.0.89 () {58 vars in 1016 bytes} [Mon Jul 18 16:53:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:53:59.841565 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f25e0e4-faca-44a4-b1c3-d8d8dfc685a1 service swift] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:53:59.846411 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-3f25e0e4-faca-44a4-b1c3-d8d8dfc685a1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:53:59.942179 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f25e0e4-faca-44a4-b1c3-d8d8dfc685a1 service swift] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:53:59.948762 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba68eaa8-695a-46ab-af74-60c270b8d7e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07f0c5bf1bee48a0bafdf7a9e4537c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:53:59.949450 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba68eaa8-695a-46ab-af74-60c270b8d7e7 service nova] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:59.949844 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba68eaa8-695a-46ab-af74-60c270b8d7e7 service nova] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:59.950233 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba68eaa8-695a-46ab-af74-60c270b8d7e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:59.960618 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba68eaa8-695a-46ab-af74-60c270b8d7e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:53:59.962461 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba68eaa8-695a-46ab-af74-60c270b8d7e7 service nova] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:53:59.975558 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1214/2430] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:53:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:54:05.755354 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546c389-9645-4576-8c90-996e146bbf0b None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:54:05.756188 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546c389-9645-4576-8c90-996e146bbf0b None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:54:05.756816 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546c389-9645-4576-8c90-996e146bbf0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:54:05.780284 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-b546c389-9645-4576-8c90-996e146bbf0b None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:54:05.781690 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-b546c389-9645-4576-8c90-996e146bbf0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:54:05.792470 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1217/2431] 10.222.0.89 () {58 vars in 1016 bytes} [Mon Jul 18 16:54:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:54:05.815872 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba68eaa8-695a-46ab-af74-60c270b8d7e7 service nova] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:54:05.817578 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-ba68eaa8-695a-46ab-af74-60c270b8d7e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:54:05.835254 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba68eaa8-695a-46ab-af74-60c270b8d7e7 service nova] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:54:05.843002 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcfba68-0838-49d3-b42d-a0b1b529595e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07f0c5bf1bee48a0bafdf7a9e4537c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:54:05.844090 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcfba68-0838-49d3-b42d-a0b1b529595e service nova] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:54:05.844451 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcfba68-0838-49d3-b42d-a0b1b529595e service nova] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:54:05.844797 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcfba68-0838-49d3-b42d-a0b1b529595e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:54:05.854521 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcfba68-0838-49d3-b42d-a0b1b529595e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:54:05.856251 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcfba68-0838-49d3-b42d-a0b1b529595e service nova] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:54:05.866995 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1215/2432] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:54:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:54:10.324904 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ffc64-2b5e-42b8-8837-55aaff8c5980 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:54:10.325419 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ffc64-2b5e-42b8-8837-55aaff8c5980 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:54:10.325555 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ffc64-2b5e-42b8-8837-55aaff8c5980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:54:10.344347 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-703ffc64-2b5e-42b8-8837-55aaff8c5980 None None] MFA Rules not processed for user `ea2a096c4b964f03aed533d1e5e96db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:54:10.345562 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-703ffc64-2b5e-42b8-8837-55aaff8c5980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:54:10.353287 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1218/2433] 10.222.0.81 () {58 vars in 967 bytes} [Mon Jul 18 16:54:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:54:10.366437 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcfba68-0838-49d3-b42d-a0b1b529595e service nova] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:54:10.377954 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcfba68-0838-49d3-b42d-a0b1b529595e service nova] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:54:10.384176 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242a8c39-cc7e-4dc3-86d0-0a5d671f9110 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251475c53ac64cd48ae84567d8c2ee87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:54:10.398050 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a8c39-cc7e-4dc3-86d0-0a5d671f9110 service swift] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:54:10.398050 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a8c39-cc7e-4dc3-86d0-0a5d671f9110 service swift] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:54:10.398050 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a8c39-cc7e-4dc3-86d0-0a5d671f9110 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:54:10.398367 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7cf45c-0823-4031-b9da-9ffc02e973b0 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:54:10.398367 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7cf45c-0823-4031-b9da-9ffc02e973b0 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:54:10.398367 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7cf45c-0823-4031-b9da-9ffc02e973b0 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:54:10.398367 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1219/2434] 10.222.0.81 () {54 vars in 921 bytes} [Mon Jul 18 16:54:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:54:10.398689 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242a8c39-cc7e-4dc3-86d0-0a5d671f9110 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:54:10.398689 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242a8c39-cc7e-4dc3-86d0-0a5d671f9110 service swift] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:54:10.400001 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a1e44-b701-4fd7-a218-1f99debc3b59 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:54:10.400001 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a1e44-b701-4fd7-a218-1f99debc3b59 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:54:10.400218 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a1e44-b701-4fd7-a218-1f99debc3b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:54:10.411102 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1216/2435] 10.222.0.81 () {60 vars in 1384 bytes} [Mon Jul 18 16:54:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 18 16:54:10.418754 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-440a1e44-b701-4fd7-a218-1f99debc3b59 None None] MFA Rules not processed for user `07f0c5bf1bee48a0bafdf7a9e4537c70`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:54:10.420015 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-440a1e44-b701-4fd7-a218-1f99debc3b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:54:10.433618 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1220/2436] 10.222.0.81 () {58 vars in 1018 bytes} [Mon Jul 18 16:54:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:54:10.450101 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242a8c39-cc7e-4dc3-86d0-0a5d671f9110 service swift] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:54:10.450101 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-242a8c39-cc7e-4dc3-86d0-0a5d671f9110 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:54:10.489215 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:54:10.506774 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242a8c39-cc7e-4dc3-86d0-0a5d671f9110 service swift] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:54:10.510487 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f6160c-649a-47e1-b737-1f5e0f7a04e7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e638fbc5f1f3447c8e189c228bbae530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:54:10.511155 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6160c-649a-47e1-b737-1f5e0f7a04e7 service glance] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:54:10.511438 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6160c-649a-47e1-b737-1f5e0f7a04e7 service glance] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:54:10.511849 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6160c-649a-47e1-b737-1f5e0f7a04e7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:54:10.523246 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f6160c-649a-47e1-b737-1f5e0f7a04e7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:54:10.524646 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f6160c-649a-47e1-b737-1f5e0f7a04e7 service glance] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:54:10.535392 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1217/2437] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:54:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:54:10.793124 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32e05f-e8c7-40fa-b930-f2a5ee8f117c None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:54:10.793498 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32e05f-e8c7-40fa-b930-f2a5ee8f117c None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:54:10.793786 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32e05f-e8c7-40fa-b930-f2a5ee8f117c None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:54:10.795389 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1221/2438] 10.222.0.81 () {54 vars in 921 bytes} [Mon Jul 18 16:54:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:54:10.801061 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb788d-24bc-428c-bea5-3a6c33e5886a None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:54:10.801405 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb788d-24bc-428c-bea5-3a6c33e5886a None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:54:10.801642 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb788d-24bc-428c-bea5-3a6c33e5886a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:54:10.821120 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-6fcb788d-24bc-428c-bea5-3a6c33e5886a None None] MFA Rules not processed for user `b742c540de6545249fe3245047d00c81`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:54:10.823141 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-6fcb788d-24bc-428c-bea5-3a6c33e5886a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:54:10.875877 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1218/2439] 10.222.0.81 () {58 vars in 1018 bytes} [Mon Jul 18 16:54:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:54:10.889480 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f32e05f-e8c7-40fa-b930-f2a5ee8f117c None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:54:10.891180 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-5f32e05f-e8c7-40fa-b930-f2a5ee8f117c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:54:10.905889 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f32e05f-e8c7-40fa-b930-f2a5ee8f117c None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:54:10.909633 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99682b77-8c47-4963-b158-1896257e2e95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:54:10.910277 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99682b77-8c47-4963-b158-1896257e2e95 service neutron] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:54:10.910562 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99682b77-8c47-4963-b158-1896257e2e95 service neutron] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:54:10.910839 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99682b77-8c47-4963-b158-1896257e2e95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:54:10.918508 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99682b77-8c47-4963-b158-1896257e2e95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:54:10.919977 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99682b77-8c47-4963-b158-1896257e2e95 service neutron] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:54:10.927943 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1222/2440] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:54:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:54:11.015990 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64925af-c108-4e3d-8171-33cdb531dbc7 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:54:11.016284 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64925af-c108-4e3d-8171-33cdb531dbc7 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:54:11.016566 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64925af-c108-4e3d-8171-33cdb531dbc7 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:54:11.018153 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1219/2441] 10.222.0.81 () {54 vars in 921 bytes} [Mon Jul 18 16:54:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:54:11.023995 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17011c4-4215-47cb-9e0a-13b3bcd9ecc3 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:54:11.024278 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17011c4-4215-47cb-9e0a-13b3bcd9ecc3 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:54:11.024697 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17011c4-4215-47cb-9e0a-13b3bcd9ecc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:54:11.043357 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-c17011c4-4215-47cb-9e0a-13b3bcd9ecc3 None None] MFA Rules not processed for user `07f0c5bf1bee48a0bafdf7a9e4537c70`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:54:11.044492 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-c17011c4-4215-47cb-9e0a-13b3bcd9ecc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:54:11.053963 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1223/2442] 10.222.0.81 () {58 vars in 1018 bytes} [Mon Jul 18 16:54:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:54:11.065031 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64925af-c108-4e3d-8171-33cdb531dbc7 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:54:11.066712 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-d64925af-c108-4e3d-8171-33cdb531dbc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:54:11.080418 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64925af-c108-4e3d-8171-33cdb531dbc7 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:54:11.084759 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c7f30f-f49b-4f24-979e-df89d54aed09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:54:11.085389 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7f30f-f49b-4f24-979e-df89d54aed09 service neutron] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:54:11.085667 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7f30f-f49b-4f24-979e-df89d54aed09 service neutron] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:54:11.085939 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7f30f-f49b-4f24-979e-df89d54aed09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:54:11.097069 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c7f30f-f49b-4f24-979e-df89d54aed09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:54:11.098506 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c7f30f-f49b-4f24-979e-df89d54aed09 service neutron] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:54:11.109384 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1220/2443] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:54:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:54:12.625930 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1aefcf-80c0-4602-8fcf-9162e3362e76 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:54:12.626467 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1aefcf-80c0-4602-8fcf-9162e3362e76 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:54:12.626467 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1aefcf-80c0-4602-8fcf-9162e3362e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:54:12.645276 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-4b1aefcf-80c0-4602-8fcf-9162e3362e76 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:54:12.647011 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-4b1aefcf-80c0-4602-8fcf-9162e3362e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:54:12.654946 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1224/2444] 10.222.0.89 () {58 vars in 1016 bytes} [Mon Jul 18 16:54:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:54:12.681773 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c7f30f-f49b-4f24-979e-df89d54aed09 service neutron] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:54:12.693426 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c7f30f-f49b-4f24-979e-df89d54aed09 service neutron] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:54:12.699447 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8bede2-3165-42bc-9655-333296869cd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07f0c5bf1bee48a0bafdf7a9e4537c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:54:12.700131 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8bede2-3165-42bc-9655-333296869cd4 service nova] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:54:12.700642 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8bede2-3165-42bc-9655-333296869cd4 service nova] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:54:12.700931 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8bede2-3165-42bc-9655-333296869cd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:54:12.710143 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8bede2-3165-42bc-9655-333296869cd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:54:12.711766 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8bede2-3165-42bc-9655-333296869cd4 service nova] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:54:12.722205 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1221/2445] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:54:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:54:13.802744 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1aefcf-80c0-4602-8fcf-9162e3362e76 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:54:13.804731 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-4b1aefcf-80c0-4602-8fcf-9162e3362e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:54:13.817251 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1aefcf-80c0-4602-8fcf-9162e3362e76 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:54:13.822457 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b57dcd5-433e-4394-a57a-387e9c8a8b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:54:13.823339 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57dcd5-433e-4394-a57a-387e9c8a8b1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:54:13.823620 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57dcd5-433e-4394-a57a-387e9c8a8b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:54:13.823924 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57dcd5-433e-4394-a57a-387e9c8a8b1b admin admin] PATH_INFO: `/v3/users/60f5a94486a74d31a195adf28367dc9b` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:54:13.825158 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b57dcd5-433e-4394-a57a-387e9c8a8b1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=60f5a94486a74d31a195adf28367dc9b)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:54:13.827135 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b57dcd5-433e-4394-a57a-387e9c8a8b1b admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:54:14.039335 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-2b57dcd5-433e-4394-a57a-387e9c8a8b1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60f5a94486a74d31a195adf28367dc9b'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:54:14.040564 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:54:14.053370 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-2b57dcd5-433e-4394-a57a-387e9c8a8b1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60f5a94486a74d31a195adf28367dc9b'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:54:14.054079 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-2b57dcd5-433e-4394-a57a-387e9c8a8b1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60f5a94486a74d31a195adf28367dc9b'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:54:14.061648 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-2b57dcd5-433e-4394-a57a-387e9c8a8b1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60f5a94486a74d31a195adf28367dc9b'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:54:14.139949 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-2b57dcd5-433e-4394-a57a-387e9c8a8b1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60f5a94486a74d31a195adf28367dc9b'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:54:14.148238 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1225/2446] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 16:54:13 2022] DELETE /identity/v3/users/60f5a94486a74d31a195adf28367dc9b => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:54:14.394805 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8bede2-3165-42bc-9655-333296869cd4 service nova] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:54:14.407042 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8bede2-3165-42bc-9655-333296869cd4 service nova] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:54:14.479610 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a3351-2173-47c3-8a69-61720fab06dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:54:14.480507 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a3351-2173-47c3-8a69-61720fab06dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:54:14.480791 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a3351-2173-47c3-8a69-61720fab06dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:54:14.481067 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a3351-2173-47c3-8a69-61720fab06dc admin admin] PATH_INFO: `/v3/projects/a796216c159e437abc7515f0abb558fb` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:54:14.482270 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939a3351-2173-47c3-8a69-61720fab06dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a796216c159e437abc7515f0abb558fb)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:54:14.484238 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939a3351-2173-47c3-8a69-61720fab06dc admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:54:14.628495 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-939a3351-2173-47c3-8a69-61720fab06dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a796216c159e437abc7515f0abb558fb', 'request_id': 'req-939a3351-2173-47c3-8a69-61720fab06dc'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:54:14.788045 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-939a3351-2173-47c3-8a69-61720fab06dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a796216c159e437abc7515f0abb558fb', 'request_id': 'req-939a3351-2173-47c3-8a69-61720fab06dc'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:54:14.793306 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:54:14.794485 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-939a3351-2173-47c3-8a69-61720fab06dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a796216c159e437abc7515f0abb558fb', 'request_id': 'req-939a3351-2173-47c3-8a69-61720fab06dc'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:54:14.806330 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-939a3351-2173-47c3-8a69-61720fab06dc admin admin] The token cache is being invalidate because project a796216c159e437abc7515f0abb558fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:54:14.806636 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-939a3351-2173-47c3-8a69-61720fab06dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:54:14.807304 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-939a3351-2173-47c3-8a69-61720fab06dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:54:14.809057 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1222/2447] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 16:54:14 2022] DELETE /identity/v3/projects/a796216c159e437abc7515f0abb558fb => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:54:16.812611 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97f062-23d4-4c22-9dd3-7142ff3c0cc2 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:54:16.813137 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97f062-23d4-4c22-9dd3-7142ff3c0cc2 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:54:16.813245 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97f062-23d4-4c22-9dd3-7142ff3c0cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:54:16.832335 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-1e97f062-23d4-4c22-9dd3-7142ff3c0cc2 None None] MFA Rules not processed for user `ea2a096c4b964f03aed533d1e5e96db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:54:16.833668 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-1e97f062-23d4-4c22-9dd3-7142ff3c0cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:54:16.890812 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1226/2448] 10.222.0.81 () {58 vars in 1009 bytes} [Mon Jul 18 16:54:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:54:16.903444 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a3351-2173-47c3-8a69-61720fab06dc admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:54:16.905137 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-939a3351-2173-47c3-8a69-61720fab06dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:54:16.974236 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a3351-2173-47c3-8a69-61720fab06dc admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:54:16.979601 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c1ebdc-4678-4be6-b080-ebb4e4881ca6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251475c53ac64cd48ae84567d8c2ee87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:54:16.980268 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1ebdc-4678-4be6-b080-ebb4e4881ca6 service swift] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:54:16.980547 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1ebdc-4678-4be6-b080-ebb4e4881ca6 service swift] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:54:16.980818 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1ebdc-4678-4be6-b080-ebb4e4881ca6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:54:16.989360 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c1ebdc-4678-4be6-b080-ebb4e4881ca6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:54:16.991473 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c1ebdc-4678-4be6-b080-ebb4e4881ca6 service swift] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:54:16.999681 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1223/2449] 10.222.0.81 () {60 vars in 1384 bytes} [Mon Jul 18 16:54:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 16:54:18.284767 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7132ff5e-8529-4ebc-80a1-72f79b98e9be None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:54:18.285307 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7132ff5e-8529-4ebc-80a1-72f79b98e9be None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:54:18.285407 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7132ff5e-8529-4ebc-80a1-72f79b98e9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:54:18.303995 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-7132ff5e-8529-4ebc-80a1-72f79b98e9be None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:54:18.305136 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-7132ff5e-8529-4ebc-80a1-72f79b98e9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:54:18.402353 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1227/2450] 10.222.0.89 () {58 vars in 1016 bytes} [Mon Jul 18 16:54:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:54:18.438797 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c1ebdc-4678-4be6-b080-ebb4e4881ca6 service swift] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:54:18.440424 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-38c1ebdc-4678-4be6-b080-ebb4e4881ca6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:54:18.532878 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c1ebdc-4678-4be6-b080-ebb4e4881ca6 service swift] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:54:18.541273 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb98ba-9e29-4067-a439-0f87a6c19f5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07f0c5bf1bee48a0bafdf7a9e4537c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:54:18.542065 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb98ba-9e29-4067-a439-0f87a6c19f5c service nova] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:54:18.542358 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb98ba-9e29-4067-a439-0f87a6c19f5c service nova] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:54:18.542632 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb98ba-9e29-4067-a439-0f87a6c19f5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:54:18.551889 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bb98ba-9e29-4067-a439-0f87a6c19f5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:54:18.554142 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bb98ba-9e29-4067-a439-0f87a6c19f5c service nova] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:54:18.564058 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1224/2451] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:54:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:54:28.389121 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=64,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:54:28.559549 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=70 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:54:44.787606 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf7ccf-9008-4cbd-8cde-6074c7e2ceb5 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:54:44.788149 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf7ccf-9008-4cbd-8cde-6074c7e2ceb5 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:54:44.788245 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf7ccf-9008-4cbd-8cde-6074c7e2ceb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:54:44.807196 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-dbcf7ccf-9008-4cbd-8cde-6074c7e2ceb5 None None] MFA Rules not processed for user `ea2a096c4b964f03aed533d1e5e96db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:54:44.808517 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-dbcf7ccf-9008-4cbd-8cde-6074c7e2ceb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:54:44.816063 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1228/2452] 10.222.0.81 () {58 vars in 967 bytes} [Mon Jul 18 16:54:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:54:44.828110 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb98ba-9e29-4067-a439-0f87a6c19f5c service nova] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:54:44.839417 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb98ba-9e29-4067-a439-0f87a6c19f5c service nova] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:54:44.844628 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26119a2b-8460-42fb-8ee7-0a59beb27cd7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251475c53ac64cd48ae84567d8c2ee87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:54:44.845263 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26119a2b-8460-42fb-8ee7-0a59beb27cd7 service swift] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:54:44.845544 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26119a2b-8460-42fb-8ee7-0a59beb27cd7 service swift] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:54:44.845815 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26119a2b-8460-42fb-8ee7-0a59beb27cd7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:54:44.854769 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26119a2b-8460-42fb-8ee7-0a59beb27cd7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:54:44.856399 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26119a2b-8460-42fb-8ee7-0a59beb27cd7 service swift] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:54:44.865201 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1225/2453] 10.222.0.81 () {60 vars in 1384 bytes} [Mon Jul 18 16:54:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 18 16:54:46.251609 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e077c3-751a-4a7b-8a9f-12f957b82b5d None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:54:46.252163 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e077c3-751a-4a7b-8a9f-12f957b82b5d None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:54:46.252294 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e077c3-751a-4a7b-8a9f-12f957b82b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:54:46.277725 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-a0e077c3-751a-4a7b-8a9f-12f957b82b5d None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:54:46.279019 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-a0e077c3-751a-4a7b-8a9f-12f957b82b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:54:46.287990 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1229/2454] 10.222.0.89 () {58 vars in 1016 bytes} [Mon Jul 18 16:54:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:54:46.318321 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26119a2b-8460-42fb-8ee7-0a59beb27cd7 service swift] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:54:46.330271 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26119a2b-8460-42fb-8ee7-0a59beb27cd7 service swift] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:54:46.335834 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a147047-c941-4ee2-846d-7ce7e647a2be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07f0c5bf1bee48a0bafdf7a9e4537c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:54:46.336542 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a147047-c941-4ee2-846d-7ce7e647a2be service nova] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:54:46.336911 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a147047-c941-4ee2-846d-7ce7e647a2be service nova] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:54:46.337260 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a147047-c941-4ee2-846d-7ce7e647a2be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:54:46.345715 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a147047-c941-4ee2-846d-7ce7e647a2be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:54:46.347261 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a147047-c941-4ee2-846d-7ce7e647a2be service nova] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:54:46.357360 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1226/2455] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:54:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:54:50.539416 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1877548-8577-436d-a241-90ad615bf4e8 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:54:50.540240 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1877548-8577-436d-a241-90ad615bf4e8 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:54:50.540240 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1877548-8577-436d-a241-90ad615bf4e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:54:50.557829 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-e1877548-8577-436d-a241-90ad615bf4e8 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:54:50.559020 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-e1877548-8577-436d-a241-90ad615bf4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:54:50.566924 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1230/2456] 10.222.0.89 () {58 vars in 1016 bytes} [Mon Jul 18 16:54:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:54:50.590728 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a147047-c941-4ee2-846d-7ce7e647a2be service nova] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:54:50.592222 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-5a147047-c941-4ee2-846d-7ce7e647a2be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:54:50.607370 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a147047-c941-4ee2-846d-7ce7e647a2be service nova] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:54:50.613072 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c388f8a7-5577-48ae-b5fb-0db3052c6748 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07f0c5bf1bee48a0bafdf7a9e4537c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:54:50.613718 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388f8a7-5577-48ae-b5fb-0db3052c6748 service nova] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:54:50.614002 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388f8a7-5577-48ae-b5fb-0db3052c6748 service nova] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:54:50.614283 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388f8a7-5577-48ae-b5fb-0db3052c6748 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:54:50.623201 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c388f8a7-5577-48ae-b5fb-0db3052c6748 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:54:50.624824 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c388f8a7-5577-48ae-b5fb-0db3052c6748 service nova] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:54:50.636119 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1227/2457] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:54:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 16:55:00.552817 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=9 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:55:00.631683 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=18 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:55:03.358205 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1877548-8577-436d-a241-90ad615bf4e8 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:55:03.359613 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-e1877548-8577-436d-a241-90ad615bf4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:55:03.417538 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1877548-8577-436d-a241-90ad615bf4e8 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:55:03.421107 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18765c76-a5e8-49b6-81c2-fcb45580c247 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:55:03.421749 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18765c76-a5e8-49b6-81c2-fcb45580c247 service neutron] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:55:03.422029 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18765c76-a5e8-49b6-81c2-fcb45580c247 service neutron] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:55:03.422310 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18765c76-a5e8-49b6-81c2-fcb45580c247 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:55:03.424137 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-18765c76-a5e8-49b6-81c2-fcb45580c247 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:55:03.438325 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18765c76-a5e8-49b6-81c2-fcb45580c247 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:55:03.439778 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18765c76-a5e8-49b6-81c2-fcb45580c247 service neutron] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:55:03.451326 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1231/2458] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:55:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:55:04.724609 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c388f8a7-5577-48ae-b5fb-0db3052c6748 service nova] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:55:04.734162 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c388f8a7-5577-48ae-b5fb-0db3052c6748 service nova] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:55:04.737872 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b10a0-e893-44fc-a547-6de0a0edc262 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:55:04.739067 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b10a0-e893-44fc-a547-6de0a0edc262 service neutron] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:55:04.739347 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b10a0-e893-44fc-a547-6de0a0edc262 service neutron] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:55:04.739738 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b10a0-e893-44fc-a547-6de0a0edc262 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:55:04.746929 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-528b10a0-e893-44fc-a547-6de0a0edc262 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:55:04.756062 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b10a0-e893-44fc-a547-6de0a0edc262 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:55:04.757477 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b10a0-e893-44fc-a547-6de0a0edc262 service neutron] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:55:04.769010 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1228/2459] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:55:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:55:12.356834 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba98543-f9fa-45df-bae0-1f099c63ca8f None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:55:12.357337 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba98543-f9fa-45df-bae0-1f099c63ca8f None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:55:12.357436 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba98543-f9fa-45df-bae0-1f099c63ca8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:55:12.374644 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-7ba98543-f9fa-45df-bae0-1f099c63ca8f None None] MFA Rules not processed for user `1243241885654b7283cc678febc40c41`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:55:12.375878 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-7ba98543-f9fa-45df-bae0-1f099c63ca8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:55:12.430681 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1232/2460] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:55:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:55:14.154656 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b10a0-e893-44fc-a547-6de0a0edc262 service neutron] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:55:14.165965 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b10a0-e893-44fc-a547-6de0a0edc262 service neutron] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:55:14.173148 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbeeef2-7838-445d-9403-9a10882ae1a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07f0c5bf1bee48a0bafdf7a9e4537c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:55:14.173889 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbeeef2-7838-445d-9403-9a10882ae1a7 service nova] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:55:14.174173 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbeeef2-7838-445d-9403-9a10882ae1a7 service nova] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:55:14.174453 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbeeef2-7838-445d-9403-9a10882ae1a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:55:14.176339 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-bbbeeef2-7838-445d-9403-9a10882ae1a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:55:14.240733 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbeeef2-7838-445d-9403-9a10882ae1a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:55:14.242458 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbeeef2-7838-445d-9403-9a10882ae1a7 service nova] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:55:14.252150 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1229/2461] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:55:14 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:55:21.413234 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba98543-f9fa-45df-bae0-1f099c63ca8f None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:55:21.413937 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-7ba98543-f9fa-45df-bae0-1f099c63ca8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:55:21.488511 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba98543-f9fa-45df-bae0-1f099c63ca8f None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:55:21.492175 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089eb00a-a64d-43a4-8045-c553bc305884 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:55:21.492833 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089eb00a-a64d-43a4-8045-c553bc305884 service cinder] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:55:21.493116 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089eb00a-a64d-43a4-8045-c553bc305884 service cinder] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:55:21.493400 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089eb00a-a64d-43a4-8045-c553bc305884 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:55:21.495368 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-089eb00a-a64d-43a4-8045-c553bc305884 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:55:21.575321 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089eb00a-a64d-43a4-8045-c553bc305884 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:55:21.576788 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089eb00a-a64d-43a4-8045-c553bc305884 service cinder] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:55:21.586380 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1233/2462] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:55:21 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:55:24.247621 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=34 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:55:27.341778 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef6da7-f51f-4fe3-9880-69d63c3693e6 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:55:27.342492 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef6da7-f51f-4fe3-9880-69d63c3693e6 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:55:27.342492 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef6da7-f51f-4fe3-9880-69d63c3693e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:55:27.360524 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-30ef6da7-f51f-4fe3-9880-69d63c3693e6 None None] MFA Rules not processed for user `0f292cde7f7142f08e961a3d20d76b31`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:55:27.361815 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-30ef6da7-f51f-4fe3-9880-69d63c3693e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:55:27.368751 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1230/2463] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:55:27 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:55:31.581567 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=99 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:55:33.891101 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089eb00a-a64d-43a4-8045-c553bc305884 service cinder] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:55:33.892576 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-089eb00a-a64d-43a4-8045-c553bc305884 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:55:33.905754 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089eb00a-a64d-43a4-8045-c553bc305884 service cinder] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:55:33.909787 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e10883-93d2-469a-963d-dd4397a91a76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:55:33.911123 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e10883-93d2-469a-963d-dd4397a91a76 service neutron] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:55:33.911411 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e10883-93d2-469a-963d-dd4397a91a76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:55:33.911698 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e10883-93d2-469a-963d-dd4397a91a76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:55:33.913510 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-44e10883-93d2-469a-963d-dd4397a91a76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:55:33.929577 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e10883-93d2-469a-963d-dd4397a91a76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:55:33.929577 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e10883-93d2-469a-963d-dd4397a91a76 service neutron] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:55:33.935771 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1234/2464] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:55:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:55:35.508070 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7186d8-afdd-4a29-ba3e-81c42d66cbad None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:55:35.508630 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7186d8-afdd-4a29-ba3e-81c42d66cbad None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:55:35.508630 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7186d8-afdd-4a29-ba3e-81c42d66cbad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:55:35.527263 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-6f7186d8-afdd-4a29-ba3e-81c42d66cbad None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:55:35.528616 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-6f7186d8-afdd-4a29-ba3e-81c42d66cbad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:55:35.537236 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1231/2465] 10.222.0.89 () {58 vars in 1016 bytes} [Mon Jul 18 16:55:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:55:35.559216 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e10883-93d2-469a-963d-dd4397a91a76 service neutron] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:55:35.573126 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e10883-93d2-469a-963d-dd4397a91a76 service neutron] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:55:35.578555 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43a8ae6-2363-442a-b432-b93e0ba37905 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07f0c5bf1bee48a0bafdf7a9e4537c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:55:35.579203 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a8ae6-2363-442a-b432-b93e0ba37905 service nova] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:55:35.579483 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a8ae6-2363-442a-b432-b93e0ba37905 service nova] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:55:35.579787 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a8ae6-2363-442a-b432-b93e0ba37905 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:55:35.588275 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43a8ae6-2363-442a-b432-b93e0ba37905 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:55:35.589842 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43a8ae6-2363-442a-b432-b93e0ba37905 service nova] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:55:35.600691 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1235/2466] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:55:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:55:35.678225 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7186d8-afdd-4a29-ba3e-81c42d66cbad None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:55:35.691805 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7186d8-afdd-4a29-ba3e-81c42d66cbad None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:55:35.697388 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b64042a-3ffc-4bb7-97fd-db5ae626f157 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07f0c5bf1bee48a0bafdf7a9e4537c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:55:35.698039 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64042a-3ffc-4bb7-97fd-db5ae626f157 service nova] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:55:35.698509 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64042a-3ffc-4bb7-97fd-db5ae626f157 service nova] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:55:35.698799 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64042a-3ffc-4bb7-97fd-db5ae626f157 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:55:35.700761 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-7b64042a-3ffc-4bb7-97fd-db5ae626f157 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:55:35.713479 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b64042a-3ffc-4bb7-97fd-db5ae626f157 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:55:35.715065 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b64042a-3ffc-4bb7-97fd-db5ae626f157 service nova] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:55:35.726147 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1232/2467] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:55:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 16:55:40.061048 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f5c8c-4880-4f90-9a0e-6885a082990f None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:55:40.061632 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f5c8c-4880-4f90-9a0e-6885a082990f None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:55:40.061632 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f5c8c-4880-4f90-9a0e-6885a082990f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:55:40.079592 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-7f1f5c8c-4880-4f90-9a0e-6885a082990f None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:55:40.080819 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-7f1f5c8c-4880-4f90-9a0e-6885a082990f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:55:40.089169 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1236/2468] 10.222.0.89 () {58 vars in 1016 bytes} [Mon Jul 18 16:55:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:55:40.118988 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b64042a-3ffc-4bb7-97fd-db5ae626f157 service nova] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:55:40.130304 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b64042a-3ffc-4bb7-97fd-db5ae626f157 service nova] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:55:40.135956 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae83562b-b67a-4136-bbd2-2f6f5948b601 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07f0c5bf1bee48a0bafdf7a9e4537c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:55:40.136591 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae83562b-b67a-4136-bbd2-2f6f5948b601 service nova] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:55:40.136865 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae83562b-b67a-4136-bbd2-2f6f5948b601 service nova] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:55:40.137158 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae83562b-b67a-4136-bbd2-2f6f5948b601 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:55:40.146746 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae83562b-b67a-4136-bbd2-2f6f5948b601 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:55:40.148364 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae83562b-b67a-4136-bbd2-2f6f5948b601 service nova] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:55:40.158039 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1233/2469] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:55:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 16:55:43.931916 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d2230-0bfd-4e35-a662-fb84c7d3057b None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:55:43.932459 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d2230-0bfd-4e35-a662-fb84c7d3057b None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:55:43.932459 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d2230-0bfd-4e35-a662-fb84c7d3057b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:55:43.950469 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-c67d2230-0bfd-4e35-a662-fb84c7d3057b None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:55:43.951735 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-c67d2230-0bfd-4e35-a662-fb84c7d3057b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:55:43.960693 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1237/2470] 10.222.0.89 () {58 vars in 1016 bytes} [Mon Jul 18 16:55:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:55:43.982333 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae83562b-b67a-4136-bbd2-2f6f5948b601 service nova] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:55:43.993603 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae83562b-b67a-4136-bbd2-2f6f5948b601 service nova] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:55:43.999212 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d5baf4-16a0-4b41-ae96-d014b19319be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07f0c5bf1bee48a0bafdf7a9e4537c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:55:43.999886 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d5baf4-16a0-4b41-ae96-d014b19319be service nova] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:55:44.000171 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d5baf4-16a0-4b41-ae96-d014b19319be service nova] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:55:44.000451 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d5baf4-16a0-4b41-ae96-d014b19319be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:55:44.009303 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d5baf4-16a0-4b41-ae96-d014b19319be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:55:44.010872 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d5baf4-16a0-4b41-ae96-d014b19319be service nova] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:55:44.021292 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1234/2471] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:55:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:55:48.366109 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bdca53-a952-4ae3-9897-982301cd4699 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:55:48.366538 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bdca53-a952-4ae3-9897-982301cd4699 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:55:48.366704 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bdca53-a952-4ae3-9897-982301cd4699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:55:48.385387 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-d7bdca53-a952-4ae3-9897-982301cd4699 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:55:48.386574 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-d7bdca53-a952-4ae3-9897-982301cd4699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:55:48.395418 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1238/2472] 10.222.0.89 () {58 vars in 1016 bytes} [Mon Jul 18 16:55:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:55:48.422073 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d5baf4-16a0-4b41-ae96-d014b19319be service nova] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:55:48.434509 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d5baf4-16a0-4b41-ae96-d014b19319be service nova] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:55:48.446007 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e5d65d-241f-4ec4-a55f-8bb7bcc29f70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07f0c5bf1bee48a0bafdf7a9e4537c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:55:48.447272 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e5d65d-241f-4ec4-a55f-8bb7bcc29f70 service nova] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:55:48.447636 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e5d65d-241f-4ec4-a55f-8bb7bcc29f70 service nova] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:55:48.448083 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e5d65d-241f-4ec4-a55f-8bb7bcc29f70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:55:48.458367 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e5d65d-241f-4ec4-a55f-8bb7bcc29f70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:55:48.460021 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e5d65d-241f-4ec4-a55f-8bb7bcc29f70 service nova] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:55:48.470653 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1235/2473] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:55:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:55:53.651877 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6788b8-e75b-498a-989a-6bffd95bc7c1 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:55:53.652425 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6788b8-e75b-498a-989a-6bffd95bc7c1 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:55:53.652425 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6788b8-e75b-498a-989a-6bffd95bc7c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:55:53.671086 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-af6788b8-e75b-498a-989a-6bffd95bc7c1 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:55:53.672323 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-af6788b8-e75b-498a-989a-6bffd95bc7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:55:53.680842 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1239/2474] 10.222.0.89 () {58 vars in 1016 bytes} [Mon Jul 18 16:55:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:55:53.703706 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e5d65d-241f-4ec4-a55f-8bb7bcc29f70 service nova] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:55:53.715958 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e5d65d-241f-4ec4-a55f-8bb7bcc29f70 service nova] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:55:53.722407 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b90d16d-924f-4a6b-a48f-d5370b32cb01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07f0c5bf1bee48a0bafdf7a9e4537c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:55:53.722819 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90d16d-924f-4a6b-a48f-d5370b32cb01 service nova] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:55:53.722940 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90d16d-924f-4a6b-a48f-d5370b32cb01 service nova] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:55:53.723180 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90d16d-924f-4a6b-a48f-d5370b32cb01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:55:53.731776 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b90d16d-924f-4a6b-a48f-d5370b32cb01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:55:53.733368 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b90d16d-924f-4a6b-a48f-d5370b32cb01 service nova] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:55:53.743496 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1236/2475] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:55:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:55:55.432752 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6788b8-e75b-498a-989a-6bffd95bc7c1 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:55:55.445548 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6788b8-e75b-498a-989a-6bffd95bc7c1 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:55:55.451027 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece66f6-6369-4123-89a1-d31c1fc4a2e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07f0c5bf1bee48a0bafdf7a9e4537c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:55:55.451666 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece66f6-6369-4123-89a1-d31c1fc4a2e4 service nova] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:55:55.451991 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece66f6-6369-4123-89a1-d31c1fc4a2e4 service nova] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:55:55.452270 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece66f6-6369-4123-89a1-d31c1fc4a2e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:55:55.454032 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-2ece66f6-6369-4123-89a1-d31c1fc4a2e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:55:55.514107 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ece66f6-6369-4123-89a1-d31c1fc4a2e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:55:55.515745 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ece66f6-6369-4123-89a1-d31c1fc4a2e4 service nova] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:55:55.525456 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1240/2476] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:55:55 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:56:03.739297 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=36 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:56:05.521147 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=52 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:56:12.232173 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dbb938-1d3d-4ab2-be76-d8451c3d6c4f None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:56:12.232698 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dbb938-1d3d-4ab2-be76-d8451c3d6c4f None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:56:12.232698 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dbb938-1d3d-4ab2-be76-d8451c3d6c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:56:12.249748 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-03dbb938-1d3d-4ab2-be76-d8451c3d6c4f None None] MFA Rules not processed for user `27015a61b08249388e22187e1e56c057`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:56:12.250940 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-03dbb938-1d3d-4ab2-be76-d8451c3d6c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:56:12.261849 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1237/2477] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:56:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:56:12.562472 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece66f6-6369-4123-89a1-d31c1fc4a2e4 service nova] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:56:12.572371 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece66f6-6369-4123-89a1-d31c1fc4a2e4 service nova] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:56:12.575903 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56b5986-8e93-4620-9255-3f7b40e844d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:56:12.576534 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b5986-8e93-4620-9255-3f7b40e844d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:56:12.576810 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b5986-8e93-4620-9255-3f7b40e844d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:56:12.577081 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b5986-8e93-4620-9255-3f7b40e844d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:56:12.578829 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-b56b5986-8e93-4620-9255-3f7b40e844d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:56:12.588176 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56b5986-8e93-4620-9255-3f7b40e844d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:56:12.589562 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56b5986-8e93-4620-9255-3f7b40e844d1 service neutron] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:56:12.597384 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1241/2478] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:56:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:56:12.996795 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dbb938-1d3d-4ab2-be76-d8451c3d6c4f None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:56:12.998268 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-03dbb938-1d3d-4ab2-be76-d8451c3d6c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:56:13.078872 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dbb938-1d3d-4ab2-be76-d8451c3d6c4f None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:56:13.085633 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d2b75-d1ca-41d7-913f-dd4f99decfdc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700ad7df774415b89737c7dddcc5b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:56:13.086551 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d2b75-d1ca-41d7-913f-dd4f99decfdc service placement] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:56:13.086755 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d2b75-d1ca-41d7-913f-dd4f99decfdc service placement] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:56:13.087129 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d2b75-d1ca-41d7-913f-dd4f99decfdc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:56:13.088965 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-233d2b75-d1ca-41d7-913f-dd4f99decfdc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:56:13.101443 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d2b75-d1ca-41d7-913f-dd4f99decfdc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:56:13.103028 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d2b75-d1ca-41d7-913f-dd4f99decfdc service placement] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:56:13.113619 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1238/2479] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:56:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:56:15.282007 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56b5986-8e93-4620-9255-3f7b40e844d1 service neutron] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:56:15.301356 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56b5986-8e93-4620-9255-3f7b40e844d1 service neutron] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:56:15.321423 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d4fe8-825f-4992-bf91-cff999c17f7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07f0c5bf1bee48a0bafdf7a9e4537c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:56:15.322474 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d4fe8-825f-4992-bf91-cff999c17f7c service nova] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:56:15.322964 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d4fe8-825f-4992-bf91-cff999c17f7c service nova] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:56:15.323455 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d4fe8-825f-4992-bf91-cff999c17f7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:56:15.328837 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-a04d4fe8-825f-4992-bf91-cff999c17f7c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:56:15.347396 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04d4fe8-825f-4992-bf91-cff999c17f7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:56:15.350003 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04d4fe8-825f-4992-bf91-cff999c17f7c service nova] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:56:15.374946 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1242/2480] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:56:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:56:23.109234 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=35 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:56:25.357647 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=12 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:56:26.417349 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d2b75-d1ca-41d7-913f-dd4f99decfdc service placement] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:56:26.429576 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d2b75-d1ca-41d7-913f-dd4f99decfdc service placement] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:56:26.434969 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f656cd-17f4-4922-80ec-ed6c109be713 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07f0c5bf1bee48a0bafdf7a9e4537c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:56:26.435858 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f656cd-17f4-4922-80ec-ed6c109be713 service nova] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:56:26.436141 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f656cd-17f4-4922-80ec-ed6c109be713 service nova] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:56:26.436495 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f656cd-17f4-4922-80ec-ed6c109be713 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:56:26.438202 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-d8f656cd-17f4-4922-80ec-ed6c109be713 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:56:26.451381 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f656cd-17f4-4922-80ec-ed6c109be713 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:56:26.453010 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f656cd-17f4-4922-80ec-ed6c109be713 service nova] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:56:26.464915 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1239/2481] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:56:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:56:27.418863 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9798cb5e-25d0-40da-b5d9-661cbefabbca None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:56:27.418863 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9798cb5e-25d0-40da-b5d9-661cbefabbca None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:56:27.418863 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9798cb5e-25d0-40da-b5d9-661cbefabbca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:56:27.436879 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-9798cb5e-25d0-40da-b5d9-661cbefabbca None None] MFA Rules not processed for user `ea2a096c4b964f03aed533d1e5e96db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:56:27.438113 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-9798cb5e-25d0-40da-b5d9-661cbefabbca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:56:27.445285 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1243/2482] 10.222.0.81 () {58 vars in 967 bytes} [Mon Jul 18 16:56:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:56:27.605426 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f656cd-17f4-4922-80ec-ed6c109be713 service nova] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:56:27.623264 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f656cd-17f4-4922-80ec-ed6c109be713 service nova] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:56:27.629437 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305aef47-2fd7-4cd4-9e82-6cd2e98e1f1e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251475c53ac64cd48ae84567d8c2ee87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:56:27.630329 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305aef47-2fd7-4cd4-9e82-6cd2e98e1f1e service swift] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:56:27.631177 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305aef47-2fd7-4cd4-9e82-6cd2e98e1f1e service swift] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:56:27.631456 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305aef47-2fd7-4cd4-9e82-6cd2e98e1f1e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:56:27.641117 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305aef47-2fd7-4cd4-9e82-6cd2e98e1f1e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:56:27.642691 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305aef47-2fd7-4cd4-9e82-6cd2e98e1f1e service swift] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:56:27.651350 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1240/2483] 10.222.0.81 () {60 vars in 1384 bytes} [Mon Jul 18 16:56:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 16:56:28.974789 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9798cb5e-25d0-40da-b5d9-661cbefabbca None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:56:28.984585 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9798cb5e-25d0-40da-b5d9-661cbefabbca None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:56:28.988175 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3daab-aefe-4ab9-9ff9-8fb1be42207e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:56:28.988823 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3daab-aefe-4ab9-9ff9-8fb1be42207e service neutron] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:56:28.989107 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3daab-aefe-4ab9-9ff9-8fb1be42207e service neutron] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:56:28.989383 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3daab-aefe-4ab9-9ff9-8fb1be42207e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:56:28.991783 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-feb3daab-aefe-4ab9-9ff9-8fb1be42207e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:56:29.004242 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb3daab-aefe-4ab9-9ff9-8fb1be42207e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:56:29.006493 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb3daab-aefe-4ab9-9ff9-8fb1be42207e service neutron] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:56:29.016351 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1244/2484] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:56:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:56:36.077636 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305aef47-2fd7-4cd4-9e82-6cd2e98e1f1e service swift] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:56:36.079114 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-305aef47-2fd7-4cd4-9e82-6cd2e98e1f1e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:56:36.099574 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305aef47-2fd7-4cd4-9e82-6cd2e98e1f1e service swift] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:56:36.099574 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a931e07f-4c85-4131-b2d8-3dd54b226d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:56:36.099574 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a931e07f-4c85-4131-b2d8-3dd54b226d32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:56:36.099574 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a931e07f-4c85-4131-b2d8-3dd54b226d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:56:36.100338 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a931e07f-4c85-4131-b2d8-3dd54b226d32 admin admin] PATH_INFO: `/v3/users/1243241885654b7283cc678febc40c41` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:56:36.101582 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a931e07f-4c85-4131-b2d8-3dd54b226d32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1243241885654b7283cc678febc40c41)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:56:36.103536 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a931e07f-4c85-4131-b2d8-3dd54b226d32 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:56:36.319235 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-a931e07f-4c85-4131-b2d8-3dd54b226d32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1243241885654b7283cc678febc40c41'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:56:36.319833 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-a931e07f-4c85-4131-b2d8-3dd54b226d32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1243241885654b7283cc678febc40c41'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:56:36.331827 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-a931e07f-4c85-4131-b2d8-3dd54b226d32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1243241885654b7283cc678febc40c41'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:56:36.423795 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-a931e07f-4c85-4131-b2d8-3dd54b226d32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1243241885654b7283cc678febc40c41'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:56:36.433565 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-a931e07f-4c85-4131-b2d8-3dd54b226d32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1243241885654b7283cc678febc40c41'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:56:36.440561 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1241/2485] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 16:56:36 2022] DELETE /identity/v3/users/1243241885654b7283cc678febc40c41 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:56:36.769917 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3daab-aefe-4ab9-9ff9-8fb1be42207e service neutron] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:56:36.782448 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3daab-aefe-4ab9-9ff9-8fb1be42207e service neutron] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:56:36.854688 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff386a6-c70f-4f7d-abd5-db8857937816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:56:36.855920 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff386a6-c70f-4f7d-abd5-db8857937816 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:56:36.856361 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff386a6-c70f-4f7d-abd5-db8857937816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:56:36.856797 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff386a6-c70f-4f7d-abd5-db8857937816 admin admin] PATH_INFO: `/v3/projects/a013a342f25846be913682d2f925ca01` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:56:36.859299 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff386a6-c70f-4f7d-abd5-db8857937816 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a013a342f25846be913682d2f925ca01)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:56:36.861814 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff386a6-c70f-4f7d-abd5-db8857937816 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:56:37.014541 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-dff386a6-c70f-4f7d-abd5-db8857937816 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a013a342f25846be913682d2f925ca01', 'request_id': 'req-dff386a6-c70f-4f7d-abd5-db8857937816'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:56:37.021893 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-dff386a6-c70f-4f7d-abd5-db8857937816 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a013a342f25846be913682d2f925ca01', 'request_id': 'req-dff386a6-c70f-4f7d-abd5-db8857937816'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:56:37.029101 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-dff386a6-c70f-4f7d-abd5-db8857937816 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a013a342f25846be913682d2f925ca01', 'request_id': 'req-dff386a6-c70f-4f7d-abd5-db8857937816'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:56:37.128535 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-dff386a6-c70f-4f7d-abd5-db8857937816 admin admin] The token cache is being invalidate because project a013a342f25846be913682d2f925ca01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:56:37.128830 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-dff386a6-c70f-4f7d-abd5-db8857937816 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:56:37.130817 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-dff386a6-c70f-4f7d-abd5-db8857937816 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:56:37.131578 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1245/2486] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 16:56:36 2022] DELETE /identity/v3/projects/a013a342f25846be913682d2f925ca01 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:56:37.553174 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a931e07f-4c85-4131-b2d8-3dd54b226d32 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:56:37.554633 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-a931e07f-4c85-4131-b2d8-3dd54b226d32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:56:37.569057 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a931e07f-4c85-4131-b2d8-3dd54b226d32 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:56:37.624346 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1353cfed-52e2-43ad-9a90-f0b9f7309966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:56:37.625127 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1353cfed-52e2-43ad-9a90-f0b9f7309966 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:56:37.625405 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1353cfed-52e2-43ad-9a90-f0b9f7309966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:56:37.625674 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1353cfed-52e2-43ad-9a90-f0b9f7309966 admin admin] PATH_INFO: `/v3/users/ee0824c301ef4dfd89cbf51e9c36a913` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:56:37.626837 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1353cfed-52e2-43ad-9a90-f0b9f7309966 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee0824c301ef4dfd89cbf51e9c36a913)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:56:37.628813 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1353cfed-52e2-43ad-9a90-f0b9f7309966 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:56:37.838721 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-1353cfed-52e2-43ad-9a90-f0b9f7309966 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee0824c301ef4dfd89cbf51e9c36a913'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:56:37.839774 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-1353cfed-52e2-43ad-9a90-f0b9f7309966 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee0824c301ef4dfd89cbf51e9c36a913'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:56:37.840712 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:56:37.852946 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-1353cfed-52e2-43ad-9a90-f0b9f7309966 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee0824c301ef4dfd89cbf51e9c36a913'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:56:37.914996 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-1353cfed-52e2-43ad-9a90-f0b9f7309966 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee0824c301ef4dfd89cbf51e9c36a913'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:56:37.922156 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-1353cfed-52e2-43ad-9a90-f0b9f7309966 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee0824c301ef4dfd89cbf51e9c36a913'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:56:37.928499 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1242/2487] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 16:56:37 2022] DELETE /identity/v3/users/ee0824c301ef4dfd89cbf51e9c36a913 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:56:38.209938 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff386a6-c70f-4f7d-abd5-db8857937816 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:56:38.211394 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-dff386a6-c70f-4f7d-abd5-db8857937816 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:56:38.224634 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff386a6-c70f-4f7d-abd5-db8857937816 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:56:38.283802 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b898f6-27c4-491a-8dc0-6c06288a34bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:56:38.284670 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b898f6-27c4-491a-8dc0-6c06288a34bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:56:38.285082 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b898f6-27c4-491a-8dc0-6c06288a34bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:56:38.285294 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b898f6-27c4-491a-8dc0-6c06288a34bf admin admin] PATH_INFO: `/v3/projects/3c2271562d6a4232bb3dc6ed9bc33bde` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:56:38.286599 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b898f6-27c4-491a-8dc0-6c06288a34bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c2271562d6a4232bb3dc6ed9bc33bde)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:56:38.288543 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b898f6-27c4-491a-8dc0-6c06288a34bf admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:56:38.300561 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:56:38.414039 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-a1b898f6-27c4-491a-8dc0-6c06288a34bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c2271562d6a4232bb3dc6ed9bc33bde', 'request_id': 'req-a1b898f6-27c4-491a-8dc0-6c06288a34bf'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:56:38.419429 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-a1b898f6-27c4-491a-8dc0-6c06288a34bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c2271562d6a4232bb3dc6ed9bc33bde', 'request_id': 'req-a1b898f6-27c4-491a-8dc0-6c06288a34bf'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:56:38.425970 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-a1b898f6-27c4-491a-8dc0-6c06288a34bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c2271562d6a4232bb3dc6ed9bc33bde', 'request_id': 'req-a1b898f6-27c4-491a-8dc0-6c06288a34bf'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:56:38.504828 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-a1b898f6-27c4-491a-8dc0-6c06288a34bf admin admin] The token cache is being invalidate because project 3c2271562d6a4232bb3dc6ed9bc33bde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:56:38.505370 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-a1b898f6-27c4-491a-8dc0-6c06288a34bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:56:38.505996 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-a1b898f6-27c4-491a-8dc0-6c06288a34bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:56:38.507822 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1246/2488] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 16:56:38 2022] DELETE /identity/v3/projects/3c2271562d6a4232bb3dc6ed9bc33bde => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:56:38.511550 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1353cfed-52e2-43ad-9a90-f0b9f7309966 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:56:38.513044 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-1353cfed-52e2-43ad-9a90-f0b9f7309966 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:56:38.526165 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1353cfed-52e2-43ad-9a90-f0b9f7309966 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:56:38.582595 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1b88d8-109a-4323-b756-eca3b5028dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:56:38.583470 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b88d8-109a-4323-b756-eca3b5028dc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:56:38.583783 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b88d8-109a-4323-b756-eca3b5028dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:56:38.584061 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b88d8-109a-4323-b756-eca3b5028dc7 admin admin] PATH_INFO: `/v3/users/47beed36a8644c5f80186734ab3fd865` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:56:38.585242 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1b88d8-109a-4323-b756-eca3b5028dc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47beed36a8644c5f80186734ab3fd865)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:56:38.587162 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1b88d8-109a-4323-b756-eca3b5028dc7 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:56:38.850977 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-fc1b88d8-109a-4323-b756-eca3b5028dc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47beed36a8644c5f80186734ab3fd865'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:56:38.851659 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-fc1b88d8-109a-4323-b756-eca3b5028dc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47beed36a8644c5f80186734ab3fd865'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:56:38.863688 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-fc1b88d8-109a-4323-b756-eca3b5028dc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47beed36a8644c5f80186734ab3fd865'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:56:38.945041 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-fc1b88d8-109a-4323-b756-eca3b5028dc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47beed36a8644c5f80186734ab3fd865'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:56:38.952891 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-fc1b88d8-109a-4323-b756-eca3b5028dc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47beed36a8644c5f80186734ab3fd865'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:56:38.959535 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1243/2489] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 16:56:38 2022] DELETE /identity/v3/users/47beed36a8644c5f80186734ab3fd865 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:56:39.220825 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b898f6-27c4-491a-8dc0-6c06288a34bf admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:56:39.222392 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-a1b898f6-27c4-491a-8dc0-6c06288a34bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:56:39.236853 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b898f6-27c4-491a-8dc0-6c06288a34bf admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:56:39.294693 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a9618e-6cac-4150-a993-3a012b275166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:56:39.295552 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9618e-6cac-4150-a993-3a012b275166 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:56:39.295870 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9618e-6cac-4150-a993-3a012b275166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:56:39.296149 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9618e-6cac-4150-a993-3a012b275166 admin admin] PATH_INFO: `/v3/projects/e96690eabf4c4ea887e866541d6d4f50` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:56:39.297333 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a9618e-6cac-4150-a993-3a012b275166 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e96690eabf4c4ea887e866541d6d4f50)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:56:39.299378 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a9618e-6cac-4150-a993-3a012b275166 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:56:39.392329 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-d2a9618e-6cac-4150-a993-3a012b275166 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e96690eabf4c4ea887e866541d6d4f50', 'request_id': 'req-d2a9618e-6cac-4150-a993-3a012b275166'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:56:39.398600 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-d2a9618e-6cac-4150-a993-3a012b275166 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e96690eabf4c4ea887e866541d6d4f50', 'request_id': 'req-d2a9618e-6cac-4150-a993-3a012b275166'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:56:39.405103 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-d2a9618e-6cac-4150-a993-3a012b275166 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e96690eabf4c4ea887e866541d6d4f50', 'request_id': 'req-d2a9618e-6cac-4150-a993-3a012b275166'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:56:39.465461 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-d2a9618e-6cac-4150-a993-3a012b275166 admin admin] The token cache is being invalidate because project e96690eabf4c4ea887e866541d6d4f50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:56:39.465734 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-d2a9618e-6cac-4150-a993-3a012b275166 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:56:39.466813 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-d2a9618e-6cac-4150-a993-3a012b275166 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:56:39.468406 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1247/2490] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 16:56:39 2022] DELETE /identity/v3/projects/e96690eabf4c4ea887e866541d6d4f50 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:56:48.955313 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=65,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:56:49.462025 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=70,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:57:02.328852 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb5212b-46ae-4c5a-abd7-36fb69399abf None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:57:02.329400 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb5212b-46ae-4c5a-abd7-36fb69399abf None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:57:02.329506 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb5212b-46ae-4c5a-abd7-36fb69399abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:57:02.348234 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-bdb5212b-46ae-4c5a-abd7-36fb69399abf None None] MFA Rules not processed for user `512342c273bb4299ad5fc29e69b5aeb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:57:02.349452 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-bdb5212b-46ae-4c5a-abd7-36fb69399abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:57:02.406195 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1244/2491] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:57:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:57:02.545837 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a9618e-6cac-4150-a993-3a012b275166 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:57:02.547412 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-d2a9618e-6cac-4150-a993-3a012b275166 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:57:02.606039 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a9618e-6cac-4150-a993-3a012b275166 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:57:02.609699 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5b1a64-f731-44a0-9b16-8b7ea21e6cd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:57:02.610343 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b1a64-f731-44a0-9b16-8b7ea21e6cd1 service neutron] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:57:02.610626 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b1a64-f731-44a0-9b16-8b7ea21e6cd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:57:02.610906 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b1a64-f731-44a0-9b16-8b7ea21e6cd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:57:02.612837 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-0b5b1a64-f731-44a0-9b16-8b7ea21e6cd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:57:02.681301 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5b1a64-f731-44a0-9b16-8b7ea21e6cd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:57:02.682732 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5b1a64-f731-44a0-9b16-8b7ea21e6cd1 service neutron] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:57:02.693243 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1248/2492] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:57:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:57:02.724307 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb5212b-46ae-4c5a-abd7-36fb69399abf None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:57:02.726768 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-bdb5212b-46ae-4c5a-abd7-36fb69399abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:57:02.738778 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb5212b-46ae-4c5a-abd7-36fb69399abf None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:57:02.742316 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549328dd-6d61-4c07-abe4-a8e1c3dec9c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:57:02.742947 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549328dd-6d61-4c07-abe4-a8e1c3dec9c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:57:02.743312 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549328dd-6d61-4c07-abe4-a8e1c3dec9c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:57:02.743607 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549328dd-6d61-4c07-abe4-a8e1c3dec9c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:57:02.745440 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-549328dd-6d61-4c07-abe4-a8e1c3dec9c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:57:02.755688 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549328dd-6d61-4c07-abe4-a8e1c3dec9c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:57:02.757132 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549328dd-6d61-4c07-abe4-a8e1c3dec9c6 service neutron] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:57:02.765791 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1245/2493] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:57:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:57:06.390181 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5b1a64-f731-44a0-9b16-8b7ea21e6cd1 service neutron] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:57:06.390181 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-0b5b1a64-f731-44a0-9b16-8b7ea21e6cd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:57:06.458872 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5b1a64-f731-44a0-9b16-8b7ea21e6cd1 service neutron] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:57:06.465562 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd149c41-8780-459a-9ba5-0e9c059c1833 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700ad7df774415b89737c7dddcc5b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:57:06.465562 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd149c41-8780-459a-9ba5-0e9c059c1833 service placement] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:57:06.465562 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd149c41-8780-459a-9ba5-0e9c059c1833 service placement] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:57:06.466551 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd149c41-8780-459a-9ba5-0e9c059c1833 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:57:06.467536 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-cd149c41-8780-459a-9ba5-0e9c059c1833 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:57:06.480769 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd149c41-8780-459a-9ba5-0e9c059c1833 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:57:06.482370 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd149c41-8780-459a-9ba5-0e9c059c1833 service placement] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:57:06.494091 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1249/2494] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:57:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:57:06.526302 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549328dd-6d61-4c07-abe4-a8e1c3dec9c6 service neutron] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:57:06.532880 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-549328dd-6d61-4c07-abe4-a8e1c3dec9c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:57:06.552637 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549328dd-6d61-4c07-abe4-a8e1c3dec9c6 service neutron] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:57:06.561157 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60983b59-6bca-43eb-a978-023af795d21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:57:06.562044 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60983b59-6bca-43eb-a978-023af795d21c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:57:06.562326 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60983b59-6bca-43eb-a978-023af795d21c admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:57:06.562603 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60983b59-6bca-43eb-a978-023af795d21c admin admin] PATH_INFO: `/v3/users/0f292cde7f7142f08e961a3d20d76b31` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:57:06.564033 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60983b59-6bca-43eb-a978-023af795d21c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f292cde7f7142f08e961a3d20d76b31)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:57:06.566049 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60983b59-6bca-43eb-a978-023af795d21c admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:57:06.804591 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-60983b59-6bca-43eb-a978-023af795d21c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f292cde7f7142f08e961a3d20d76b31'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:57:06.805258 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-60983b59-6bca-43eb-a978-023af795d21c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f292cde7f7142f08e961a3d20d76b31'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:57:06.818684 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-60983b59-6bca-43eb-a978-023af795d21c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f292cde7f7142f08e961a3d20d76b31'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:57:06.991418 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-60983b59-6bca-43eb-a978-023af795d21c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f292cde7f7142f08e961a3d20d76b31'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:57:06.998980 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-60983b59-6bca-43eb-a978-023af795d21c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f292cde7f7142f08e961a3d20d76b31'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:57:07.005552 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1246/2495] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 16:57:06 2022] DELETE /identity/v3/users/0f292cde7f7142f08e961a3d20d76b31 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:57:07.261120 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd149c41-8780-459a-9ba5-0e9c059c1833 service placement] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:57:07.277615 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd149c41-8780-459a-9ba5-0e9c059c1833 service placement] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:57:07.337647 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=100 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:57:07.357453 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fec3d92-41e5-4b3f-a6fb-70c056db1833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:57:07.358439 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec3d92-41e5-4b3f-a6fb-70c056db1833 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:57:07.358826 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec3d92-41e5-4b3f-a6fb-70c056db1833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:57:07.359185 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec3d92-41e5-4b3f-a6fb-70c056db1833 admin admin] PATH_INFO: `/v3/projects/5882975bac7244929b452349e972fa9d` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:57:07.360622 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fec3d92-41e5-4b3f-a6fb-70c056db1833 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5882975bac7244929b452349e972fa9d)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:57:07.362740 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fec3d92-41e5-4b3f-a6fb-70c056db1833 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:57:07.512548 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-9fec3d92-41e5-4b3f-a6fb-70c056db1833 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5882975bac7244929b452349e972fa9d', 'request_id': 'req-9fec3d92-41e5-4b3f-a6fb-70c056db1833'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:57:07.518092 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-9fec3d92-41e5-4b3f-a6fb-70c056db1833 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5882975bac7244929b452349e972fa9d', 'request_id': 'req-9fec3d92-41e5-4b3f-a6fb-70c056db1833'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:57:07.524780 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-9fec3d92-41e5-4b3f-a6fb-70c056db1833 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5882975bac7244929b452349e972fa9d', 'request_id': 'req-9fec3d92-41e5-4b3f-a6fb-70c056db1833'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:57:07.630162 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-9fec3d92-41e5-4b3f-a6fb-70c056db1833 admin admin] The token cache is being invalidate because project 5882975bac7244929b452349e972fa9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:57:07.630714 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-9fec3d92-41e5-4b3f-a6fb-70c056db1833 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:57:07.631380 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-9fec3d92-41e5-4b3f-a6fb-70c056db1833 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:57:07.632984 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1250/2496] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 16:57:07 2022] DELETE /identity/v3/projects/5882975bac7244929b452349e972fa9d => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:57:07.639422 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45bceb8-0d62-4823-b538-89ba1d4492bf None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:57:07.639984 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45bceb8-0d62-4823-b538-89ba1d4492bf None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:57:07.640175 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45bceb8-0d62-4823-b538-89ba1d4492bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:57:07.658961 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-c45bceb8-0d62-4823-b538-89ba1d4492bf None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:57:07.660232 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-c45bceb8-0d62-4823-b538-89ba1d4492bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:57:07.737725 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1247/2497] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:57:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:57:07.739596 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491c112-25d9-4abc-afb3-20f96861831e None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:57:07.740077 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491c112-25d9-4abc-afb3-20f96861831e None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:57:07.740990 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491c112-25d9-4abc-afb3-20f96861831e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:57:07.761611 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-6491c112-25d9-4abc-afb3-20f96861831e None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:57:07.762900 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-6491c112-25d9-4abc-afb3-20f96861831e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:57:07.774543 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1251/2498] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:57:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:57:07.782427 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45bceb8-0d62-4823-b538-89ba1d4492bf None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:57:07.784566 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:57:07.790369 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45bceb8-0d62-4823-b538-89ba1d4492bf None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:57:07.795501 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e9cc3-ae69-4ba2-b5e7-6fa66783d1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:57:07.796214 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e9cc3-ae69-4ba2-b5e7-6fa66783d1da admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:57:07.796498 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e9cc3-ae69-4ba2-b5e7-6fa66783d1da admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:57:07.796779 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e9cc3-ae69-4ba2-b5e7-6fa66783d1da admin admin] PATH_INFO: `/v3/domains` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:57:07.809620 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121e9cc3-ae69-4ba2-b5e7-6fa66783d1da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:57:07.810118 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121e9cc3-ae69-4ba2-b5e7-6fa66783d1da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:57:07.813168 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121e9cc3-ae69-4ba2-b5e7-6fa66783d1da admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:57:07.835333 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1248/2499] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Jul 18 16:57:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:57:07.836286 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6491c112-25d9-4abc-afb3-20f96861831e None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:57:07.853658 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6491c112-25d9-4abc-afb3-20f96861831e None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:57:07.861010 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b181f7-7200-4e56-9381-fcd9a2edfca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:57:07.862680 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b181f7-7200-4e56-9381-fcd9a2edfca1 admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:57:07.862972 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b181f7-7200-4e56-9381-fcd9a2edfca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:57:07.863254 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b181f7-7200-4e56-9381-fcd9a2edfca1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:57:07.864009 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b181f7-7200-4e56-9381-fcd9a2edfca1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:57:07.869851 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b181f7-7200-4e56-9381-fcd9a2edfca1 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:57:08.055740 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1252/2500] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:57:07 2022] POST /identity/v3/projects => generated 385 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:57:08.059929 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e9cc3-ae69-4ba2-b5e7-6fa66783d1da admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:57:08.069952 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e9cc3-ae69-4ba2-b5e7-6fa66783d1da admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:57:08.140026 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16104364-8986-499e-b9ed-c9b1d04717ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:57:08.140853 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16104364-8986-499e-b9ed-c9b1d04717ee admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:57:08.140965 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16104364-8986-499e-b9ed-c9b1d04717ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:57:08.141244 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16104364-8986-499e-b9ed-c9b1d04717ee admin admin] PATH_INFO: `/v3/users` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:57:08.141951 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16104364-8986-499e-b9ed-c9b1d04717ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:57:08.143918 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16104364-8986-499e-b9ed-c9b1d04717ee admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:57:08.230071 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1249/2501] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 16:57:08 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:57:08.234167 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b181f7-7200-4e56-9381-fcd9a2edfca1 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:57:08.244635 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b181f7-7200-4e56-9381-fcd9a2edfca1 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:57:08.249391 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158ef398-939a-43fb-a158-b22e09a182ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:57:08.250054 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ef398-939a-43fb-a158-b22e09a182ce admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:57:08.250394 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ef398-939a-43fb-a158-b22e09a182ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:57:08.250671 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ef398-939a-43fb-a158-b22e09a182ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:57:08.251398 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158ef398-939a-43fb-a158-b22e09a182ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:57:08.253099 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158ef398-939a-43fb-a158-b22e09a182ce admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:57:08.264564 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1253/2502] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:57:08.268943 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16104364-8986-499e-b9ed-c9b1d04717ee admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:57:08.279828 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16104364-8986-499e-b9ed-c9b1d04717ee admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:57:08.284568 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b7a93c-f607-41bd-9d78-602010d1d421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:57:08.285306 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7a93c-f607-41bd-9d78-602010d1d421 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:57:08.285660 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7a93c-f607-41bd-9d78-602010d1d421 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:57:08.286030 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7a93c-f607-41bd-9d78-602010d1d421 admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:57:08.286819 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b7a93c-f607-41bd-9d78-602010d1d421 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:57:08.289022 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b7a93c-f607-41bd-9d78-602010d1d421 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:57:08.302710 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1250/2503] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:57:08.303902 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158ef398-939a-43fb-a158-b22e09a182ce admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:57:08.314191 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158ef398-939a-43fb-a158-b22e09a182ce admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:57:08.319499 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10774c8-5ace-4dbb-9a7b-e04b6dd3ac21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:57:08.320428 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10774c8-5ace-4dbb-9a7b-e04b6dd3ac21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:57:08.320704 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10774c8-5ace-4dbb-9a7b-e04b6dd3ac21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:57:08.320974 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10774c8-5ace-4dbb-9a7b-e04b6dd3ac21 admin admin] PATH_INFO: `/v3/projects/372a083dcdbe4b6996689ddf25e46c0d/users/1d601d9805b840e0b9f5f998b6e7327d/roles/ad3a2bc7b2094a4da1a95a143c8d9436` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:57:08.340932 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10774c8-5ace-4dbb-9a7b-e04b6dd3ac21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=372a083dcdbe4b6996689ddf25e46c0d, user_id=1d601d9805b840e0b9f5f998b6e7327d, role_id=ad3a2bc7b2094a4da1a95a143c8d9436)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:57:08.343626 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10774c8-5ace-4dbb-9a7b-e04b6dd3ac21 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:57:08.460067 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1254/2504] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:57:08 2022] PUT /identity/v3/projects/372a083dcdbe4b6996689ddf25e46c0d/users/1d601d9805b840e0b9f5f998b6e7327d/roles/ad3a2bc7b2094a4da1a95a143c8d9436 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:57:08.465544 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f5dcb-9329-452d-b3ea-103119850743 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:57:08.466065 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f5dcb-9329-452d-b3ea-103119850743 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:57:08.466348 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f5dcb-9329-452d-b3ea-103119850743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:57:08.506375 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-d03f5dcb-9329-452d-b3ea-103119850743 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:57:08.507815 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-d03f5dcb-9329-452d-b3ea-103119850743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:57:08.569606 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1251/2505] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:57:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:57:08.579190 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10774c8-5ace-4dbb-9a7b-e04b6dd3ac21 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:57:08.581057 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-b10774c8-5ace-4dbb-9a7b-e04b6dd3ac21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:57:08.640560 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10774c8-5ace-4dbb-9a7b-e04b6dd3ac21 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:57:08.644230 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13e79d-6cc9-45bc-a0e2-fb76ae068e07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:57:08.644883 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13e79d-6cc9-45bc-a0e2-fb76ae068e07 service neutron] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:57:08.645160 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13e79d-6cc9-45bc-a0e2-fb76ae068e07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:57:08.645434 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13e79d-6cc9-45bc-a0e2-fb76ae068e07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:57:08.655355 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f13e79d-6cc9-45bc-a0e2-fb76ae068e07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:57:08.656886 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f13e79d-6cc9-45bc-a0e2-fb76ae068e07 service neutron] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:57:08.666498 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1255/2506] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:57:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:57:14.344191 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da81663c-caa6-48c0-9e95-b226e2ddc788 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:57:14.344651 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da81663c-caa6-48c0-9e95-b226e2ddc788 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:57:14.344960 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da81663c-caa6-48c0-9e95-b226e2ddc788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:57:14.373845 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-da81663c-caa6-48c0-9e95-b226e2ddc788 None None] MFA Rules not processed for user `1d601d9805b840e0b9f5f998b6e7327d`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:57:14.375184 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-da81663c-caa6-48c0-9e95-b226e2ddc788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:57:14.452255 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:57:14.456292 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1252/2507] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:57:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:57:14.472622 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13e79d-6cc9-45bc-a0e2-fb76ae068e07 service neutron] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:57:14.474086 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-1f13e79d-6cc9-45bc-a0e2-fb76ae068e07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:57:14.485452 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:57:14.561843 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13e79d-6cc9-45bc-a0e2-fb76ae068e07 service neutron] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:57:14.569017 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d374b9-8acf-4aa6-907c-b6502a1efebe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07f0c5bf1bee48a0bafdf7a9e4537c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:57:14.569720 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d374b9-8acf-4aa6-907c-b6502a1efebe service nova] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:57:14.570006 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d374b9-8acf-4aa6-907c-b6502a1efebe service nova] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:57:14.570282 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d374b9-8acf-4aa6-907c-b6502a1efebe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:57:14.579053 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d374b9-8acf-4aa6-907c-b6502a1efebe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:57:14.580706 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d374b9-8acf-4aa6-907c-b6502a1efebe service nova] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:57:14.591316 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1256/2508] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:57:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:57:17.332669 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53308f1e-f694-4a4b-aeb9-d0c44bb1de84 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:57:17.333144 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53308f1e-f694-4a4b-aeb9-d0c44bb1de84 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:57:17.333144 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53308f1e-f694-4a4b-aeb9-d0c44bb1de84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:57:17.351927 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-53308f1e-f694-4a4b-aeb9-d0c44bb1de84 None None] MFA Rules not processed for user `1d601d9805b840e0b9f5f998b6e7327d`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:57:17.353149 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-53308f1e-f694-4a4b-aeb9-d0c44bb1de84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:57:17.365347 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1253/2509] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:57:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:57:25.594695 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=30 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:57:27.346198 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=3 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:57:56.853200 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d374b9-8acf-4aa6-907c-b6502a1efebe service nova] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:57:56.855113 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-98d374b9-8acf-4aa6-907c-b6502a1efebe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:57:56.992254 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d374b9-8acf-4aa6-907c-b6502a1efebe service nova] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:57:56.997467 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c567e39-5708-4edd-9a2e-a2c996f333f8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700ad7df774415b89737c7dddcc5b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:57:56.998117 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c567e39-5708-4edd-9a2e-a2c996f333f8 service placement] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:57:56.999544 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c567e39-5708-4edd-9a2e-a2c996f333f8 service placement] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:57:56.999544 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c567e39-5708-4edd-9a2e-a2c996f333f8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:57:57.000583 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-8c567e39-5708-4edd-9a2e-a2c996f333f8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:57:57.013174 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c567e39-5708-4edd-9a2e-a2c996f333f8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:57:57.014754 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c567e39-5708-4edd-9a2e-a2c996f333f8 service placement] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:57:57.024970 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1257/2510] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:57:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:58:07.020555 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=63 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:58:09.591258 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb96036-6463-4a3a-bda7-63bfe5b3e145 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:58:09.594017 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb96036-6463-4a3a-bda7-63bfe5b3e145 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:58:09.594017 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb96036-6463-4a3a-bda7-63bfe5b3e145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:58:09.620092 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-eeb96036-6463-4a3a-bda7-63bfe5b3e145 None None] MFA Rules not processed for user `ea2a096c4b964f03aed533d1e5e96db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:58:09.621285 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-eeb96036-6463-4a3a-bda7-63bfe5b3e145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:58:09.682672 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1254/2511] 10.222.0.81 () {58 vars in 1009 bytes} [Mon Jul 18 16:58:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:58:09.850664 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c567e39-5708-4edd-9a2e-a2c996f333f8 service placement] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:58:09.852105 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-8c567e39-5708-4edd-9a2e-a2c996f333f8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:58:09.922311 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c567e39-5708-4edd-9a2e-a2c996f333f8 service placement] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:58:09.927606 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c847e17-4c75-4e2c-86e0-f297144e2140 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251475c53ac64cd48ae84567d8c2ee87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:58:09.928296 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c847e17-4c75-4e2c-86e0-f297144e2140 service swift] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:58:09.928583 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c847e17-4c75-4e2c-86e0-f297144e2140 service swift] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:58:09.928857 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c847e17-4c75-4e2c-86e0-f297144e2140 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:58:09.937267 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c847e17-4c75-4e2c-86e0-f297144e2140 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:58:09.938787 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c847e17-4c75-4e2c-86e0-f297144e2140 service swift] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:58:09.946899 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1258/2512] 10.222.0.81 () {60 vars in 1384 bytes} [Mon Jul 18 16:58:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 16:58:19.675699 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=32 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:58:19.943739 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=32 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:58:29.631403 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b118b1-7ef2-47c3-a735-a975a541c9bf None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:58:29.631974 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b118b1-7ef2-47c3-a735-a975a541c9bf None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:58:29.632072 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b118b1-7ef2-47c3-a735-a975a541c9bf None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:58:29.633480 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1255/2513] 10.222.0.81 () {54 vars in 921 bytes} [Mon Jul 18 16:58:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:58:29.640220 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a57fe-5abf-49a0-acf8-5b5c74fa33f9 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:58:29.640726 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a57fe-5abf-49a0-acf8-5b5c74fa33f9 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:58:29.640897 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a57fe-5abf-49a0-acf8-5b5c74fa33f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:58:29.682218 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-2b2a57fe-5abf-49a0-acf8-5b5c74fa33f9 None None] MFA Rules not processed for user `07f0c5bf1bee48a0bafdf7a9e4537c70`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:58:29.683483 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-2b2a57fe-5abf-49a0-acf8-5b5c74fa33f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:58:29.703087 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1259/2514] 10.222.0.81 () {58 vars in 1018 bytes} [Mon Jul 18 16:58:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:58:29.714448 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b118b1-7ef2-47c3-a735-a975a541c9bf None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:58:29.716221 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-e4b118b1-7ef2-47c3-a735-a975a541c9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:58:29.774538 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b118b1-7ef2-47c3-a735-a975a541c9bf None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:58:29.778580 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338cf24d-c74f-4027-ac3f-c572da7ab40f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e638fbc5f1f3447c8e189c228bbae530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:58:29.779266 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338cf24d-c74f-4027-ac3f-c572da7ab40f service glance] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:58:29.779551 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338cf24d-c74f-4027-ac3f-c572da7ab40f service glance] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:58:29.779891 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338cf24d-c74f-4027-ac3f-c572da7ab40f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:58:29.790415 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338cf24d-c74f-4027-ac3f-c572da7ab40f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:58:29.791907 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338cf24d-c74f-4027-ac3f-c572da7ab40f service glance] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:58:29.802828 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1256/2515] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:58:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:58:30.036616 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b49b8b-b1c7-4f53-b5ce-6c4a122de359 None None] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:58:30.036905 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b49b8b-b1c7-4f53-b5ce-6c4a122de359 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:58:30.037179 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b49b8b-b1c7-4f53-b5ce-6c4a122de359 None None] PATH_INFO: `/` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:58:30.038833 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1260/2516] 10.222.0.81 () {54 vars in 921 bytes} [Mon Jul 18 16:58:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:58:30.044441 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05736df8-bc53-4b36-8ad8-cbba45bf6e4c None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:58:30.044733 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05736df8-bc53-4b36-8ad8-cbba45bf6e4c None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:58:30.045039 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05736df8-bc53-4b36-8ad8-cbba45bf6e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:58:30.075634 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-05736df8-bc53-4b36-8ad8-cbba45bf6e4c None None] MFA Rules not processed for user `b742c540de6545249fe3245047d00c81`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:58:30.076875 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-05736df8-bc53-4b36-8ad8-cbba45bf6e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:58:30.093363 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1257/2517] 10.222.0.81 () {58 vars in 1018 bytes} [Mon Jul 18 16:58:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:58:30.105795 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b49b8b-b1c7-4f53-b5ce-6c4a122de359 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:58:30.107891 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-b1b49b8b-b1c7-4f53-b5ce-6c4a122de359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:58:30.122717 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b49b8b-b1c7-4f53-b5ce-6c4a122de359 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:58:30.126274 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d04631-b82f-4735-a689-d7a9fb699259 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:58:30.126917 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d04631-b82f-4735-a689-d7a9fb699259 service neutron] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:58:30.127200 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d04631-b82f-4735-a689-d7a9fb699259 service neutron] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:58:30.127471 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d04631-b82f-4735-a689-d7a9fb699259 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:58:30.135964 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d04631-b82f-4735-a689-d7a9fb699259 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:58:30.137640 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d04631-b82f-4735-a689-d7a9fb699259 service neutron] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:58:30.145895 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1261/2518] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:58:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:58:30.228901 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6cc1f-3c8d-48dc-abd1-aa7247a9d6c0 None None] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:58:30.229207 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6cc1f-3c8d-48dc-abd1-aa7247a9d6c0 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:58:30.229486 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6cc1f-3c8d-48dc-abd1-aa7247a9d6c0 None None] PATH_INFO: `/` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:58:30.230908 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1258/2519] 10.222.0.81 () {54 vars in 921 bytes} [Mon Jul 18 16:58:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:58:30.236154 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb62000-c02b-4aef-b248-48e3fd62e4d3 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:58:30.236443 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb62000-c02b-4aef-b248-48e3fd62e4d3 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:58:30.236726 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb62000-c02b-4aef-b248-48e3fd62e4d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:58:30.256385 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-abb62000-c02b-4aef-b248-48e3fd62e4d3 None None] MFA Rules not processed for user `07f0c5bf1bee48a0bafdf7a9e4537c70`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:58:30.257587 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-abb62000-c02b-4aef-b248-48e3fd62e4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:58:30.267160 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1262/2520] 10.222.0.81 () {58 vars in 1018 bytes} [Mon Jul 18 16:58:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:58:30.278154 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda6cc1f-3c8d-48dc-abd1-aa7247a9d6c0 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:58:30.289342 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda6cc1f-3c8d-48dc-abd1-aa7247a9d6c0 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:58:30.293447 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2d2813-4f47-47bc-855b-cebffc6504ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:58:30.294071 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d2813-4f47-47bc-855b-cebffc6504ee service neutron] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:58:30.294348 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d2813-4f47-47bc-855b-cebffc6504ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:58:30.294638 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d2813-4f47-47bc-855b-cebffc6504ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:58:30.304787 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2d2813-4f47-47bc-855b-cebffc6504ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:58:30.306215 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2d2813-4f47-47bc-855b-cebffc6504ee service neutron] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:58:30.316806 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1259/2521] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:58:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:58:32.770639 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59852285-b2aa-47a6-834c-d121a5019366 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:58:32.771159 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59852285-b2aa-47a6-834c-d121a5019366 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:58:32.771262 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59852285-b2aa-47a6-834c-d121a5019366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:58:32.790479 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-59852285-b2aa-47a6-834c-d121a5019366 None None] MFA Rules not processed for user `ea2a096c4b964f03aed533d1e5e96db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:58:32.792262 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-59852285-b2aa-47a6-834c-d121a5019366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:58:32.799541 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1263/2522] 10.222.0.81 () {58 vars in 1009 bytes} [Mon Jul 18 16:58:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:58:32.811629 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2d2813-4f47-47bc-855b-cebffc6504ee service neutron] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:58:32.823022 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2d2813-4f47-47bc-855b-cebffc6504ee service neutron] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:58:32.827967 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbfd016-dd71-43b3-b98e-0e1d59d4a76d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251475c53ac64cd48ae84567d8c2ee87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:58:32.828602 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbfd016-dd71-43b3-b98e-0e1d59d4a76d service swift] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:58:32.828878 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbfd016-dd71-43b3-b98e-0e1d59d4a76d service swift] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:58:32.829175 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbfd016-dd71-43b3-b98e-0e1d59d4a76d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:58:32.837159 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbfd016-dd71-43b3-b98e-0e1d59d4a76d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:58:32.839219 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbfd016-dd71-43b3-b98e-0e1d59d4a76d service swift] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:58:32.847131 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1260/2523] 10.222.0.81 () {60 vars in 1384 bytes} [Mon Jul 18 16:58:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 16:58:42.784105 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=28 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:58:42.843988 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=50 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:58:55.599262 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9183d0-46d4-42a5-bc7d-f69eed97ea25 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:58:55.599823 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9183d0-46d4-42a5-bc7d-f69eed97ea25 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:58:55.600037 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9183d0-46d4-42a5-bc7d-f69eed97ea25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:58:55.618754 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-cd9183d0-46d4-42a5-bc7d-f69eed97ea25 None None] MFA Rules not processed for user `ea2a096c4b964f03aed533d1e5e96db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:58:55.620544 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-cd9183d0-46d4-42a5-bc7d-f69eed97ea25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:58:55.628108 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1264/2524] 10.222.0.81 () {58 vars in 967 bytes} [Mon Jul 18 16:58:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:58:55.640327 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbfd016-dd71-43b3-b98e-0e1d59d4a76d service swift] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:58:55.650958 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbfd016-dd71-43b3-b98e-0e1d59d4a76d service swift] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:58:55.656018 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69295742-30c8-4f77-a11f-af0bbc3e88e8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251475c53ac64cd48ae84567d8c2ee87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:58:55.656778 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69295742-30c8-4f77-a11f-af0bbc3e88e8 service swift] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:58:55.657677 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69295742-30c8-4f77-a11f-af0bbc3e88e8 service swift] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:58:55.657966 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69295742-30c8-4f77-a11f-af0bbc3e88e8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:58:55.667325 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69295742-30c8-4f77-a11f-af0bbc3e88e8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:58:55.668944 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69295742-30c8-4f77-a11f-af0bbc3e88e8 service swift] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:58:55.677272 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1261/2525] 10.222.0.81 () {60 vars in 1384 bytes} [Mon Jul 18 16:58:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 16:59:05.613262 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=3 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:59:05.673772 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=6 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:59:14.173460 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1c49a-6b6c-4c12-82e3-6c5e039b5721 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:14.174099 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1c49a-6b6c-4c12-82e3-6c5e039b5721 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:14.174099 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1c49a-6b6c-4c12-82e3-6c5e039b5721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:14.192051 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-95a1c49a-6b6c-4c12-82e3-6c5e039b5721 None None] MFA Rules not processed for user `1d601d9805b840e0b9f5f998b6e7327d`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:59:14.193319 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-95a1c49a-6b6c-4c12-82e3-6c5e039b5721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:59:14.201459 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1265/2526] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:59:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:59:16.725891 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69295742-30c8-4f77-a11f-af0bbc3e88e8 service swift] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:59:16.737198 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69295742-30c8-4f77-a11f-af0bbc3e88e8 service swift] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:59:16.740820 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149aed73-ed96-4c39-b3cd-6d2c8982b635 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:59:16.741456 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149aed73-ed96-4c39-b3cd-6d2c8982b635 service neutron] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:16.741825 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149aed73-ed96-4c39-b3cd-6d2c8982b635 service neutron] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:16.742223 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149aed73-ed96-4c39-b3cd-6d2c8982b635 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:16.744178 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-149aed73-ed96-4c39-b3cd-6d2c8982b635 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:59:16.779467 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149aed73-ed96-4c39-b3cd-6d2c8982b635 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:59:16.780915 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149aed73-ed96-4c39-b3cd-6d2c8982b635 service neutron] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:59:16.800643 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1262/2527] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:59:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:59:21.718605 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1c49a-6b6c-4c12-82e3-6c5e039b5721 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:59:21.720022 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-95a1c49a-6b6c-4c12-82e3-6c5e039b5721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:59:21.739103 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1c49a-6b6c-4c12-82e3-6c5e039b5721 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:59:21.743856 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5302c748-f70a-4284-8c80-7f86ec1a10b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:59:21.745272 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302c748-f70a-4284-8c80-7f86ec1a10b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:21.745551 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302c748-f70a-4284-8c80-7f86ec1a10b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:21.745841 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302c748-f70a-4284-8c80-7f86ec1a10b3 admin admin] PATH_INFO: `/v3/users/512342c273bb4299ad5fc29e69b5aeb8` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:21.747148 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5302c748-f70a-4284-8c80-7f86ec1a10b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=512342c273bb4299ad5fc29e69b5aeb8)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:59:21.749151 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5302c748-f70a-4284-8c80-7f86ec1a10b3 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:59:22.041902 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-5302c748-f70a-4284-8c80-7f86ec1a10b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '512342c273bb4299ad5fc29e69b5aeb8'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:59:22.054585 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-5302c748-f70a-4284-8c80-7f86ec1a10b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '512342c273bb4299ad5fc29e69b5aeb8'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:59:22.055359 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-5302c748-f70a-4284-8c80-7f86ec1a10b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '512342c273bb4299ad5fc29e69b5aeb8'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:59:22.062729 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-5302c748-f70a-4284-8c80-7f86ec1a10b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '512342c273bb4299ad5fc29e69b5aeb8'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:59:22.164690 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-5302c748-f70a-4284-8c80-7f86ec1a10b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '512342c273bb4299ad5fc29e69b5aeb8'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:59:22.171837 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1266/2528] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 16:59:21 2022] DELETE /identity/v3/users/512342c273bb4299ad5fc29e69b5aeb8 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:59:22.418602 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149aed73-ed96-4c39-b3cd-6d2c8982b635 service neutron] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:59:22.431705 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149aed73-ed96-4c39-b3cd-6d2c8982b635 service neutron] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:59:22.495284 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e421746-62cd-4bc1-a130-293bc9092e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:59:22.496181 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e421746-62cd-4bc1-a130-293bc9092e90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:22.496465 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e421746-62cd-4bc1-a130-293bc9092e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:22.496744 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e421746-62cd-4bc1-a130-293bc9092e90 admin admin] PATH_INFO: `/v3/projects/5c7a58bbcfcb40eeadc7620aa6a86f65` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:22.497935 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e421746-62cd-4bc1-a130-293bc9092e90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c7a58bbcfcb40eeadc7620aa6a86f65)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:59:22.499885 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e421746-62cd-4bc1-a130-293bc9092e90 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:59:22.621161 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-8e421746-62cd-4bc1-a130-293bc9092e90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c7a58bbcfcb40eeadc7620aa6a86f65', 'request_id': 'req-8e421746-62cd-4bc1-a130-293bc9092e90'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:59:22.707760 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-8e421746-62cd-4bc1-a130-293bc9092e90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c7a58bbcfcb40eeadc7620aa6a86f65', 'request_id': 'req-8e421746-62cd-4bc1-a130-293bc9092e90'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:59:22.714522 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-8e421746-62cd-4bc1-a130-293bc9092e90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c7a58bbcfcb40eeadc7620aa6a86f65', 'request_id': 'req-8e421746-62cd-4bc1-a130-293bc9092e90'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:59:22.725518 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-8e421746-62cd-4bc1-a130-293bc9092e90 admin admin] The token cache is being invalidate because project 5c7a58bbcfcb40eeadc7620aa6a86f65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:59:22.725805 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-8e421746-62cd-4bc1-a130-293bc9092e90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:59:22.726444 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-8e421746-62cd-4bc1-a130-293bc9092e90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:59:22.728601 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1263/2529] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 16:59:22 2022] DELETE /identity/v3/projects/5c7a58bbcfcb40eeadc7620aa6a86f65 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:59:22.733849 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811456b-c2cc-4e80-a521-84baee702b2b None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:22.734374 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811456b-c2cc-4e80-a521-84baee702b2b None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:22.734485 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811456b-c2cc-4e80-a521-84baee702b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:22.784005 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-c811456b-c2cc-4e80-a521-84baee702b2b None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:59:22.785247 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-c811456b-c2cc-4e80-a521-84baee702b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:59:22.846823 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1267/2530] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:59:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:59:22.855246 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c76da3-fea4-4ad2-be81-f3cab10d67c5 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:22.855565 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c76da3-fea4-4ad2-be81-f3cab10d67c5 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:22.855851 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c76da3-fea4-4ad2-be81-f3cab10d67c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:22.877465 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-95c76da3-fea4-4ad2-be81-f3cab10d67c5 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:59:22.879497 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-95c76da3-fea4-4ad2-be81-f3cab10d67c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:59:22.892238 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1264/2531] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:59:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:59:22.900228 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811456b-c2cc-4e80-a521-84baee702b2b None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:59:22.913480 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811456b-c2cc-4e80-a521-84baee702b2b None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:59:22.918380 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc3f13d-87a8-435f-ac41-2bb1c27a6fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:59:22.919051 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3f13d-87a8-435f-ac41-2bb1c27a6fcb admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:22.919337 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3f13d-87a8-435f-ac41-2bb1c27a6fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:22.919613 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3f13d-87a8-435f-ac41-2bb1c27a6fcb admin admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:22.920392 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc3f13d-87a8-435f-ac41-2bb1c27a6fcb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:59:22.920702 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc3f13d-87a8-435f-ac41-2bb1c27a6fcb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:59:22.923151 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc3f13d-87a8-435f-ac41-2bb1c27a6fcb admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:59:22.936566 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1268/2532] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Jul 18 16:59:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:59:22.940756 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c76da3-fea4-4ad2-be81-f3cab10d67c5 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:59:22.958480 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c76da3-fea4-4ad2-be81-f3cab10d67c5 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:59:22.963969 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ae07ca-7b0d-476e-b3a9-5a5638360f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:59:22.964918 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae07ca-7b0d-476e-b3a9-5a5638360f62 admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:22.965531 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae07ca-7b0d-476e-b3a9-5a5638360f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:22.966004 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae07ca-7b0d-476e-b3a9-5a5638360f62 admin admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:22.966863 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ae07ca-7b0d-476e-b3a9-5a5638360f62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:59:22.969403 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ae07ca-7b0d-476e-b3a9-5a5638360f62 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:59:23.111756 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1265/2533] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:59:22 2022] POST /identity/v3/projects => generated 365 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:59:23.114644 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc3f13d-87a8-435f-ac41-2bb1c27a6fcb admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:59:23.128984 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc3f13d-87a8-435f-ac41-2bb1c27a6fcb admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:59:23.163282 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:59:23.192563 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9acc25d-18df-4c8d-aec6-26f6176f6b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:59:23.193287 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9acc25d-18df-4c8d-aec6-26f6176f6b8a admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:23.193567 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9acc25d-18df-4c8d-aec6-26f6176f6b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:23.193839 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9acc25d-18df-4c8d-aec6-26f6176f6b8a admin admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:23.194582 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9acc25d-18df-4c8d-aec6-26f6176f6b8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:59:23.196633 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9acc25d-18df-4c8d-aec6-26f6176f6b8a admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:59:23.296933 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1269/2534] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 16:59:23 2022] POST /identity/v3/users => generated 283 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:59:23.301133 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ae07ca-7b0d-476e-b3a9-5a5638360f62 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:59:23.312690 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ae07ca-7b0d-476e-b3a9-5a5638360f62 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:59:23.317621 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1f59d-45c0-4eeb-bc72-aff390340140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:59:23.318281 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1f59d-45c0-4eeb-bc72-aff390340140 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:23.318562 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1f59d-45c0-4eeb-bc72-aff390340140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:23.318838 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1f59d-45c0-4eeb-bc72-aff390340140 admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:23.319564 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c1f59d-45c0-4eeb-bc72-aff390340140 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:59:23.321195 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c1f59d-45c0-4eeb-bc72-aff390340140 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:59:23.331909 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1266/2535] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:59:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:59:23.336018 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9acc25d-18df-4c8d-aec6-26f6176f6b8a admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:59:23.346039 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9acc25d-18df-4c8d-aec6-26f6176f6b8a admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:59:23.350967 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3aca63-abba-4ea5-8c32-434730d85968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:59:23.351628 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3aca63-abba-4ea5-8c32-434730d85968 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:23.351943 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3aca63-abba-4ea5-8c32-434730d85968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:23.352242 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3aca63-abba-4ea5-8c32-434730d85968 admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:23.352964 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3aca63-abba-4ea5-8c32-434730d85968 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:59:23.355138 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3aca63-abba-4ea5-8c32-434730d85968 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:59:23.365350 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1270/2536] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:59:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:59:23.370070 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1f59d-45c0-4eeb-bc72-aff390340140 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:59:23.383523 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1f59d-45c0-4eeb-bc72-aff390340140 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:59:23.386173 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e37293-76d5-4b45-bf18-e304981a36ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:59:23.387059 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e37293-76d5-4b45-bf18-e304981a36ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:23.387339 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e37293-76d5-4b45-bf18-e304981a36ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:23.387619 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e37293-76d5-4b45-bf18-e304981a36ec admin admin] PATH_INFO: `/v3/projects/163d93cfb7dc4db1b01f84b93bea6e1d/users/cda9767904634cd58352e4546fbddbbb/roles/ad3a2bc7b2094a4da1a95a143c8d9436` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:23.390753 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:59:23.402326 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e37293-76d5-4b45-bf18-e304981a36ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=163d93cfb7dc4db1b01f84b93bea6e1d, user_id=cda9767904634cd58352e4546fbddbbb, role_id=ad3a2bc7b2094a4da1a95a143c8d9436)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:59:23.405027 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e37293-76d5-4b45-bf18-e304981a36ec admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:59:23.507609 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1267/2537] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:59:23 2022] PUT /identity/v3/projects/163d93cfb7dc4db1b01f84b93bea6e1d/users/cda9767904634cd58352e4546fbddbbb/roles/ad3a2bc7b2094a4da1a95a143c8d9436 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:59:23.520394 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb2bb2-9c67-44aa-bf92-4ffc4dd7147f None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:23.520685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb2bb2-9c67-44aa-bf92-4ffc4dd7147f None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:23.520965 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb2bb2-9c67-44aa-bf92-4ffc4dd7147f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:23.549123 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-0edb2bb2-9c67-44aa-bf92-4ffc4dd7147f None None] MFA Rules not processed for user `cda9767904634cd58352e4546fbddbbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:59:23.550114 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-0edb2bb2-9c67-44aa-bf92-4ffc4dd7147f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:59:23.613706 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1271/2538] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:59:23 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:59:23.624768 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e37293-76d5-4b45-bf18-e304981a36ec admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:59:23.626480 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-15e37293-76d5-4b45-bf18-e304981a36ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:59:23.704197 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e37293-76d5-4b45-bf18-e304981a36ec admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:59:23.707872 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3c3a1c-25af-46c3-bd0f-7b4ba6aca6cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:59:23.708435 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c3a1c-25af-46c3-bd0f-7b4ba6aca6cf service cinder] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:23.708718 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c3a1c-25af-46c3-bd0f-7b4ba6aca6cf service cinder] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:23.708984 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c3a1c-25af-46c3-bd0f-7b4ba6aca6cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:23.717746 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3c3a1c-25af-46c3-bd0f-7b4ba6aca6cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:59:23.719157 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3c3a1c-25af-46c3-bd0f-7b4ba6aca6cf service cinder] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:59:23.727843 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1268/2539] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:59:23 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:59:33.610775 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=52,keystone:INSERT=3 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:59:33.723890 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=41,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:59:36.303660 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edb2bb2-9c67-44aa-bf92-4ffc4dd7147f None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:59:36.364671 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edb2bb2-9c67-44aa-bf92-4ffc4dd7147f None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:59:36.369142 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da291db8-4923-4856-b2d0-6eeddfcf4fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:59:36.370010 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da291db8-4923-4856-b2d0-6eeddfcf4fc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:36.370296 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da291db8-4923-4856-b2d0-6eeddfcf4fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:36.371065 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da291db8-4923-4856-b2d0-6eeddfcf4fc3 admin admin] PATH_INFO: `/v3/users/cda9767904634cd58352e4546fbddbbb` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:36.372268 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da291db8-4923-4856-b2d0-6eeddfcf4fc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cda9767904634cd58352e4546fbddbbb)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:59:36.374185 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da291db8-4923-4856-b2d0-6eeddfcf4fc3 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:59:36.555128 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-da291db8-4923-4856-b2d0-6eeddfcf4fc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cda9767904634cd58352e4546fbddbbb'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:59:36.567382 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-da291db8-4923-4856-b2d0-6eeddfcf4fc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cda9767904634cd58352e4546fbddbbb'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:59:36.568060 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-da291db8-4923-4856-b2d0-6eeddfcf4fc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cda9767904634cd58352e4546fbddbbb'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:59:36.574927 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-da291db8-4923-4856-b2d0-6eeddfcf4fc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cda9767904634cd58352e4546fbddbbb'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:59:36.650182 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-da291db8-4923-4856-b2d0-6eeddfcf4fc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cda9767904634cd58352e4546fbddbbb'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:59:36.656726 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1272/2540] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 16:59:36 2022] DELETE /identity/v3/users/cda9767904634cd58352e4546fbddbbb => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:59:36.661272 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d108048-5618-4ff4-99ed-4b4ad105be60 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:36.661738 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d108048-5618-4ff4-99ed-4b4ad105be60 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:36.665809 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d108048-5618-4ff4-99ed-4b4ad105be60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:36.679561 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-5d108048-5618-4ff4-99ed-4b4ad105be60 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:59:36.680790 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-5d108048-5618-4ff4-99ed-4b4ad105be60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:59:36.738384 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1269/2541] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:59:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:59:36.748882 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da291db8-4923-4856-b2d0-6eeddfcf4fc3 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:59:36.750263 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-da291db8-4923-4856-b2d0-6eeddfcf4fc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:59:36.807137 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da291db8-4923-4856-b2d0-6eeddfcf4fc3 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:59:36.811289 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02dc051-ea4a-488c-b371-0791bbbf42a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:59:36.811972 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02dc051-ea4a-488c-b371-0791bbbf42a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:36.812252 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02dc051-ea4a-488c-b371-0791bbbf42a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:36.812526 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02dc051-ea4a-488c-b371-0791bbbf42a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:36.821555 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02dc051-ea4a-488c-b371-0791bbbf42a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:59:36.822966 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02dc051-ea4a-488c-b371-0791bbbf42a8 service neutron] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:59:36.832305 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1273/2542] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:59:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:59:37.291913 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d108048-5618-4ff4-99ed-4b4ad105be60 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:59:37.293947 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-5d108048-5618-4ff4-99ed-4b4ad105be60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:59:37.306233 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d108048-5618-4ff4-99ed-4b4ad105be60 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:59:37.311579 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c4be09-a325-452a-8f2a-2137454e313a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:59:37.312359 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4be09-a325-452a-8f2a-2137454e313a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:37.312640 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4be09-a325-452a-8f2a-2137454e313a admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:37.312977 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4be09-a325-452a-8f2a-2137454e313a admin admin] PATH_INFO: `/v3/projects/163d93cfb7dc4db1b01f84b93bea6e1d` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:37.314198 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c4be09-a325-452a-8f2a-2137454e313a admin admin] RBAC: Authorizing `identity:delete_project(project_id=163d93cfb7dc4db1b01f84b93bea6e1d)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:59:37.316088 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c4be09-a325-452a-8f2a-2137454e313a admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:59:37.474854 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-40c4be09-a325-452a-8f2a-2137454e313a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '163d93cfb7dc4db1b01f84b93bea6e1d', 'request_id': 'req-40c4be09-a325-452a-8f2a-2137454e313a'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:59:37.627254 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-40c4be09-a325-452a-8f2a-2137454e313a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '163d93cfb7dc4db1b01f84b93bea6e1d', 'request_id': 'req-40c4be09-a325-452a-8f2a-2137454e313a'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:59:37.633614 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-40c4be09-a325-452a-8f2a-2137454e313a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '163d93cfb7dc4db1b01f84b93bea6e1d', 'request_id': 'req-40c4be09-a325-452a-8f2a-2137454e313a'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:59:37.645307 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-40c4be09-a325-452a-8f2a-2137454e313a admin admin] The token cache is being invalidate because project 163d93cfb7dc4db1b01f84b93bea6e1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:59:37.645590 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-40c4be09-a325-452a-8f2a-2137454e313a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:59:37.646234 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-40c4be09-a325-452a-8f2a-2137454e313a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:59:37.647798 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1270/2543] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 16:59:37 2022] DELETE /identity/v3/projects/163d93cfb7dc4db1b01f84b93bea6e1d => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:59:37.653558 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87768128-2b5b-4510-8431-6801624d91c9 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:37.654154 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87768128-2b5b-4510-8431-6801624d91c9 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:37.654154 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87768128-2b5b-4510-8431-6801624d91c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:37.672259 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-87768128-2b5b-4510-8431-6801624d91c9 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:59:37.673451 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-87768128-2b5b-4510-8431-6801624d91c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:59:37.690532 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:59:37.732262 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1274/2544] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:59:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:59:37.740210 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa0ad74-73e9-44da-878e-70b7e64a5ff7 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:37.740686 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa0ad74-73e9-44da-878e-70b7e64a5ff7 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:37.740801 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa0ad74-73e9-44da-878e-70b7e64a5ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:37.759626 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-8aa0ad74-73e9-44da-878e-70b7e64a5ff7 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:59:37.760844 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-8aa0ad74-73e9-44da-878e-70b7e64a5ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:59:37.769360 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1271/2545] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:59:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:59:37.773534 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87768128-2b5b-4510-8431-6801624d91c9 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:59:37.783140 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87768128-2b5b-4510-8431-6801624d91c9 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:59:37.788055 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393489c7-f20b-4f9f-8e88-4c4297000542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:59:37.788716 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393489c7-f20b-4f9f-8e88-4c4297000542 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:37.789001 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393489c7-f20b-4f9f-8e88-4c4297000542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:37.789280 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393489c7-f20b-4f9f-8e88-4c4297000542 admin admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:37.790030 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393489c7-f20b-4f9f-8e88-4c4297000542 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:59:37.790372 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393489c7-f20b-4f9f-8e88-4c4297000542 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:59:37.792055 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393489c7-f20b-4f9f-8e88-4c4297000542 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:59:37.804467 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1275/2546] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Jul 18 16:59:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:59:37.809456 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa0ad74-73e9-44da-878e-70b7e64a5ff7 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:59:37.818827 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa0ad74-73e9-44da-878e-70b7e64a5ff7 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:59:37.823487 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d4cc6-e845-40c7-ba56-31d98aa8ce0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:59:37.824686 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d4cc6-e845-40c7-ba56-31d98aa8ce0b admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:37.824972 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d4cc6-e845-40c7-ba56-31d98aa8ce0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:37.825247 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d4cc6-e845-40c7-ba56-31d98aa8ce0b admin admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:37.825966 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350d4cc6-e845-40c7-ba56-31d98aa8ce0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:59:37.827884 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350d4cc6-e845-40c7-ba56-31d98aa8ce0b admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:59:37.977523 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1272/2547] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:59:37 2022] POST /identity/v3/projects => generated 371 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:59:37.981911 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393489c7-f20b-4f9f-8e88-4c4297000542 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:59:37.992179 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393489c7-f20b-4f9f-8e88-4c4297000542 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:59:38.049152 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0aaa56-23d0-491a-b79b-c19e65a87f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:59:38.049842 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0aaa56-23d0-491a-b79b-c19e65a87f1a admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:38.050112 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0aaa56-23d0-491a-b79b-c19e65a87f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:38.050390 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0aaa56-23d0-491a-b79b-c19e65a87f1a admin admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:38.051078 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0aaa56-23d0-491a-b79b-c19e65a87f1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:59:38.053029 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0aaa56-23d0-491a-b79b-c19e65a87f1a admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:59:38.187313 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1276/2548] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 16:59:37 2022] POST /identity/v3/users => generated 286 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:59:38.191616 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d4cc6-e845-40c7-ba56-31d98aa8ce0b admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:59:38.201966 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d4cc6-e845-40c7-ba56-31d98aa8ce0b admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:59:38.206699 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26568fc9-d6aa-4d12-b667-cc5faa8d365b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:59:38.207351 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26568fc9-d6aa-4d12-b667-cc5faa8d365b admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:38.207634 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26568fc9-d6aa-4d12-b667-cc5faa8d365b admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:38.207938 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26568fc9-d6aa-4d12-b667-cc5faa8d365b admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:38.208675 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26568fc9-d6aa-4d12-b667-cc5faa8d365b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:59:38.210285 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26568fc9-d6aa-4d12-b667-cc5faa8d365b admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:59:38.220801 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1273/2549] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:59:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:59:38.229533 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0aaa56-23d0-491a-b79b-c19e65a87f1a admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:59:38.240214 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0aaa56-23d0-491a-b79b-c19e65a87f1a admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:59:38.244954 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d2b62f-b832-443c-bf58-973ce39e9e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:59:38.246203 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d2b62f-b832-443c-bf58-973ce39e9e03 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:38.246496 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d2b62f-b832-443c-bf58-973ce39e9e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:38.246776 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d2b62f-b832-443c-bf58-973ce39e9e03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:38.247497 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d2b62f-b832-443c-bf58-973ce39e9e03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:59:38.249176 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d2b62f-b832-443c-bf58-973ce39e9e03 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:59:38.259389 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1277/2550] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:59:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:59:38.268790 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26568fc9-d6aa-4d12-b667-cc5faa8d365b admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:59:38.278892 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26568fc9-d6aa-4d12-b667-cc5faa8d365b admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:59:38.283442 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a8ef05-4ec8-403c-8b66-241b1eeb1658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:59:38.284344 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a8ef05-4ec8-403c-8b66-241b1eeb1658 admin admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:38.284628 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a8ef05-4ec8-403c-8b66-241b1eeb1658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:38.284903 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a8ef05-4ec8-403c-8b66-241b1eeb1658 admin admin] PATH_INFO: `/v3/projects/40f5b14e139b4aeebd529e4cb0eed573/users/65f978c0ce4640bfb28d3f002e465f28/roles/ad3a2bc7b2094a4da1a95a143c8d9436` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:38.300904 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a8ef05-4ec8-403c-8b66-241b1eeb1658 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40f5b14e139b4aeebd529e4cb0eed573, user_id=65f978c0ce4640bfb28d3f002e465f28, role_id=ad3a2bc7b2094a4da1a95a143c8d9436)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:59:38.303545 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a8ef05-4ec8-403c-8b66-241b1eeb1658 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:59:38.382795 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1274/2551] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:59:38 2022] PUT /identity/v3/projects/40f5b14e139b4aeebd529e4cb0eed573/users/65f978c0ce4640bfb28d3f002e465f28/roles/ad3a2bc7b2094a4da1a95a143c8d9436 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:59:38.393099 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77868e07-e804-4eed-b3a9-02ec5b54cf0a None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:38.393393 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77868e07-e804-4eed-b3a9-02ec5b54cf0a None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:38.393675 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77868e07-e804-4eed-b3a9-02ec5b54cf0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:38.421447 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-77868e07-e804-4eed-b3a9-02ec5b54cf0a None None] MFA Rules not processed for user `65f978c0ce4640bfb28d3f002e465f28`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:59:38.422737 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-77868e07-e804-4eed-b3a9-02ec5b54cf0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:59:38.488257 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1278/2552] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:59:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:59:38.492951 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a8ef05-4ec8-403c-8b66-241b1eeb1658 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:59:38.514041 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:59:38.555071 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a8ef05-4ec8-403c-8b66-241b1eeb1658 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:59:38.559705 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b8d82-1843-4a0d-8099-d6b70e2b3686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:59:38.560380 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b8d82-1843-4a0d-8099-d6b70e2b3686 admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:38.560663 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b8d82-1843-4a0d-8099-d6b70e2b3686 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:38.560940 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b8d82-1843-4a0d-8099-d6b70e2b3686 admin admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:38.561619 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b8d82-1843-4a0d-8099-d6b70e2b3686 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:59:38.563567 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b8d82-1843-4a0d-8099-d6b70e2b3686 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:59:38.685900 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1275/2553] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 16:59:38 2022] POST /identity/v3/projects => generated 373 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:59:38.689926 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77868e07-e804-4eed-b3a9-02ec5b54cf0a None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:59:38.700803 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77868e07-e804-4eed-b3a9-02ec5b54cf0a None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:59:38.713456 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:59:38.756878 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4d147-6ce8-4115-8575-767f33f066da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:59:38.757576 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4d147-6ce8-4115-8575-767f33f066da admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:38.758067 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4d147-6ce8-4115-8575-767f33f066da admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:38.758389 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4d147-6ce8-4115-8575-767f33f066da admin admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:38.759301 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb4d147-6ce8-4115-8575-767f33f066da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:59:38.761711 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb4d147-6ce8-4115-8575-767f33f066da admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:59:38.885259 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1279/2554] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 16:59:38 2022] POST /identity/v3/users => generated 293 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:59:38.889595 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b8d82-1843-4a0d-8099-d6b70e2b3686 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:59:38.900235 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b8d82-1843-4a0d-8099-d6b70e2b3686 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:59:38.905429 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413fb67-4ffe-4928-8be6-c10200df7359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:59:38.906141 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413fb67-4ffe-4928-8be6-c10200df7359 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:38.906423 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413fb67-4ffe-4928-8be6-c10200df7359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:38.906700 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413fb67-4ffe-4928-8be6-c10200df7359 admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:38.907419 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2413fb67-4ffe-4928-8be6-c10200df7359 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:59:38.909073 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2413fb67-4ffe-4928-8be6-c10200df7359 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:59:38.919997 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1276/2555] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:59:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:59:38.924173 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4d147-6ce8-4115-8575-767f33f066da admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:59:38.934345 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4d147-6ce8-4115-8575-767f33f066da admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:59:38.938942 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da715d8d-eac4-46f1-89f3-dc41b35626ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:59:38.939863 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da715d8d-eac4-46f1-89f3-dc41b35626ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:38.940172 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da715d8d-eac4-46f1-89f3-dc41b35626ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:38.940449 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da715d8d-eac4-46f1-89f3-dc41b35626ec admin admin] PATH_INFO: `/v3/projects/2b1c763bc6ee45ad90a946ae6767f22a/users/923556f486b54fb3a97f3e034db2705a/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:38.955684 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da715d8d-eac4-46f1-89f3-dc41b35626ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b1c763bc6ee45ad90a946ae6767f22a, user_id=923556f486b54fb3a97f3e034db2705a, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:59:38.958366 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da715d8d-eac4-46f1-89f3-dc41b35626ec admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:59:39.084773 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1280/2556] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:59:38 2022] PUT /identity/v3/projects/2b1c763bc6ee45ad90a946ae6767f22a/users/923556f486b54fb3a97f3e034db2705a/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:59:39.088879 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413fb67-4ffe-4928-8be6-c10200df7359 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:59:39.099827 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413fb67-4ffe-4928-8be6-c10200df7359 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:59:39.158105 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f1d4c-523c-458f-98e8-7d5f0240ed39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:59:39.158683 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f1d4c-523c-458f-98e8-7d5f0240ed39 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:39.158968 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f1d4c-523c-458f-98e8-7d5f0240ed39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:39.159247 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f1d4c-523c-458f-98e8-7d5f0240ed39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:39.160008 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145f1d4c-523c-458f-98e8-7d5f0240ed39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:59:39.161595 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145f1d4c-523c-458f-98e8-7d5f0240ed39 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:59:39.173009 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1277/2557] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 16:59:39 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 16:59:39.177336 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da715d8d-eac4-46f1-89f3-dc41b35626ec admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:59:39.188525 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da715d8d-eac4-46f1-89f3-dc41b35626ec admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:59:39.193192 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d8d8d9-b704-40ae-b59b-4d308c225f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:59:39.194071 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8d8d9-b704-40ae-b59b-4d308c225f52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:39.194353 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8d8d9-b704-40ae-b59b-4d308c225f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:39.194658 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8d8d9-b704-40ae-b59b-4d308c225f52 admin admin] PATH_INFO: `/v3/projects/2b1c763bc6ee45ad90a946ae6767f22a/users/923556f486b54fb3a97f3e034db2705a/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:39.196657 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d8d8d9-b704-40ae-b59b-4d308c225f52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b1c763bc6ee45ad90a946ae6767f22a, user_id=923556f486b54fb3a97f3e034db2705a, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:59:39.199973 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d8d8d9-b704-40ae-b59b-4d308c225f52 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:59:39.210231 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1281/2558] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 16:59:39 2022] PUT /identity/v3/projects/2b1c763bc6ee45ad90a946ae6767f22a/users/923556f486b54fb3a97f3e034db2705a/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:59:39.220745 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102862eb-9504-4ac0-ad67-ddd341c9fc31 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:39.221039 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102862eb-9504-4ac0-ad67-ddd341c9fc31 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:39.221321 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102862eb-9504-4ac0-ad67-ddd341c9fc31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:39.247566 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-102862eb-9504-4ac0-ad67-ddd341c9fc31 None None] MFA Rules not processed for user `923556f486b54fb3a97f3e034db2705a`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:59:39.248810 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-102862eb-9504-4ac0-ad67-ddd341c9fc31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:59:39.316921 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1278/2559] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 16:59:39 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:59:39.329074 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d8d8d9-b704-40ae-b59b-4d308c225f52 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:59:39.330867 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-36d8d8d9-b704-40ae-b59b-4d308c225f52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:59:39.395387 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d8d8d9-b704-40ae-b59b-4d308c225f52 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:59:39.399060 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84384625-aeef-4530-b9a7-9e75b0f27b47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:59:39.399721 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84384625-aeef-4530-b9a7-9e75b0f27b47 service cinder] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:39.400019 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84384625-aeef-4530-b9a7-9e75b0f27b47 service cinder] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:39.400291 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84384625-aeef-4530-b9a7-9e75b0f27b47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:39.409729 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84384625-aeef-4530-b9a7-9e75b0f27b47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:59:39.411084 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84384625-aeef-4530-b9a7-9e75b0f27b47 service cinder] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:59:39.420671 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1282/2560] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:59:39 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 16:59:39.611774 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102862eb-9504-4ac0-ad67-ddd341c9fc31 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:59:39.622231 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102862eb-9504-4ac0-ad67-ddd341c9fc31 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:59:39.625904 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371c12da-9c71-42c5-8593-2e2c282dd82a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:59:39.626532 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c12da-9c71-42c5-8593-2e2c282dd82a service cinder] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:39.626811 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c12da-9c71-42c5-8593-2e2c282dd82a service cinder] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:39.627081 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c12da-9c71-42c5-8593-2e2c282dd82a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:39.639114 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:59:39.685567 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371c12da-9c71-42c5-8593-2e2c282dd82a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:59:39.686930 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371c12da-9c71-42c5-8593-2e2c282dd82a service cinder] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:59:39.696774 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1279/2561] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 16:59:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:59:49.416400 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=62,keystone:INSERT=5 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:59:49.697663 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=21 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:04.008231 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84384625-aeef-4530-b9a7-9e75b0f27b47 service cinder] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:04.009677 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-84384625-aeef-4530-b9a7-9e75b0f27b47 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:04.067074 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84384625-aeef-4530-b9a7-9e75b0f27b47 service cinder] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:04.070812 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4d8d8d-0c44-4401-a3d6-4604857e97d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:04.071458 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d8d8d-0c44-4401-a3d6-4604857e97d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:04.071760 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d8d8d-0c44-4401-a3d6-4604857e97d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:04.072040 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d8d8d-0c44-4401-a3d6-4604857e97d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:04.073794 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-fb4d8d8d-0c44-4401-a3d6-4604857e97d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:04.141701 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4d8d8d-0c44-4401-a3d6-4604857e97d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:04.143152 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4d8d8d-0c44-4401-a3d6-4604857e97d9 service neutron] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:04.154198 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1283/2562] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 17:00:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:00:07.960483 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371c12da-9c71-42c5-8593-2e2c282dd82a service cinder] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:07.962170 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-371c12da-9c71-42c5-8593-2e2c282dd82a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:07.977222 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371c12da-9c71-42c5-8593-2e2c282dd82a service cinder] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:07.981870 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c387f-7a83-4a99-b226-fa5216dce6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:07.982769 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c387f-7a83-4a99-b226-fa5216dce6c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:07.983634 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c387f-7a83-4a99-b226-fa5216dce6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:07.983852 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c387f-7a83-4a99-b226-fa5216dce6c6 admin admin] PATH_INFO: `/v3/users/27015a61b08249388e22187e1e56c057` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:08.000767 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0c387f-7a83-4a99-b226-fa5216dce6c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27015a61b08249388e22187e1e56c057)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:08.002740 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0c387f-7a83-4a99-b226-fa5216dce6c6 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:08.355459 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-6b0c387f-7a83-4a99-b226-fa5216dce6c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27015a61b08249388e22187e1e56c057'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:08.356167 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-6b0c387f-7a83-4a99-b226-fa5216dce6c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27015a61b08249388e22187e1e56c057'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:08.369254 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-6b0c387f-7a83-4a99-b226-fa5216dce6c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27015a61b08249388e22187e1e56c057'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:08.507158 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-6b0c387f-7a83-4a99-b226-fa5216dce6c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27015a61b08249388e22187e1e56c057'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:08.514702 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-6b0c387f-7a83-4a99-b226-fa5216dce6c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27015a61b08249388e22187e1e56c057'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:08.520706 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1280/2563] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 17:00:07 2022] DELETE /identity/v3/users/27015a61b08249388e22187e1e56c057 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:00:08.748010 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4d8d8d-0c44-4401-a3d6-4604857e97d9 service neutron] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:08.761701 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4d8d8d-0c44-4401-a3d6-4604857e97d9 service neutron] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:08.822190 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aff46bf-1a6f-4413-8a09-6d7ae5c9f34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:08.823159 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff46bf-1a6f-4413-8a09-6d7ae5c9f34c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:08.823337 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff46bf-1a6f-4413-8a09-6d7ae5c9f34c admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:08.823618 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff46bf-1a6f-4413-8a09-6d7ae5c9f34c admin admin] PATH_INFO: `/v3/projects/2a79870b4c874b8796d8e2bcf163dfb6` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:08.835735 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aff46bf-1a6f-4413-8a09-6d7ae5c9f34c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a79870b4c874b8796d8e2bcf163dfb6)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:08.837727 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aff46bf-1a6f-4413-8a09-6d7ae5c9f34c admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:08.973383 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:08.977173 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-6aff46bf-1a6f-4413-8a09-6d7ae5c9f34c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a79870b4c874b8796d8e2bcf163dfb6', 'request_id': 'req-6aff46bf-1a6f-4413-8a09-6d7ae5c9f34c'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:08.982601 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-6aff46bf-1a6f-4413-8a09-6d7ae5c9f34c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a79870b4c874b8796d8e2bcf163dfb6', 'request_id': 'req-6aff46bf-1a6f-4413-8a09-6d7ae5c9f34c'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:08.989311 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-6aff46bf-1a6f-4413-8a09-6d7ae5c9f34c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a79870b4c874b8796d8e2bcf163dfb6', 'request_id': 'req-6aff46bf-1a6f-4413-8a09-6d7ae5c9f34c'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:09.095459 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-6aff46bf-1a6f-4413-8a09-6d7ae5c9f34c admin admin] The token cache is being invalidate because project 2a79870b4c874b8796d8e2bcf163dfb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:00:09.095943 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-6aff46bf-1a6f-4413-8a09-6d7ae5c9f34c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:09.096708 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-6aff46bf-1a6f-4413-8a09-6d7ae5c9f34c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:09.098613 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1284/2564] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 17:00:08 2022] DELETE /identity/v3/projects/2a79870b4c874b8796d8e2bcf163dfb6 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:00:09.103735 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b846e1-baf9-4b4e-860f-0be5affda75b None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:09.104255 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b846e1-baf9-4b4e-860f-0be5affda75b None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:09.104387 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b846e1-baf9-4b4e-860f-0be5affda75b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:09.124610 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-e6b846e1-baf9-4b4e-860f-0be5affda75b None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:00:09.126027 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-e6b846e1-baf9-4b4e-860f-0be5affda75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:09.192968 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1281/2565] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:00:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:00:09.201253 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef287b-9d03-47c6-8a69-41b049abc197 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:09.201548 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef287b-9d03-47c6-8a69-41b049abc197 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:09.201843 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef287b-9d03-47c6-8a69-41b049abc197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:09.220992 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-7bef287b-9d03-47c6-8a69-41b049abc197 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:00:09.222201 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-7bef287b-9d03-47c6-8a69-41b049abc197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:09.230302 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1285/2566] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:00:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:00:09.235279 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b846e1-baf9-4b4e-860f-0be5affda75b None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:09.245293 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b846e1-baf9-4b4e-860f-0be5affda75b None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:09.250098 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f62532-1c93-4bc3-be93-5926fb8de3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:09.250741 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f62532-1c93-4bc3-be93-5926fb8de3f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:09.251017 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f62532-1c93-4bc3-be93-5926fb8de3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:09.251304 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f62532-1c93-4bc3-be93-5926fb8de3f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:09.252046 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f62532-1c93-4bc3-be93-5926fb8de3f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 17:00:09.252349 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f62532-1c93-4bc3-be93-5926fb8de3f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:09.253991 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f62532-1c93-4bc3-be93-5926fb8de3f7 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:09.266165 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1282/2567] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Jul 18 17:00:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 17:00:09.270658 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef287b-9d03-47c6-8a69-41b049abc197 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:09.280395 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef287b-9d03-47c6-8a69-41b049abc197 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:09.285286 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65095c70-0b06-48d4-95cf-8843c0336849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:09.285945 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65095c70-0b06-48d4-95cf-8843c0336849 admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:09.286233 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65095c70-0b06-48d4-95cf-8843c0336849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:09.286508 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65095c70-0b06-48d4-95cf-8843c0336849 admin admin] PATH_INFO: `/v3/projects` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:09.287204 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65095c70-0b06-48d4-95cf-8843c0336849 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:09.289136 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65095c70-0b06-48d4-95cf-8843c0336849 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:09.411849 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1286/2568] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 17:00:09 2022] POST /identity/v3/projects => generated 403 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:00:09.416018 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f62532-1c93-4bc3-be93-5926fb8de3f7 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:09.426682 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f62532-1c93-4bc3-be93-5926fb8de3f7 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:09.473487 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:09.486505 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499696ff-508c-45ea-8c5a-0622cd88d7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:09.487084 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499696ff-508c-45ea-8c5a-0622cd88d7c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:09.487369 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499696ff-508c-45ea-8c5a-0622cd88d7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:09.487699 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499696ff-508c-45ea-8c5a-0622cd88d7c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:09.488419 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499696ff-508c-45ea-8c5a-0622cd88d7c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:09.490357 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499696ff-508c-45ea-8c5a-0622cd88d7c3 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:09.615498 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1283/2569] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 17:00:09 2022] POST /identity/v3/users => generated 302 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:00:09.619794 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65095c70-0b06-48d4-95cf-8843c0336849 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:09.629852 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65095c70-0b06-48d4-95cf-8843c0336849 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:09.634585 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b1bde9-ed1c-4977-8929-b2643b6b12e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:09.635236 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1bde9-ed1c-4977-8929-b2643b6b12e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:09.635541 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1bde9-ed1c-4977-8929-b2643b6b12e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:09.635854 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1bde9-ed1c-4977-8929-b2643b6b12e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:09.636610 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b1bde9-ed1c-4977-8929-b2643b6b12e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:09.638188 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b1bde9-ed1c-4977-8929-b2643b6b12e1 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:09.648515 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1287/2570] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 17:00:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:00:09.652479 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499696ff-508c-45ea-8c5a-0622cd88d7c3 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:09.663135 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499696ff-508c-45ea-8c5a-0622cd88d7c3 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:09.667688 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d172ad1-9e39-439e-be86-c1ee7265fd87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:09.668366 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d172ad1-9e39-439e-be86-c1ee7265fd87 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:09.668644 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d172ad1-9e39-439e-be86-c1ee7265fd87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:09.668913 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d172ad1-9e39-439e-be86-c1ee7265fd87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:09.669620 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d172ad1-9e39-439e-be86-c1ee7265fd87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:09.671233 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d172ad1-9e39-439e-be86-c1ee7265fd87 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:09.681673 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1284/2571] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 17:00:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:00:09.686915 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b1bde9-ed1c-4977-8929-b2643b6b12e1 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:09.697057 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b1bde9-ed1c-4977-8929-b2643b6b12e1 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:09.701700 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6703dedf-cd3f-4910-a2e4-8f23871e88dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:09.703084 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6703dedf-cd3f-4910-a2e4-8f23871e88dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:09.703365 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6703dedf-cd3f-4910-a2e4-8f23871e88dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:09.703678 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6703dedf-cd3f-4910-a2e4-8f23871e88dd admin admin] PATH_INFO: `/v3/projects/4319f5f8af35427d8263a0fddf5405b5/users/ba2c872ee14c4c18b3a55f02f5a761d8/roles/ad3a2bc7b2094a4da1a95a143c8d9436` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:09.722909 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6703dedf-cd3f-4910-a2e4-8f23871e88dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4319f5f8af35427d8263a0fddf5405b5, user_id=ba2c872ee14c4c18b3a55f02f5a761d8, role_id=ad3a2bc7b2094a4da1a95a143c8d9436)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:09.725645 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6703dedf-cd3f-4910-a2e4-8f23871e88dd admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:09.833174 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1288/2572] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 17:00:09 2022] PUT /identity/v3/projects/4319f5f8af35427d8263a0fddf5405b5/users/ba2c872ee14c4c18b3a55f02f5a761d8/roles/ad3a2bc7b2094a4da1a95a143c8d9436 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:00:09.852564 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47655c28-c29f-47c4-af80-58059a94a976 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:09.853064 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47655c28-c29f-47c4-af80-58059a94a976 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:09.853575 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47655c28-c29f-47c4-af80-58059a94a976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:09.886374 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-47655c28-c29f-47c4-af80-58059a94a976 None None] MFA Rules not processed for user `ba2c872ee14c4c18b3a55f02f5a761d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:00:09.887603 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-47655c28-c29f-47c4-af80-58059a94a976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:09.958911 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1285/2573] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:00:09 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:00:09.963571 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6703dedf-cd3f-4910-a2e4-8f23871e88dd admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:10.028369 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6703dedf-cd3f-4910-a2e4-8f23871e88dd admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:10.033172 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09572467-2336-4b55-b710-36da9beaaa1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:10.033832 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09572467-2336-4b55-b710-36da9beaaa1b admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:10.034115 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09572467-2336-4b55-b710-36da9beaaa1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:10.034394 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09572467-2336-4b55-b710-36da9beaaa1b admin admin] PATH_INFO: `/v3/projects` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:10.035082 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09572467-2336-4b55-b710-36da9beaaa1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:10.037057 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09572467-2336-4b55-b710-36da9beaaa1b admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:10.137129 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1289/2574] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 17:00:09 2022] POST /identity/v3/projects => generated 405 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:00:10.141727 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47655c28-c29f-47c4-af80-58059a94a976 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:10.152523 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47655c28-c29f-47c4-af80-58059a94a976 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:10.210379 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f45a432-9bf8-44e8-a5dc-991909040d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:10.211087 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45a432-9bf8-44e8-a5dc-991909040d7c admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:10.217689 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45a432-9bf8-44e8-a5dc-991909040d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:10.217689 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45a432-9bf8-44e8-a5dc-991909040d7c admin admin] PATH_INFO: `/v3/users` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:10.217689 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f45a432-9bf8-44e8-a5dc-991909040d7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:10.217689 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f45a432-9bf8-44e8-a5dc-991909040d7c admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:10.324450 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1286/2575] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 17:00:10 2022] POST /identity/v3/users => generated 309 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:00:10.328393 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09572467-2336-4b55-b710-36da9beaaa1b admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:10.338736 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09572467-2336-4b55-b710-36da9beaaa1b admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:10.343372 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f54f4-13d9-4299-9ffb-e6b48020d177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:10.344061 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f54f4-13d9-4299-9ffb-e6b48020d177 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:10.344344 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f54f4-13d9-4299-9ffb-e6b48020d177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:10.344622 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f54f4-13d9-4299-9ffb-e6b48020d177 admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:10.345374 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603f54f4-13d9-4299-9ffb-e6b48020d177 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:10.346964 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603f54f4-13d9-4299-9ffb-e6b48020d177 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:10.358525 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1290/2576] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 17:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:00:10.365674 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f45a432-9bf8-44e8-a5dc-991909040d7c admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:10.376743 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f45a432-9bf8-44e8-a5dc-991909040d7c admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:10.381671 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8564953-1e62-4284-90df-8c3647c67f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:10.382548 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8564953-1e62-4284-90df-8c3647c67f89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:10.382828 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8564953-1e62-4284-90df-8c3647c67f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:10.383104 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8564953-1e62-4284-90df-8c3647c67f89 admin admin] PATH_INFO: `/v3/projects/f669a1dfdc7c4aac85aeed0f24638862/users/5752786889d14bc9bcd8989db67017d9/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:10.398323 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8564953-1e62-4284-90df-8c3647c67f89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f669a1dfdc7c4aac85aeed0f24638862, user_id=5752786889d14bc9bcd8989db67017d9, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:10.401008 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8564953-1e62-4284-90df-8c3647c67f89 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:10.513053 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1287/2577] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 17:00:10 2022] PUT /identity/v3/projects/f669a1dfdc7c4aac85aeed0f24638862/users/5752786889d14bc9bcd8989db67017d9/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:00:10.517592 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f54f4-13d9-4299-9ffb-e6b48020d177 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:10.527666 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f54f4-13d9-4299-9ffb-e6b48020d177 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:10.557347 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:10.584076 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c4012b-5ca6-49e3-b14f-78bad241163b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:10.584675 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c4012b-5ca6-49e3-b14f-78bad241163b admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:10.584960 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c4012b-5ca6-49e3-b14f-78bad241163b admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:10.585237 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c4012b-5ca6-49e3-b14f-78bad241163b admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:10.585965 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c4012b-5ca6-49e3-b14f-78bad241163b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:10.587574 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c4012b-5ca6-49e3-b14f-78bad241163b admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:10.598308 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1291/2578] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 17:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:00:10.602856 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8564953-1e62-4284-90df-8c3647c67f89 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:10.613269 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8564953-1e62-4284-90df-8c3647c67f89 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:10.618256 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd4ece5-d3dc-43bd-bcd9-93c2179e08d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:10.619137 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd4ece5-d3dc-43bd-bcd9-93c2179e08d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:10.619432 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd4ece5-d3dc-43bd-bcd9-93c2179e08d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:10.619758 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd4ece5-d3dc-43bd-bcd9-93c2179e08d3 admin admin] PATH_INFO: `/v3/projects/f669a1dfdc7c4aac85aeed0f24638862/users/5752786889d14bc9bcd8989db67017d9/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:10.621723 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd4ece5-d3dc-43bd-bcd9-93c2179e08d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f669a1dfdc7c4aac85aeed0f24638862, user_id=5752786889d14bc9bcd8989db67017d9, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:10.624936 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd4ece5-d3dc-43bd-bcd9-93c2179e08d3 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:10.636043 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1288/2579] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 17:00:10 2022] PUT /identity/v3/projects/f669a1dfdc7c4aac85aeed0f24638862/users/5752786889d14bc9bcd8989db67017d9/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:00:10.646956 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd9f31-01c4-4b65-85b4-539b1ac44615 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:10.647244 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd9f31-01c4-4b65-85b4-539b1ac44615 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:10.647520 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd9f31-01c4-4b65-85b4-539b1ac44615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:10.673655 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-7bbd9f31-01c4-4b65-85b4-539b1ac44615 None None] MFA Rules not processed for user `5752786889d14bc9bcd8989db67017d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:00:10.674859 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-7bbd9f31-01c4-4b65-85b4-539b1ac44615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:10.743088 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1292/2580] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:00:10 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:00:10.754297 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd4ece5-d3dc-43bd-bcd9-93c2179e08d3 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:10.756283 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-8fd4ece5-d3dc-43bd-bcd9-93c2179e08d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:10.767520 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:10.814810 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd4ece5-d3dc-43bd-bcd9-93c2179e08d3 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:10.818839 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9d3b73-87a7-451b-8862-787fd45a4d7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:10.819440 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d3b73-87a7-451b-8862-787fd45a4d7f service cinder] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:10.819741 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d3b73-87a7-451b-8862-787fd45a4d7f service cinder] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:10.820034 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d3b73-87a7-451b-8862-787fd45a4d7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:10.831182 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9d3b73-87a7-451b-8862-787fd45a4d7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:10.832629 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9d3b73-87a7-451b-8862-787fd45a4d7f service cinder] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:10.842519 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1289/2581] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 17:00:10 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:00:10.988151 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd9f31-01c4-4b65-85b4-539b1ac44615 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:11.051078 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd9f31-01c4-4b65-85b4-539b1ac44615 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:11.055441 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8c6f0d-cb83-439e-a78f-870385b8efe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:11.056331 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c6f0d-cb83-439e-a78f-870385b8efe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:11.056613 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c6f0d-cb83-439e-a78f-870385b8efe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:11.056880 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c6f0d-cb83-439e-a78f-870385b8efe1 admin admin] PATH_INFO: `/v3/users/ba2c872ee14c4c18b3a55f02f5a761d8` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:11.058042 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8c6f0d-cb83-439e-a78f-870385b8efe1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba2c872ee14c4c18b3a55f02f5a761d8)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:11.060176 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8c6f0d-cb83-439e-a78f-870385b8efe1 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:11.451212 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-5a8c6f0d-cb83-439e-a78f-870385b8efe1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba2c872ee14c4c18b3a55f02f5a761d8'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:11.459046 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:11.465018 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-5a8c6f0d-cb83-439e-a78f-870385b8efe1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba2c872ee14c4c18b3a55f02f5a761d8'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:11.465782 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-5a8c6f0d-cb83-439e-a78f-870385b8efe1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba2c872ee14c4c18b3a55f02f5a761d8'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:11.472946 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-5a8c6f0d-cb83-439e-a78f-870385b8efe1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba2c872ee14c4c18b3a55f02f5a761d8'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:11.541424 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-5a8c6f0d-cb83-439e-a78f-870385b8efe1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba2c872ee14c4c18b3a55f02f5a761d8'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:11.547943 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1293/2582] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 17:00:10 2022] DELETE /identity/v3/users/ba2c872ee14c4c18b3a55f02f5a761d8 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:00:11.552550 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb88cd89-2c14-4575-81ef-ff4dc986f377 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:11.553060 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb88cd89-2c14-4575-81ef-ff4dc986f377 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:11.553158 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb88cd89-2c14-4575-81ef-ff4dc986f377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:11.570767 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-bb88cd89-2c14-4575-81ef-ff4dc986f377 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:00:11.573581 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-bb88cd89-2c14-4575-81ef-ff4dc986f377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:11.630528 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1290/2583] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:00:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:00:11.640955 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8c6f0d-cb83-439e-a78f-870385b8efe1 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:11.642421 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-5a8c6f0d-cb83-439e-a78f-870385b8efe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:11.699060 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8c6f0d-cb83-439e-a78f-870385b8efe1 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:11.703195 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3077fab0-ff29-45c7-a5f8-ad5b351bd22c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:11.703875 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077fab0-ff29-45c7-a5f8-ad5b351bd22c service neutron] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:11.704157 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077fab0-ff29-45c7-a5f8-ad5b351bd22c service neutron] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:11.704433 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077fab0-ff29-45c7-a5f8-ad5b351bd22c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:11.713431 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3077fab0-ff29-45c7-a5f8-ad5b351bd22c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:11.714854 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3077fab0-ff29-45c7-a5f8-ad5b351bd22c service neutron] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:11.724663 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1294/2584] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 17:00:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 17:00:12.250961 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb88cd89-2c14-4575-81ef-ff4dc986f377 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:12.252489 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-bb88cd89-2c14-4575-81ef-ff4dc986f377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:12.264855 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb88cd89-2c14-4575-81ef-ff4dc986f377 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:12.270374 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb593646-34db-4ed3-91f5-4037c9bf9829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:12.271455 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb593646-34db-4ed3-91f5-4037c9bf9829 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:12.271793 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb593646-34db-4ed3-91f5-4037c9bf9829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:12.272078 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb593646-34db-4ed3-91f5-4037c9bf9829 admin admin] PATH_INFO: `/v3/projects/4319f5f8af35427d8263a0fddf5405b5` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:12.273506 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb593646-34db-4ed3-91f5-4037c9bf9829 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4319f5f8af35427d8263a0fddf5405b5)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:12.275852 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb593646-34db-4ed3-91f5-4037c9bf9829 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:12.449737 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-eb593646-34db-4ed3-91f5-4037c9bf9829 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4319f5f8af35427d8263a0fddf5405b5', 'request_id': 'req-eb593646-34db-4ed3-91f5-4037c9bf9829'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:12.552075 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-eb593646-34db-4ed3-91f5-4037c9bf9829 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4319f5f8af35427d8263a0fddf5405b5', 'request_id': 'req-eb593646-34db-4ed3-91f5-4037c9bf9829'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:12.558464 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-eb593646-34db-4ed3-91f5-4037c9bf9829 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4319f5f8af35427d8263a0fddf5405b5', 'request_id': 'req-eb593646-34db-4ed3-91f5-4037c9bf9829'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:12.569499 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-eb593646-34db-4ed3-91f5-4037c9bf9829 admin admin] The token cache is being invalidate because project 4319f5f8af35427d8263a0fddf5405b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:00:12.569788 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-eb593646-34db-4ed3-91f5-4037c9bf9829 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:12.570427 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-eb593646-34db-4ed3-91f5-4037c9bf9829 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:12.572019 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1291/2585] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 17:00:12 2022] DELETE /identity/v3/projects/4319f5f8af35427d8263a0fddf5405b5 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:00:12.575966 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3077fab0-ff29-45c7-a5f8-ad5b351bd22c service neutron] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:12.585994 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3077fab0-ff29-45c7-a5f8-ad5b351bd22c service neutron] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:12.642348 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42899905-e0fd-4c4f-8585-03f03615228c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:12.643216 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42899905-e0fd-4c4f-8585-03f03615228c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:12.643523 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42899905-e0fd-4c4f-8585-03f03615228c admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:12.643797 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42899905-e0fd-4c4f-8585-03f03615228c admin admin] PATH_INFO: `/v3/users/5752786889d14bc9bcd8989db67017d9` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:12.644979 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42899905-e0fd-4c4f-8585-03f03615228c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5752786889d14bc9bcd8989db67017d9)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:12.647160 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42899905-e0fd-4c4f-8585-03f03615228c admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:12.874012 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-42899905-e0fd-4c4f-8585-03f03615228c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5752786889d14bc9bcd8989db67017d9'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:12.886333 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-42899905-e0fd-4c4f-8585-03f03615228c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5752786889d14bc9bcd8989db67017d9'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:12.887094 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-42899905-e0fd-4c4f-8585-03f03615228c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5752786889d14bc9bcd8989db67017d9'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:12.894165 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-42899905-e0fd-4c4f-8585-03f03615228c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5752786889d14bc9bcd8989db67017d9'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:12.897706 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:12.985602 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-42899905-e0fd-4c4f-8585-03f03615228c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5752786889d14bc9bcd8989db67017d9'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:12.992337 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1295/2586] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 17:00:12 2022] DELETE /identity/v3/users/5752786889d14bc9bcd8989db67017d9 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:00:13.474816 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb593646-34db-4ed3-91f5-4037c9bf9829 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:13.476370 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-eb593646-34db-4ed3-91f5-4037c9bf9829 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:13.490221 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb593646-34db-4ed3-91f5-4037c9bf9829 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:13.525957 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:13.550519 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b88764-4408-4a8d-abf8-1e21392df96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:13.551372 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b88764-4408-4a8d-abf8-1e21392df96d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:13.551654 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b88764-4408-4a8d-abf8-1e21392df96d admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:13.551958 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b88764-4408-4a8d-abf8-1e21392df96d admin admin] PATH_INFO: `/v3/projects/f669a1dfdc7c4aac85aeed0f24638862` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:13.553127 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b88764-4408-4a8d-abf8-1e21392df96d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f669a1dfdc7c4aac85aeed0f24638862)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:13.555097 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b88764-4408-4a8d-abf8-1e21392df96d admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:13.677596 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-e1b88764-4408-4a8d-abf8-1e21392df96d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f669a1dfdc7c4aac85aeed0f24638862', 'request_id': 'req-e1b88764-4408-4a8d-abf8-1e21392df96d'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:13.746329 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-e1b88764-4408-4a8d-abf8-1e21392df96d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f669a1dfdc7c4aac85aeed0f24638862', 'request_id': 'req-e1b88764-4408-4a8d-abf8-1e21392df96d'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:13.752257 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-e1b88764-4408-4a8d-abf8-1e21392df96d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f669a1dfdc7c4aac85aeed0f24638862', 'request_id': 'req-e1b88764-4408-4a8d-abf8-1e21392df96d'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:13.764326 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-e1b88764-4408-4a8d-abf8-1e21392df96d admin admin] The token cache is being invalidate because project f669a1dfdc7c4aac85aeed0f24638862 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:00:13.764648 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-e1b88764-4408-4a8d-abf8-1e21392df96d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:13.765310 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-e1b88764-4408-4a8d-abf8-1e21392df96d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:13.766870 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1292/2587] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 17:00:13 2022] DELETE /identity/v3/projects/f669a1dfdc7c4aac85aeed0f24638862 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:00:13.772074 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc5aba-d64b-4732-872f-60f9c2511976 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:13.772564 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc5aba-d64b-4732-872f-60f9c2511976 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:13.772564 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc5aba-d64b-4732-872f-60f9c2511976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:13.791418 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-b8fc5aba-d64b-4732-872f-60f9c2511976 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:00:13.792676 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-b8fc5aba-d64b-4732-872f-60f9c2511976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:13.854680 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1296/2588] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:00:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:00:13.863166 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9efcff9-8acd-4445-97fd-8bb2008fc3e6 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:13.863480 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9efcff9-8acd-4445-97fd-8bb2008fc3e6 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:13.863783 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9efcff9-8acd-4445-97fd-8bb2008fc3e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:13.883380 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-a9efcff9-8acd-4445-97fd-8bb2008fc3e6 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:00:13.884771 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-a9efcff9-8acd-4445-97fd-8bb2008fc3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:13.893042 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1293/2589] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:00:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:00:13.897474 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc5aba-d64b-4732-872f-60f9c2511976 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:13.908209 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc5aba-d64b-4732-872f-60f9c2511976 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:13.913331 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5332be02-a33d-45fc-a0de-22a7bf8e0d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:13.914005 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5332be02-a33d-45fc-a0de-22a7bf8e0d92 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:13.914313 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5332be02-a33d-45fc-a0de-22a7bf8e0d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:13.914591 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5332be02-a33d-45fc-a0de-22a7bf8e0d92 admin admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:13.915412 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5332be02-a33d-45fc-a0de-22a7bf8e0d92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 17:00:13.915746 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5332be02-a33d-45fc-a0de-22a7bf8e0d92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:13.917554 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5332be02-a33d-45fc-a0de-22a7bf8e0d92 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:13.930620 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1297/2590] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Jul 18 17:00:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 17:00:13.935025 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9efcff9-8acd-4445-97fd-8bb2008fc3e6 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:13.944401 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9efcff9-8acd-4445-97fd-8bb2008fc3e6 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:13.949233 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5ccc84-1f3c-4a7e-9e61-a74fca84eeb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:13.949927 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ccc84-1f3c-4a7e-9e61-a74fca84eeb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:13.952089 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ccc84-1f3c-4a7e-9e61-a74fca84eeb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:13.952089 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ccc84-1f3c-4a7e-9e61-a74fca84eeb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:13.952089 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5ccc84-1f3c-4a7e-9e61-a74fca84eeb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:13.953708 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5ccc84-1f3c-4a7e-9e61-a74fca84eeb6 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:14.034473 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1294/2591] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 17:00:13 2022] POST /identity/v3/projects => generated 381 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:00:14.038505 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5332be02-a33d-45fc-a0de-22a7bf8e0d92 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:14.048877 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5332be02-a33d-45fc-a0de-22a7bf8e0d92 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:14.104460 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a6bbf8-00a8-47d5-b3ae-1142e7f552dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:14.105115 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a6bbf8-00a8-47d5-b3ae-1142e7f552dd admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:14.105399 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a6bbf8-00a8-47d5-b3ae-1142e7f552dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:14.105677 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a6bbf8-00a8-47d5-b3ae-1142e7f552dd admin admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:14.106364 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a6bbf8-00a8-47d5-b3ae-1142e7f552dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:14.108796 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a6bbf8-00a8-47d5-b3ae-1142e7f552dd admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:14.233938 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1298/2592] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 17:00:14 2022] POST /identity/v3/users => generated 291 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:00:14.238478 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5ccc84-1f3c-4a7e-9e61-a74fca84eeb6 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:14.249988 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5ccc84-1f3c-4a7e-9e61-a74fca84eeb6 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:14.254780 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e95fe87-8a2f-44ca-81d3-4ab140cb6abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:14.255703 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95fe87-8a2f-44ca-81d3-4ab140cb6abf admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:14.256023 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95fe87-8a2f-44ca-81d3-4ab140cb6abf admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:14.256482 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95fe87-8a2f-44ca-81d3-4ab140cb6abf admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:14.257212 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e95fe87-8a2f-44ca-81d3-4ab140cb6abf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:14.258804 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e95fe87-8a2f-44ca-81d3-4ab140cb6abf admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:14.269918 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1295/2593] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 17:00:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 17:00:14.274067 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a6bbf8-00a8-47d5-b3ae-1142e7f552dd admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:14.294986 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a6bbf8-00a8-47d5-b3ae-1142e7f552dd admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:14.300429 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a77c6e-0d95-442f-9b68-d17657c49991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:14.301075 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a77c6e-0d95-442f-9b68-d17657c49991 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:14.301358 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a77c6e-0d95-442f-9b68-d17657c49991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:14.301636 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a77c6e-0d95-442f-9b68-d17657c49991 admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:14.302365 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a77c6e-0d95-442f-9b68-d17657c49991 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:14.304082 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a77c6e-0d95-442f-9b68-d17657c49991 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:14.315695 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1299/2594] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 17:00:14 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:00:14.320090 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e95fe87-8a2f-44ca-81d3-4ab140cb6abf admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:14.330537 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e95fe87-8a2f-44ca-81d3-4ab140cb6abf admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:14.335328 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58525ad2-fff4-4e65-a938-91d72707703f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:14.336244 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58525ad2-fff4-4e65-a938-91d72707703f admin admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:14.336522 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58525ad2-fff4-4e65-a938-91d72707703f admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:14.336790 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58525ad2-fff4-4e65-a938-91d72707703f admin admin] PATH_INFO: `/v3/projects/c36917c9bc2647e0adb23af26ebd48d3/users/93b24f000bb04353ab629e9f17335a0d/roles/ad3a2bc7b2094a4da1a95a143c8d9436` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:14.353183 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58525ad2-fff4-4e65-a938-91d72707703f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c36917c9bc2647e0adb23af26ebd48d3, user_id=93b24f000bb04353ab629e9f17335a0d, role_id=ad3a2bc7b2094a4da1a95a143c8d9436)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:14.356006 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58525ad2-fff4-4e65-a938-91d72707703f admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:14.455918 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1296/2595] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 17:00:14 2022] PUT /identity/v3/projects/c36917c9bc2647e0adb23af26ebd48d3/users/93b24f000bb04353ab629e9f17335a0d/roles/ad3a2bc7b2094a4da1a95a143c8d9436 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:00:14.468252 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f0df7-edc9-4c05-b449-a444ff9a7053 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:14.468542 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f0df7-edc9-4c05-b449-a444ff9a7053 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:14.468823 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f0df7-edc9-4c05-b449-a444ff9a7053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:14.496898 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-3c1f0df7-edc9-4c05-b449-a444ff9a7053 None None] MFA Rules not processed for user `93b24f000bb04353ab629e9f17335a0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:00:14.498152 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-3c1f0df7-edc9-4c05-b449-a444ff9a7053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:14.548007 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:14.565843 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1300/2596] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:00:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:00:14.570470 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58525ad2-fff4-4e65-a938-91d72707703f admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:14.637944 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58525ad2-fff4-4e65-a938-91d72707703f admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:14.645277 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06d9bc-77e0-459e-a2ae-e53584718a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:14.645953 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06d9bc-77e0-459e-a2ae-e53584718a1b admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:14.646233 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06d9bc-77e0-459e-a2ae-e53584718a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:14.646506 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06d9bc-77e0-459e-a2ae-e53584718a1b admin admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:14.647291 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a06d9bc-77e0-459e-a2ae-e53584718a1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:14.649332 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a06d9bc-77e0-459e-a2ae-e53584718a1b admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:14.656964 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:14.771233 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1297/2597] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 17:00:14 2022] POST /identity/v3/projects => generated 381 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 17:00:14.775130 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f0df7-edc9-4c05-b449-a444ff9a7053 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:14.786342 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f0df7-edc9-4c05-b449-a444ff9a7053 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:14.851096 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306d66d3-4a36-4c01-9234-6c40f7ec4788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:14.851815 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d66d3-4a36-4c01-9234-6c40f7ec4788 admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:14.852096 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d66d3-4a36-4c01-9234-6c40f7ec4788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:14.852364 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d66d3-4a36-4c01-9234-6c40f7ec4788 admin admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:14.853077 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306d66d3-4a36-4c01-9234-6c40f7ec4788 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:14.855030 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306d66d3-4a36-4c01-9234-6c40f7ec4788 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:14.975176 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1301/2598] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 17:00:14 2022] POST /identity/v3/users => generated 297 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:00:14.976394 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06d9bc-77e0-459e-a2ae-e53584718a1b admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:14.986740 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06d9bc-77e0-459e-a2ae-e53584718a1b admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:14.991344 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42afd1f-8b68-4e7b-b4d0-8468d8f043ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:14.992100 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42afd1f-8b68-4e7b-b4d0-8468d8f043ce admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:14.992386 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42afd1f-8b68-4e7b-b4d0-8468d8f043ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:14.992658 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42afd1f-8b68-4e7b-b4d0-8468d8f043ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:14.993384 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42afd1f-8b68-4e7b-b4d0-8468d8f043ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:14.995048 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42afd1f-8b68-4e7b-b4d0-8468d8f043ce admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:15.006372 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1298/2599] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 17:00:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 17:00:15.011040 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306d66d3-4a36-4c01-9234-6c40f7ec4788 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:15.022991 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306d66d3-4a36-4c01-9234-6c40f7ec4788 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:15.027788 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246be446-81f5-497c-bd85-6d562f115c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:15.028682 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246be446-81f5-497c-bd85-6d562f115c36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:15.028966 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246be446-81f5-497c-bd85-6d562f115c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:15.029244 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246be446-81f5-497c-bd85-6d562f115c36 admin admin] PATH_INFO: `/v3/projects/49dd367ca7f14c9688a89950b546e009/users/56bbaa797eb54b05a902b273bae8cd75/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:15.045703 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246be446-81f5-497c-bd85-6d562f115c36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49dd367ca7f14c9688a89950b546e009, user_id=56bbaa797eb54b05a902b273bae8cd75, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:15.048428 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246be446-81f5-497c-bd85-6d562f115c36 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:15.221008 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1302/2600] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 17:00:15 2022] PUT /identity/v3/projects/49dd367ca7f14c9688a89950b546e009/users/56bbaa797eb54b05a902b273bae8cd75/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:00:15.226259 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42afd1f-8b68-4e7b-b4d0-8468d8f043ce admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:15.236844 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42afd1f-8b68-4e7b-b4d0-8468d8f043ce admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:15.303501 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0baad03-1aa9-411f-9f8d-75b97b6f44e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:15.304466 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0baad03-1aa9-411f-9f8d-75b97b6f44e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:15.304755 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0baad03-1aa9-411f-9f8d-75b97b6f44e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:15.305045 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0baad03-1aa9-411f-9f8d-75b97b6f44e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:15.305955 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0baad03-1aa9-411f-9f8d-75b97b6f44e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:15.308021 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0baad03-1aa9-411f-9f8d-75b97b6f44e0 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:15.320202 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1299/2601] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 17:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:00:15.324745 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246be446-81f5-497c-bd85-6d562f115c36 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:15.336023 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246be446-81f5-497c-bd85-6d562f115c36 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:15.341041 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e6ea0-2ac0-44ce-9db4-835bb71161db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:15.341896 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e6ea0-2ac0-44ce-9db4-835bb71161db admin admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:15.342212 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e6ea0-2ac0-44ce-9db4-835bb71161db admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:15.342492 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e6ea0-2ac0-44ce-9db4-835bb71161db admin admin] PATH_INFO: `/v3/projects/49dd367ca7f14c9688a89950b546e009/users/56bbaa797eb54b05a902b273bae8cd75/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:15.344521 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1e6ea0-2ac0-44ce-9db4-835bb71161db admin admin] RBAC: Authorizing `identity:create_grant(project_id=49dd367ca7f14c9688a89950b546e009, user_id=56bbaa797eb54b05a902b273bae8cd75, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:15.347217 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1e6ea0-2ac0-44ce-9db4-835bb71161db admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:15.358400 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1303/2602] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 17:00:15 2022] PUT /identity/v3/projects/49dd367ca7f14c9688a89950b546e009/users/56bbaa797eb54b05a902b273bae8cd75/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:00:15.374540 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b37753a-e2ca-47aa-a37f-8a155ccbcd3d None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:15.374955 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b37753a-e2ca-47aa-a37f-8a155ccbcd3d None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:15.375309 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b37753a-e2ca-47aa-a37f-8a155ccbcd3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:15.405753 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-0b37753a-e2ca-47aa-a37f-8a155ccbcd3d None None] MFA Rules not processed for user `56bbaa797eb54b05a902b273bae8cd75`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:00:15.406979 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-0b37753a-e2ca-47aa-a37f-8a155ccbcd3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:15.480781 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1300/2603] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:00:15 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:00:15.495519 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e6ea0-2ac0-44ce-9db4-835bb71161db admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:15.497430 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-3e1e6ea0-2ac0-44ce-9db4-835bb71161db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:15.570263 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e6ea0-2ac0-44ce-9db4-835bb71161db admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:15.574124 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c990c297-af53-460c-bf3b-0acb0da939a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:15.574799 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c990c297-af53-460c-bf3b-0acb0da939a7 service cinder] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:15.575081 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c990c297-af53-460c-bf3b-0acb0da939a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:15.575355 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c990c297-af53-460c-bf3b-0acb0da939a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:15.584838 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c990c297-af53-460c-bf3b-0acb0da939a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:15.586264 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c990c297-af53-460c-bf3b-0acb0da939a7 service cinder] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:15.595960 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1304/2604] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 17:00:15 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:00:15.862947 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b37753a-e2ca-47aa-a37f-8a155ccbcd3d None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:15.873026 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b37753a-e2ca-47aa-a37f-8a155ccbcd3d None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:15.877274 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6728b1bf-2d11-4921-8858-379655539d70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:15.877916 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728b1bf-2d11-4921-8858-379655539d70 service cinder] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:15.878200 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728b1bf-2d11-4921-8858-379655539d70 service cinder] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:15.878477 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728b1bf-2d11-4921-8858-379655539d70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:15.935329 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:15.938283 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6728b1bf-2d11-4921-8858-379655539d70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:15.939859 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6728b1bf-2d11-4921-8858-379655539d70 service cinder] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:15.949240 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1301/2605] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 17:00:15 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:00:23.958637 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c990c297-af53-460c-bf3b-0acb0da939a7 service cinder] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:23.960154 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-c990c297-af53-460c-bf3b-0acb0da939a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:24.011314 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:24.027864 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c990c297-af53-460c-bf3b-0acb0da939a7 service cinder] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:24.033086 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ad7aa-61da-48a2-bbaa-e915c263d473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:24.033956 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ad7aa-61da-48a2-bbaa-e915c263d473 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:24.034237 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ad7aa-61da-48a2-bbaa-e915c263d473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:24.034510 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ad7aa-61da-48a2-bbaa-e915c263d473 admin admin] PATH_INFO: `/v3/users/65f978c0ce4640bfb28d3f002e465f28` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:24.035750 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9ad7aa-61da-48a2-bbaa-e915c263d473 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65f978c0ce4640bfb28d3f002e465f28)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:24.037695 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9ad7aa-61da-48a2-bbaa-e915c263d473 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:24.223444 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-fd9ad7aa-61da-48a2-bbaa-e915c263d473 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65f978c0ce4640bfb28d3f002e465f28'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:24.235603 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-fd9ad7aa-61da-48a2-bbaa-e915c263d473 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65f978c0ce4640bfb28d3f002e465f28'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:24.236309 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-fd9ad7aa-61da-48a2-bbaa-e915c263d473 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65f978c0ce4640bfb28d3f002e465f28'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:24.243316 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-fd9ad7aa-61da-48a2-bbaa-e915c263d473 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65f978c0ce4640bfb28d3f002e465f28'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:24.317320 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-fd9ad7aa-61da-48a2-bbaa-e915c263d473 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65f978c0ce4640bfb28d3f002e465f28'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:24.323419 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1305/2606] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 17:00:23 2022] DELETE /identity/v3/users/65f978c0ce4640bfb28d3f002e465f28 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:00:24.328501 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d19fc2-36e6-4c0f-879d-c61cb4772701 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:24.328976 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d19fc2-36e6-4c0f-879d-c61cb4772701 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:24.332119 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d19fc2-36e6-4c0f-879d-c61cb4772701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:24.347683 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-18d19fc2-36e6-4c0f-879d-c61cb4772701 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:00:24.348918 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-18d19fc2-36e6-4c0f-879d-c61cb4772701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:24.407669 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1302/2607] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:00:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:00:24.417334 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ad7aa-61da-48a2-bbaa-e915c263d473 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:24.418733 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-fd9ad7aa-61da-48a2-bbaa-e915c263d473 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:24.476870 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ad7aa-61da-48a2-bbaa-e915c263d473 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:24.480526 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31062f0-9ae9-4b4d-8553-c8d067fe7b92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:24.481178 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31062f0-9ae9-4b4d-8553-c8d067fe7b92 service neutron] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:24.481464 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31062f0-9ae9-4b4d-8553-c8d067fe7b92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:24.481741 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31062f0-9ae9-4b4d-8553-c8d067fe7b92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:24.491447 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31062f0-9ae9-4b4d-8553-c8d067fe7b92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:24.492920 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31062f0-9ae9-4b4d-8553-c8d067fe7b92 service neutron] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:24.503176 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1306/2608] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 17:00:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:00:24.993218 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d19fc2-36e6-4c0f-879d-c61cb4772701 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:24.994958 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-18d19fc2-36e6-4c0f-879d-c61cb4772701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:25.007685 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d19fc2-36e6-4c0f-879d-c61cb4772701 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:25.012508 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3a91e6-5d94-491a-ae63-9db696b892ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:25.013374 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a91e6-5d94-491a-ae63-9db696b892ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:25.013652 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a91e6-5d94-491a-ae63-9db696b892ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:25.013932 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a91e6-5d94-491a-ae63-9db696b892ec admin admin] PATH_INFO: `/v3/projects/40f5b14e139b4aeebd529e4cb0eed573` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:25.015123 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3a91e6-5d94-491a-ae63-9db696b892ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=40f5b14e139b4aeebd529e4cb0eed573)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:25.017597 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3a91e6-5d94-491a-ae63-9db696b892ec admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:25.171127 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-3a3a91e6-5d94-491a-ae63-9db696b892ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40f5b14e139b4aeebd529e4cb0eed573', 'request_id': 'req-3a3a91e6-5d94-491a-ae63-9db696b892ec'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:25.283420 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-3a3a91e6-5d94-491a-ae63-9db696b892ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40f5b14e139b4aeebd529e4cb0eed573', 'request_id': 'req-3a3a91e6-5d94-491a-ae63-9db696b892ec'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:25.289751 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-3a3a91e6-5d94-491a-ae63-9db696b892ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40f5b14e139b4aeebd529e4cb0eed573', 'request_id': 'req-3a3a91e6-5d94-491a-ae63-9db696b892ec'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:25.301309 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-3a3a91e6-5d94-491a-ae63-9db696b892ec admin admin] The token cache is being invalidate because project 40f5b14e139b4aeebd529e4cb0eed573 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:00:25.301593 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-3a3a91e6-5d94-491a-ae63-9db696b892ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:25.307089 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-3a3a91e6-5d94-491a-ae63-9db696b892ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:25.307089 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1303/2609] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 17:00:24 2022] DELETE /identity/v3/projects/40f5b14e139b4aeebd529e4cb0eed573 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:00:25.307950 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31062f0-9ae9-4b4d-8553-c8d067fe7b92 service neutron] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:25.318378 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31062f0-9ae9-4b4d-8553-c8d067fe7b92 service neutron] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:25.375500 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b5f956-93b8-4090-a421-0439d62a97c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:25.376445 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5f956-93b8-4090-a421-0439d62a97c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:25.376726 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5f956-93b8-4090-a421-0439d62a97c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:25.376998 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5f956-93b8-4090-a421-0439d62a97c1 admin admin] PATH_INFO: `/v3/users/923556f486b54fb3a97f3e034db2705a` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:25.378179 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b5f956-93b8-4090-a421-0439d62a97c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=923556f486b54fb3a97f3e034db2705a)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:25.380171 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b5f956-93b8-4090-a421-0439d62a97c1 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:25.396834 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:25.640586 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-55b5f956-93b8-4090-a421-0439d62a97c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '923556f486b54fb3a97f3e034db2705a'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:25.652523 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-55b5f956-93b8-4090-a421-0439d62a97c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '923556f486b54fb3a97f3e034db2705a'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:25.653167 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-55b5f956-93b8-4090-a421-0439d62a97c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '923556f486b54fb3a97f3e034db2705a'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:25.660590 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-55b5f956-93b8-4090-a421-0439d62a97c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '923556f486b54fb3a97f3e034db2705a'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:25.740317 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-55b5f956-93b8-4090-a421-0439d62a97c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '923556f486b54fb3a97f3e034db2705a'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:25.747655 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1307/2610] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 17:00:25 2022] DELETE /identity/v3/users/923556f486b54fb3a97f3e034db2705a => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:00:26.234501 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3a91e6-5d94-491a-ae63-9db696b892ec admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:26.236499 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-3a3a91e6-5d94-491a-ae63-9db696b892ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:26.254301 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3a91e6-5d94-491a-ae63-9db696b892ec admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:26.319373 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f6ea15-8b9c-4136-88c1-0fd73a8ad592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:26.320265 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f6ea15-8b9c-4136-88c1-0fd73a8ad592 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:26.320546 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f6ea15-8b9c-4136-88c1-0fd73a8ad592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:26.320822 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f6ea15-8b9c-4136-88c1-0fd73a8ad592 admin admin] PATH_INFO: `/v3/projects/2b1c763bc6ee45ad90a946ae6767f22a` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:26.322009 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f6ea15-8b9c-4136-88c1-0fd73a8ad592 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b1c763bc6ee45ad90a946ae6767f22a)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:26.323929 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f6ea15-8b9c-4136-88c1-0fd73a8ad592 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:26.348817 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:26.500969 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-25f6ea15-8b9c-4136-88c1-0fd73a8ad592 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b1c763bc6ee45ad90a946ae6767f22a', 'request_id': 'req-25f6ea15-8b9c-4136-88c1-0fd73a8ad592'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:26.613563 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b5f956-93b8-4090-a421-0439d62a97c1 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:26.614981 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-55b5f956-93b8-4090-a421-0439d62a97c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:26.626920 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-25f6ea15-8b9c-4136-88c1-0fd73a8ad592 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b1c763bc6ee45ad90a946ae6767f22a', 'request_id': 'req-25f6ea15-8b9c-4136-88c1-0fd73a8ad592'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:26.630593 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b5f956-93b8-4090-a421-0439d62a97c1 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:26.633617 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-25f6ea15-8b9c-4136-88c1-0fd73a8ad592 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b1c763bc6ee45ad90a946ae6767f22a', 'request_id': 'req-25f6ea15-8b9c-4136-88c1-0fd73a8ad592'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:26.645978 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-25f6ea15-8b9c-4136-88c1-0fd73a8ad592 admin admin] The token cache is being invalidate because project 2b1c763bc6ee45ad90a946ae6767f22a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:00:26.646295 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-25f6ea15-8b9c-4136-88c1-0fd73a8ad592 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:26.646943 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-25f6ea15-8b9c-4136-88c1-0fd73a8ad592 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:26.648534 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1304/2611] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 17:00:26 2022] DELETE /identity/v3/projects/2b1c763bc6ee45ad90a946ae6767f22a => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:00:26.653349 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c73600-bdb8-45d3-9a4f-69f419fad31c None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:26.653642 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c73600-bdb8-45d3-9a4f-69f419fad31c None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:26.653927 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c73600-bdb8-45d3-9a4f-69f419fad31c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:26.672333 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-50c73600-bdb8-45d3-9a4f-69f419fad31c None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:00:26.673731 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-50c73600-bdb8-45d3-9a4f-69f419fad31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:26.697569 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7f8787-1b7e-4311-aa34-8337c73ec37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:26.698522 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f8787-1b7e-4311-aa34-8337c73ec37f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:26.698808 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f8787-1b7e-4311-aa34-8337c73ec37f admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:26.699088 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f8787-1b7e-4311-aa34-8337c73ec37f admin admin] PATH_INFO: `/v3/users/93b24f000bb04353ab629e9f17335a0d` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:26.700347 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7f8787-1b7e-4311-aa34-8337c73ec37f admin admin] RBAC: Authorizing `identity:delete_user(user_id=93b24f000bb04353ab629e9f17335a0d)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:26.702282 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7f8787-1b7e-4311-aa34-8337c73ec37f admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:26.734698 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1305/2612] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:00:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 17:00:26.742846 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5d14b4-07c8-42c4-9c6b-e8ba71cf7b24 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:26.743135 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5d14b4-07c8-42c4-9c6b-e8ba71cf7b24 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:26.743413 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5d14b4-07c8-42c4-9c6b-e8ba71cf7b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:26.761848 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-de5d14b4-07c8-42c4-9c6b-e8ba71cf7b24 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:00:26.763043 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-de5d14b4-07c8-42c4-9c6b-e8ba71cf7b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:26.771020 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1306/2613] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:00:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 17:00:26.774885 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5d14b4-07c8-42c4-9c6b-e8ba71cf7b24 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:26.783519 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5d14b4-07c8-42c4-9c6b-e8ba71cf7b24 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:26.788128 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd72e7e-7df5-40ca-bf08-f2dcfeefd806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:26.788733 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd72e7e-7df5-40ca-bf08-f2dcfeefd806 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:26.789013 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd72e7e-7df5-40ca-bf08-f2dcfeefd806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:26.789288 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd72e7e-7df5-40ca-bf08-f2dcfeefd806 admin admin] PATH_INFO: `/v3/domains` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:26.790105 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd72e7e-7df5-40ca-bf08-f2dcfeefd806 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 17:00:26.790413 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd72e7e-7df5-40ca-bf08-f2dcfeefd806 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:26.792014 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd72e7e-7df5-40ca-bf08-f2dcfeefd806 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:26.803733 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1307/2614] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Jul 18 17:00:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 17:00:26.808224 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd72e7e-7df5-40ca-bf08-f2dcfeefd806 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:26.818138 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd72e7e-7df5-40ca-bf08-f2dcfeefd806 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:26.822693 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8133d07-c8f2-41b7-bdbf-6773dc272629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:26.823293 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8133d07-c8f2-41b7-bdbf-6773dc272629 admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:26.823576 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8133d07-c8f2-41b7-bdbf-6773dc272629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:26.823887 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8133d07-c8f2-41b7-bdbf-6773dc272629 admin admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:26.824627 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8133d07-c8f2-41b7-bdbf-6773dc272629 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:26.826460 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8133d07-c8f2-41b7-bdbf-6773dc272629 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:26.907619 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-ab7f8787-1b7e-4311-aa34-8337c73ec37f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93b24f000bb04353ab629e9f17335a0d'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:26.920066 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-ab7f8787-1b7e-4311-aa34-8337c73ec37f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93b24f000bb04353ab629e9f17335a0d'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:26.920770 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-ab7f8787-1b7e-4311-aa34-8337c73ec37f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93b24f000bb04353ab629e9f17335a0d'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:26.928686 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-ab7f8787-1b7e-4311-aa34-8337c73ec37f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93b24f000bb04353ab629e9f17335a0d'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:26.930365 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1308/2615] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 17:00:26 2022] POST /identity/v3/projects => generated 391 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 17:00:26.934623 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8133d07-c8f2-41b7-bdbf-6773dc272629 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:26.994197 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8133d07-c8f2-41b7-bdbf-6773dc272629 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:26.998769 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39df087-a64f-4b80-8935-9607bca5ce03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:26.999449 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39df087-a64f-4b80-8935-9607bca5ce03 admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:27.000287 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39df087-a64f-4b80-8935-9607bca5ce03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:27.000563 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39df087-a64f-4b80-8935-9607bca5ce03 admin admin] PATH_INFO: `/v3/users` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:27.001299 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39df087-a64f-4b80-8935-9607bca5ce03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:27.003203 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39df087-a64f-4b80-8935-9607bca5ce03 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:27.020410 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-ab7f8787-1b7e-4311-aa34-8337c73ec37f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93b24f000bb04353ab629e9f17335a0d'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:27.026749 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1308/2616] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 17:00:26 2022] DELETE /identity/v3/users/93b24f000bb04353ab629e9f17335a0d => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 17:00:27.031119 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9edfbe-bb78-4d48-aec5-60c6261c5de9 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:27.031400 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9edfbe-bb78-4d48-aec5-60c6261c5de9 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:27.031676 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9edfbe-bb78-4d48-aec5-60c6261c5de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:27.043135 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:27.049624 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-cb9edfbe-bb78-4d48-aec5-60c6261c5de9 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:00:27.050697 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-cb9edfbe-bb78-4d48-aec5-60c6261c5de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:27.106815 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1309/2617] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:00:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 17:00:27.116872 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9edfbe-bb78-4d48-aec5-60c6261c5de9 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:27.118190 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-cb9edfbe-bb78-4d48-aec5-60c6261c5de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:27.172515 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9edfbe-bb78-4d48-aec5-60c6261c5de9 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:27.176090 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b204f-c36e-47cb-bf2a-600a49f3854d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:27.176725 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b204f-c36e-47cb-bf2a-600a49f3854d service neutron] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:27.177003 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b204f-c36e-47cb-bf2a-600a49f3854d service neutron] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:27.177275 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b204f-c36e-47cb-bf2a-600a49f3854d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:27.186092 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3b204f-c36e-47cb-bf2a-600a49f3854d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:27.187510 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3b204f-c36e-47cb-bf2a-600a49f3854d service neutron] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:27.192324 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:27.196800 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1310/2618] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 17:00:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 17:00:27.201602 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1309/2619] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 17:00:26 2022] POST /identity/v3/users => generated 296 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 17:00:27.202653 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b204f-c36e-47cb-bf2a-600a49f3854d service neutron] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:27.204762 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-fe3b204f-c36e-47cb-bf2a-600a49f3854d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:27.217224 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b204f-c36e-47cb-bf2a-600a49f3854d service neutron] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:27.222378 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1627cb3e-fcb2-41a3-8c81-6806aa711409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:27.223035 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627cb3e-fcb2-41a3-8c81-6806aa711409 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:27.223313 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627cb3e-fcb2-41a3-8c81-6806aa711409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:27.223584 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627cb3e-fcb2-41a3-8c81-6806aa711409 admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:27.224340 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1627cb3e-fcb2-41a3-8c81-6806aa711409 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:27.225921 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1627cb3e-fcb2-41a3-8c81-6806aa711409 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:27.237092 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1311/2620] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 17:00:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:00:27.241335 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39df087-a64f-4b80-8935-9607bca5ce03 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:27.251683 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39df087-a64f-4b80-8935-9607bca5ce03 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:27.256792 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d458a5-be44-4986-8425-a66df1f67b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:27.257454 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d458a5-be44-4986-8425-a66df1f67b53 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:27.257747 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d458a5-be44-4986-8425-a66df1f67b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:27.258022 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d458a5-be44-4986-8425-a66df1f67b53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:27.258787 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d458a5-be44-4986-8425-a66df1f67b53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:27.260474 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d458a5-be44-4986-8425-a66df1f67b53 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:27.271098 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1310/2621] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 17:00:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:00:27.274864 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1627cb3e-fcb2-41a3-8c81-6806aa711409 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:27.285643 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1627cb3e-fcb2-41a3-8c81-6806aa711409 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:27.290912 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7bdc76-6185-49f1-86de-2979a27e4a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:27.291815 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7bdc76-6185-49f1-86de-2979a27e4a91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:27.292102 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7bdc76-6185-49f1-86de-2979a27e4a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:27.292379 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7bdc76-6185-49f1-86de-2979a27e4a91 admin admin] PATH_INFO: `/v3/projects/4e29525e9aa24e2984e98eeb5d4f50aa/users/b747973ab44346b3a88b0234d020aea6/roles/ad3a2bc7b2094a4da1a95a143c8d9436` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:27.307798 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7bdc76-6185-49f1-86de-2979a27e4a91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e29525e9aa24e2984e98eeb5d4f50aa, user_id=b747973ab44346b3a88b0234d020aea6, role_id=ad3a2bc7b2094a4da1a95a143c8d9436)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:27.310468 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7bdc76-6185-49f1-86de-2979a27e4a91 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:27.483521 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1312/2622] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 17:00:27 2022] PUT /identity/v3/projects/4e29525e9aa24e2984e98eeb5d4f50aa/users/b747973ab44346b3a88b0234d020aea6/roles/ad3a2bc7b2094a4da1a95a143c8d9436 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:00:27.484814 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e4d95d-8241-4e78-9d77-c9b2aa6cfdf3 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:27.485108 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e4d95d-8241-4e78-9d77-c9b2aa6cfdf3 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:27.485389 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e4d95d-8241-4e78-9d77-c9b2aa6cfdf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:27.517777 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-81e4d95d-8241-4e78-9d77-c9b2aa6cfdf3 None None] MFA Rules not processed for user `b747973ab44346b3a88b0234d020aea6`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:00:27.519298 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-81e4d95d-8241-4e78-9d77-c9b2aa6cfdf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:27.586644 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1311/2623] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:00:27 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:00:27.591140 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7bdc76-6185-49f1-86de-2979a27e4a91 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:27.653536 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7bdc76-6185-49f1-86de-2979a27e4a91 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:27.659940 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0099f442-50db-4530-b356-5e3dc25c0333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:27.660599 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0099f442-50db-4530-b356-5e3dc25c0333 admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:27.660882 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0099f442-50db-4530-b356-5e3dc25c0333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:27.662983 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0099f442-50db-4530-b356-5e3dc25c0333 admin admin] PATH_INFO: `/v3/projects` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:27.662983 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0099f442-50db-4530-b356-5e3dc25c0333 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:27.663849 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0099f442-50db-4530-b356-5e3dc25c0333 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:27.730618 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e4d95d-8241-4e78-9d77-c9b2aa6cfdf3 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:27.732071 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-81e4d95d-8241-4e78-9d77-c9b2aa6cfdf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:27.746670 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e4d95d-8241-4e78-9d77-c9b2aa6cfdf3 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:27.753083 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:27.755033 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305188a8-c76e-4f69-8534-e20cd5a7fdf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:27.755033 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305188a8-c76e-4f69-8534-e20cd5a7fdf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:27.755033 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305188a8-c76e-4f69-8534-e20cd5a7fdf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:27.755033 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305188a8-c76e-4f69-8534-e20cd5a7fdf4 admin admin] PATH_INFO: `/v3/projects/c36917c9bc2647e0adb23af26ebd48d3` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:27.756723 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305188a8-c76e-4f69-8534-e20cd5a7fdf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c36917c9bc2647e0adb23af26ebd48d3)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:27.759545 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305188a8-c76e-4f69-8534-e20cd5a7fdf4 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:27.763203 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1313/2624] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 17:00:27 2022] POST /identity/v3/projects => generated 391 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:00:27.764529 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0099f442-50db-4530-b356-5e3dc25c0333 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:27.831591 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0099f442-50db-4530-b356-5e3dc25c0333 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:27.836415 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb208b-bcb6-4406-a77f-f4a682cc033b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:27.837107 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb208b-bcb6-4406-a77f-f4a682cc033b admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:27.837396 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb208b-bcb6-4406-a77f-f4a682cc033b admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:27.837672 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb208b-bcb6-4406-a77f-f4a682cc033b admin admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:27.838382 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bb208b-bcb6-4406-a77f-f4a682cc033b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:27.840397 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bb208b-bcb6-4406-a77f-f4a682cc033b admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:27.918303 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-305188a8-c76e-4f69-8534-e20cd5a7fdf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c36917c9bc2647e0adb23af26ebd48d3', 'request_id': 'req-305188a8-c76e-4f69-8534-e20cd5a7fdf4'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:27.934742 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1314/2625] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 17:00:27 2022] POST /identity/v3/users => generated 302 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:00:27.939212 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb208b-bcb6-4406-a77f-f4a682cc033b admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:27.948901 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb208b-bcb6-4406-a77f-f4a682cc033b admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:28.004393 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168c4d33-527f-411e-bc3c-de31c9c473fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:28.005061 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c4d33-527f-411e-bc3c-de31c9c473fa admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:28.005604 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c4d33-527f-411e-bc3c-de31c9c473fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:28.005887 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c4d33-527f-411e-bc3c-de31c9c473fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:28.006614 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168c4d33-527f-411e-bc3c-de31c9c473fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:28.008239 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168c4d33-527f-411e-bc3c-de31c9c473fa admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:28.018493 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1315/2626] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 17:00:27 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 17:00:28.022499 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168c4d33-527f-411e-bc3c-de31c9c473fa admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:28.026589 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-305188a8-c76e-4f69-8534-e20cd5a7fdf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c36917c9bc2647e0adb23af26ebd48d3', 'request_id': 'req-305188a8-c76e-4f69-8534-e20cd5a7fdf4'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:28.033042 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168c4d33-527f-411e-bc3c-de31c9c473fa admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:28.037365 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-305188a8-c76e-4f69-8534-e20cd5a7fdf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c36917c9bc2647e0adb23af26ebd48d3', 'request_id': 'req-305188a8-c76e-4f69-8534-e20cd5a7fdf4'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:28.038897 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf62d1-0fc3-4467-8c9b-5b505b4b2126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:28.039955 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf62d1-0fc3-4467-8c9b-5b505b4b2126 admin admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:28.040241 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf62d1-0fc3-4467-8c9b-5b505b4b2126 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:28.040518 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf62d1-0fc3-4467-8c9b-5b505b4b2126 admin admin] PATH_INFO: `/v3/projects/1cc0dfead1284ecab652c1b999c9b422/users/792909d9e2584f1ea0f188216e02670a/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:28.053319 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-305188a8-c76e-4f69-8534-e20cd5a7fdf4 admin admin] The token cache is being invalidate because project c36917c9bc2647e0adb23af26ebd48d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:00:28.057867 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-305188a8-c76e-4f69-8534-e20cd5a7fdf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:28.057867 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-305188a8-c76e-4f69-8534-e20cd5a7fdf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:28.057867 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1312/2627] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 17:00:27 2022] DELETE /identity/v3/projects/c36917c9bc2647e0adb23af26ebd48d3 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 17:00:28.058257 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bf62d1-0fc3-4467-8c9b-5b505b4b2126 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cc0dfead1284ecab652c1b999c9b422, user_id=792909d9e2584f1ea0f188216e02670a, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:28.059111 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bf62d1-0fc3-4467-8c9b-5b505b4b2126 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:28.059825 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305188a8-c76e-4f69-8534-e20cd5a7fdf4 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:28.061132 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-305188a8-c76e-4f69-8534-e20cd5a7fdf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:28.074763 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305188a8-c76e-4f69-8534-e20cd5a7fdf4 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:28.079947 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a7b117-fa45-42d4-9c0e-91841d1c6dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:28.080809 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a7b117-fa45-42d4-9c0e-91841d1c6dab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:28.081088 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a7b117-fa45-42d4-9c0e-91841d1c6dab admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:28.081365 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a7b117-fa45-42d4-9c0e-91841d1c6dab admin admin] PATH_INFO: `/v3/users/56bbaa797eb54b05a902b273bae8cd75` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:28.082555 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a7b117-fa45-42d4-9c0e-91841d1c6dab admin admin] RBAC: Authorizing `identity:delete_user(user_id=56bbaa797eb54b05a902b273bae8cd75)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:28.084501 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a7b117-fa45-42d4-9c0e-91841d1c6dab admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:28.214339 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1316/2628] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 17:00:28 2022] PUT /identity/v3/projects/1cc0dfead1284ecab652c1b999c9b422/users/792909d9e2584f1ea0f188216e02670a/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 17:00:28.218139 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf62d1-0fc3-4467-8c9b-5b505b4b2126 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:28.219761 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-50bf62d1-0fc3-4467-8c9b-5b505b4b2126 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:28.283702 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf62d1-0fc3-4467-8c9b-5b505b4b2126 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:28.288294 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b60c75-6142-417a-904a-2a43c40748c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:28.288955 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b60c75-6142-417a-904a-2a43c40748c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:28.289237 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b60c75-6142-417a-904a-2a43c40748c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:28.289514 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b60c75-6142-417a-904a-2a43c40748c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:28.290233 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b60c75-6142-417a-904a-2a43c40748c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:28.291854 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b60c75-6142-417a-904a-2a43c40748c0 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:28.293941 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:28.302478 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1317/2629] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 17:00:28 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 17:00:28.306512 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b60c75-6142-417a-904a-2a43c40748c0 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:28.316786 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b60c75-6142-417a-904a-2a43c40748c0 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:28.321839 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2134b3df-36e2-4e80-a09c-03b692970d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:28.322217 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2134b3df-36e2-4e80-a09c-03b692970d29 admin admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:28.322500 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2134b3df-36e2-4e80-a09c-03b692970d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:28.322777 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2134b3df-36e2-4e80-a09c-03b692970d29 admin admin] PATH_INFO: `/v3/projects/1cc0dfead1284ecab652c1b999c9b422/users/792909d9e2584f1ea0f188216e02670a/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:28.324796 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2134b3df-36e2-4e80-a09c-03b692970d29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cc0dfead1284ecab652c1b999c9b422, user_id=792909d9e2584f1ea0f188216e02670a, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:28.327425 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2134b3df-36e2-4e80-a09c-03b692970d29 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:28.337338 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1318/2630] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 17:00:28 2022] PUT /identity/v3/projects/1cc0dfead1284ecab652c1b999c9b422/users/792909d9e2584f1ea0f188216e02670a/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:00:28.348227 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b3442-c54a-4966-86c6-1795de5b20cd None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:28.348613 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b3442-c54a-4966-86c6-1795de5b20cd None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:28.348801 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b3442-c54a-4966-86c6-1795de5b20cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:28.376281 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-822b3442-c54a-4966-86c6-1795de5b20cd None None] MFA Rules not processed for user `792909d9e2584f1ea0f188216e02670a`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:00:28.377503 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-822b3442-c54a-4966-86c6-1795de5b20cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:28.412405 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-62a7b117-fa45-42d4-9c0e-91841d1c6dab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56bbaa797eb54b05a902b273bae8cd75'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:28.413052 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-62a7b117-fa45-42d4-9c0e-91841d1c6dab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56bbaa797eb54b05a902b273bae8cd75'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:28.418682 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:28.425983 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-62a7b117-fa45-42d4-9c0e-91841d1c6dab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56bbaa797eb54b05a902b273bae8cd75'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:28.444782 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1319/2631] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:00:28 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 17:00:28.455829 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b3442-c54a-4966-86c6-1795de5b20cd None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:28.457235 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-822b3442-c54a-4966-86c6-1795de5b20cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:28.515505 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b3442-c54a-4966-86c6-1795de5b20cd None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:28.519162 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039b9588-952b-457d-8c9c-43c536dd7cea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:28.519848 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b9588-952b-457d-8c9c-43c536dd7cea service cinder] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:28.520131 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b9588-952b-457d-8c9c-43c536dd7cea service cinder] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:28.520406 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b9588-952b-457d-8c9c-43c536dd7cea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:28.529358 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039b9588-952b-457d-8c9c-43c536dd7cea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:28.531359 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039b9588-952b-457d-8c9c-43c536dd7cea service cinder] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:28.545161 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1320/2632] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 17:00:28 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 17:00:28.563607 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-62a7b117-fa45-42d4-9c0e-91841d1c6dab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56bbaa797eb54b05a902b273bae8cd75'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:28.571547 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-62a7b117-fa45-42d4-9c0e-91841d1c6dab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56bbaa797eb54b05a902b273bae8cd75'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:28.581020 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1313/2633] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 17:00:28 2022] DELETE /identity/v3/users/56bbaa797eb54b05a902b273bae8cd75 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:00:28.588553 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039b9588-952b-457d-8c9c-43c536dd7cea service cinder] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:28.589985 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-039b9588-952b-457d-8c9c-43c536dd7cea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:28.602161 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039b9588-952b-457d-8c9c-43c536dd7cea service cinder] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:28.651879 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401efe28-af9f-422c-9898-055b1e5655ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:28.652538 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401efe28-af9f-422c-9898-055b1e5655ff service cinder] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:28.652844 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401efe28-af9f-422c-9898-055b1e5655ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:28.653157 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401efe28-af9f-422c-9898-055b1e5655ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:28.655065 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-401efe28-af9f-422c-9898-055b1e5655ff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:28.714098 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401efe28-af9f-422c-9898-055b1e5655ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:28.715534 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401efe28-af9f-422c-9898-055b1e5655ff service cinder] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:28.724863 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1321/2634] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 17:00:28 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:00:28.769370 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:29.051076 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a7b117-fa45-42d4-9c0e-91841d1c6dab admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:29.052615 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-62a7b117-fa45-42d4-9c0e-91841d1c6dab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:29.118865 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a7b117-fa45-42d4-9c0e-91841d1c6dab admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:29.123453 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa3c139-c202-4a17-86a4-16b931e6fba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:29.124428 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa3c139-c202-4a17-86a4-16b931e6fba0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:29.125227 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa3c139-c202-4a17-86a4-16b931e6fba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:29.125505 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa3c139-c202-4a17-86a4-16b931e6fba0 admin admin] PATH_INFO: `/v3/projects/49dd367ca7f14c9688a89950b546e009` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:29.126675 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa3c139-c202-4a17-86a4-16b931e6fba0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49dd367ca7f14c9688a89950b546e009)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:29.128648 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa3c139-c202-4a17-86a4-16b931e6fba0 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:29.256569 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-bfa3c139-c202-4a17-86a4-16b931e6fba0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49dd367ca7f14c9688a89950b546e009', 'request_id': 'req-bfa3c139-c202-4a17-86a4-16b931e6fba0'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:29.374750 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-bfa3c139-c202-4a17-86a4-16b931e6fba0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49dd367ca7f14c9688a89950b546e009', 'request_id': 'req-bfa3c139-c202-4a17-86a4-16b931e6fba0'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:29.381159 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-bfa3c139-c202-4a17-86a4-16b931e6fba0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49dd367ca7f14c9688a89950b546e009', 'request_id': 'req-bfa3c139-c202-4a17-86a4-16b931e6fba0'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:29.392623 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-bfa3c139-c202-4a17-86a4-16b931e6fba0 admin admin] The token cache is being invalidate because project 49dd367ca7f14c9688a89950b546e009 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:00:29.392907 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-bfa3c139-c202-4a17-86a4-16b931e6fba0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:29.393556 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-bfa3c139-c202-4a17-86a4-16b931e6fba0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:29.395114 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1314/2635] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 17:00:29 2022] DELETE /identity/v3/projects/49dd367ca7f14c9688a89950b546e009 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:00:29.399967 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8934d1eb-7875-42d7-821a-e02cc09c0bcc None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:29.400405 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8934d1eb-7875-42d7-821a-e02cc09c0bcc None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:29.400753 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8934d1eb-7875-42d7-821a-e02cc09c0bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:29.419041 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-8934d1eb-7875-42d7-821a-e02cc09c0bcc None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:00:29.420268 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-8934d1eb-7875-42d7-821a-e02cc09c0bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:29.479053 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1322/2636] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:00:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:00:29.487410 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2285ca06-6fa2-4d89-ac9b-89f94987baad None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:29.487895 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2285ca06-6fa2-4d89-ac9b-89f94987baad None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:29.488068 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2285ca06-6fa2-4d89-ac9b-89f94987baad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:29.506621 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-2285ca06-6fa2-4d89-ac9b-89f94987baad None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:00:29.507865 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-2285ca06-6fa2-4d89-ac9b-89f94987baad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:29.515998 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1315/2637] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:00:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:00:29.520362 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8934d1eb-7875-42d7-821a-e02cc09c0bcc None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:29.530015 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8934d1eb-7875-42d7-821a-e02cc09c0bcc None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:29.535148 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ef9aeb-6ee3-437a-9702-9a7da61dcbbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:29.539855 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef9aeb-6ee3-437a-9702-9a7da61dcbbd admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:29.539855 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef9aeb-6ee3-437a-9702-9a7da61dcbbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:29.539855 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef9aeb-6ee3-437a-9702-9a7da61dcbbd admin admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:29.539855 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ef9aeb-6ee3-437a-9702-9a7da61dcbbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 17:00:29.539855 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ef9aeb-6ee3-437a-9702-9a7da61dcbbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:29.539855 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ef9aeb-6ee3-437a-9702-9a7da61dcbbd admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:29.551569 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1323/2638] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Jul 18 17:00:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 17:00:29.555804 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2285ca06-6fa2-4d89-ac9b-89f94987baad None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:29.565168 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2285ca06-6fa2-4d89-ac9b-89f94987baad None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:29.569899 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8959ad77-2891-4037-98c8-325c21c0ca9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:29.570543 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8959ad77-2891-4037-98c8-325c21c0ca9b admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:29.570830 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8959ad77-2891-4037-98c8-325c21c0ca9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:29.571107 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8959ad77-2891-4037-98c8-325c21c0ca9b admin admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:29.571831 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8959ad77-2891-4037-98c8-325c21c0ca9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:29.573733 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8959ad77-2891-4037-98c8-325c21c0ca9b admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:29.663733 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1316/2639] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 17:00:29 2022] POST /identity/v3/projects => generated 377 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:00:29.669114 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ef9aeb-6ee3-437a-9702-9a7da61dcbbd admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:29.680016 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ef9aeb-6ee3-437a-9702-9a7da61dcbbd admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:29.736033 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce1c6c-98bb-4507-9693-44ac87c9e021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:29.736808 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce1c6c-98bb-4507-9693-44ac87c9e021 admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:29.736968 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce1c6c-98bb-4507-9693-44ac87c9e021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:29.737241 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce1c6c-98bb-4507-9693-44ac87c9e021 admin admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:29.737943 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fce1c6c-98bb-4507-9693-44ac87c9e021 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:29.739859 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fce1c6c-98bb-4507-9693-44ac87c9e021 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:29.832614 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1324/2640] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 17:00:29 2022] POST /identity/v3/users => generated 289 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:00:29.836773 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8959ad77-2891-4037-98c8-325c21c0ca9b admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:29.848100 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8959ad77-2891-4037-98c8-325c21c0ca9b admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:29.852875 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15151179-5667-45cc-ac5e-95fd2446ccc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:29.853534 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15151179-5667-45cc-ac5e-95fd2446ccc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:29.853819 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15151179-5667-45cc-ac5e-95fd2446ccc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:29.854099 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15151179-5667-45cc-ac5e-95fd2446ccc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:29.854822 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15151179-5667-45cc-ac5e-95fd2446ccc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:29.856570 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15151179-5667-45cc-ac5e-95fd2446ccc8 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:29.868259 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1317/2641] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 17:00:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:00:29.872438 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce1c6c-98bb-4507-9693-44ac87c9e021 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:29.884499 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce1c6c-98bb-4507-9693-44ac87c9e021 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:29.889531 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c9398a-d73f-46f1-8104-f23d9e1917f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:29.890725 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9398a-d73f-46f1-8104-f23d9e1917f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:29.891010 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9398a-d73f-46f1-8104-f23d9e1917f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:29.891289 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9398a-d73f-46f1-8104-f23d9e1917f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:29.892064 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c9398a-d73f-46f1-8104-f23d9e1917f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:29.893715 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c9398a-d73f-46f1-8104-f23d9e1917f3 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:29.904183 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1325/2642] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 17:00:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 17:00:29.915032 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15151179-5667-45cc-ac5e-95fd2446ccc8 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:29.925167 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15151179-5667-45cc-ac5e-95fd2446ccc8 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:29.929794 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40632c0e-5e4e-48cd-9a09-64b93a054f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:29.930665 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40632c0e-5e4e-48cd-9a09-64b93a054f65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:29.930943 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40632c0e-5e4e-48cd-9a09-64b93a054f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:29.931213 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40632c0e-5e4e-48cd-9a09-64b93a054f65 admin admin] PATH_INFO: `/v3/projects/f98ca2aa84a8462898ea36d1a65e909a/users/201c91e0de9546eea299d7e0a9771fd8/roles/ad3a2bc7b2094a4da1a95a143c8d9436` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:29.946177 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40632c0e-5e4e-48cd-9a09-64b93a054f65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f98ca2aa84a8462898ea36d1a65e909a, user_id=201c91e0de9546eea299d7e0a9771fd8, role_id=ad3a2bc7b2094a4da1a95a143c8d9436)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:29.948852 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40632c0e-5e4e-48cd-9a09-64b93a054f65 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:30.056136 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:30.062486 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1318/2643] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 17:00:29 2022] PUT /identity/v3/projects/f98ca2aa84a8462898ea36d1a65e909a/users/201c91e0de9546eea299d7e0a9771fd8/roles/ad3a2bc7b2094a4da1a95a143c8d9436 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:00:30.074045 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f3886-8bac-4302-80be-80fe5163b1de None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:30.074339 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f3886-8bac-4302-80be-80fe5163b1de None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:30.074640 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f3886-8bac-4302-80be-80fe5163b1de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:30.101018 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-483f3886-8bac-4302-80be-80fe5163b1de None None] MFA Rules not processed for user `201c91e0de9546eea299d7e0a9771fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:00:30.102241 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-483f3886-8bac-4302-80be-80fe5163b1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:30.122097 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:30.167407 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1326/2644] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:00:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:00:30.171848 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40632c0e-5e4e-48cd-9a09-64b93a054f65 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:30.230690 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40632c0e-5e4e-48cd-9a09-64b93a054f65 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:30.235300 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ced46b-2320-4dac-8c50-0da466968b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:30.235977 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ced46b-2320-4dac-8c50-0da466968b5d admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:30.236257 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ced46b-2320-4dac-8c50-0da466968b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:30.236531 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ced46b-2320-4dac-8c50-0da466968b5d admin admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:30.237218 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ced46b-2320-4dac-8c50-0da466968b5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:30.239099 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ced46b-2320-4dac-8c50-0da466968b5d admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:30.382310 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1319/2645] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 17:00:30 2022] POST /identity/v3/projects => generated 377 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 17:00:30.386488 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f3886-8bac-4302-80be-80fe5163b1de None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:30.397663 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f3886-8bac-4302-80be-80fe5163b1de None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:30.453597 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270fb0ea-bc95-40d4-8680-8c876f35ab01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:30.454184 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270fb0ea-bc95-40d4-8680-8c876f35ab01 admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:30.454463 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270fb0ea-bc95-40d4-8680-8c876f35ab01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:30.454736 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270fb0ea-bc95-40d4-8680-8c876f35ab01 admin admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:30.455413 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270fb0ea-bc95-40d4-8680-8c876f35ab01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:30.457458 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270fb0ea-bc95-40d4-8680-8c876f35ab01 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:30.546593 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1327/2646] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 17:00:30 2022] POST /identity/v3/users => generated 295 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:00:30.550790 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ced46b-2320-4dac-8c50-0da466968b5d admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:30.561370 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ced46b-2320-4dac-8c50-0da466968b5d admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:30.566235 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd48e200-3093-4108-8c55-ed6f6e6a205f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:30.567006 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48e200-3093-4108-8c55-ed6f6e6a205f admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:30.567405 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48e200-3093-4108-8c55-ed6f6e6a205f admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:30.567720 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48e200-3093-4108-8c55-ed6f6e6a205f admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:30.571765 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd48e200-3093-4108-8c55-ed6f6e6a205f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:30.571765 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd48e200-3093-4108-8c55-ed6f6e6a205f admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:30.581302 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1320/2647] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 17:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:00:30.585385 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270fb0ea-bc95-40d4-8680-8c876f35ab01 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:30.595914 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270fb0ea-bc95-40d4-8680-8c876f35ab01 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:30.601809 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6697f5-5d33-4346-9e98-0b06f382b628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:30.603147 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6697f5-5d33-4346-9e98-0b06f382b628 admin admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:30.603565 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6697f5-5d33-4346-9e98-0b06f382b628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:30.604021 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6697f5-5d33-4346-9e98-0b06f382b628 admin admin] PATH_INFO: `/v3/projects/1223b2cea1bf43e4807f3aef14133856/users/698727bcc4bb4a8bb38c06a3e3a9b32b/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:30.625295 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6697f5-5d33-4346-9e98-0b06f382b628 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1223b2cea1bf43e4807f3aef14133856, user_id=698727bcc4bb4a8bb38c06a3e3a9b32b, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:30.629532 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6697f5-5d33-4346-9e98-0b06f382b628 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:30.729450 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1328/2648] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 17:00:30 2022] PUT /identity/v3/projects/1223b2cea1bf43e4807f3aef14133856/users/698727bcc4bb4a8bb38c06a3e3a9b32b/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:00:30.733631 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd48e200-3093-4108-8c55-ed6f6e6a205f admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:30.744144 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd48e200-3093-4108-8c55-ed6f6e6a205f admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:30.803632 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278b2a81-8089-4f86-bd4e-02ed793dd805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:30.804376 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b2a81-8089-4f86-bd4e-02ed793dd805 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:30.804779 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b2a81-8089-4f86-bd4e-02ed793dd805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:30.805077 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b2a81-8089-4f86-bd4e-02ed793dd805 admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:30.805857 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278b2a81-8089-4f86-bd4e-02ed793dd805 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:30.807532 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278b2a81-8089-4f86-bd4e-02ed793dd805 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:30.817989 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1321/2649] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 17:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:00:30.822157 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6697f5-5d33-4346-9e98-0b06f382b628 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:30.832786 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6697f5-5d33-4346-9e98-0b06f382b628 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:30.837457 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8ad0f2-f362-4b16-825b-1c626ed30f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:30.838325 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ad0f2-f362-4b16-825b-1c626ed30f96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:30.838604 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ad0f2-f362-4b16-825b-1c626ed30f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:30.838875 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ad0f2-f362-4b16-825b-1c626ed30f96 admin admin] PATH_INFO: `/v3/projects/1223b2cea1bf43e4807f3aef14133856/users/698727bcc4bb4a8bb38c06a3e3a9b32b/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:30.840842 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8ad0f2-f362-4b16-825b-1c626ed30f96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1223b2cea1bf43e4807f3aef14133856, user_id=698727bcc4bb4a8bb38c06a3e3a9b32b, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:30.843490 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8ad0f2-f362-4b16-825b-1c626ed30f96 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:30.853800 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1329/2650] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 17:00:30 2022] PUT /identity/v3/projects/1223b2cea1bf43e4807f3aef14133856/users/698727bcc4bb4a8bb38c06a3e3a9b32b/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:00:30.864098 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d77b99-bcc7-40bb-be5a-04488423285d None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:30.864409 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d77b99-bcc7-40bb-be5a-04488423285d None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:30.864722 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d77b99-bcc7-40bb-be5a-04488423285d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:30.891829 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-d0d77b99-bcc7-40bb-be5a-04488423285d None None] MFA Rules not processed for user `698727bcc4bb4a8bb38c06a3e3a9b32b`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:00:30.893027 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-d0d77b99-bcc7-40bb-be5a-04488423285d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:30.951161 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:30.961907 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1322/2651] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:00:30 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:00:30.972689 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8ad0f2-f362-4b16-825b-1c626ed30f96 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:30.974568 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-df8ad0f2-f362-4b16-825b-1c626ed30f96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:31.034022 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8ad0f2-f362-4b16-825b-1c626ed30f96 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:31.038398 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2dab9b-cec1-45ba-9b8d-b7db31036da5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:31.039049 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2dab9b-cec1-45ba-9b8d-b7db31036da5 service cinder] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:31.039337 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2dab9b-cec1-45ba-9b8d-b7db31036da5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:31.039614 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2dab9b-cec1-45ba-9b8d-b7db31036da5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:31.069369 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:31.097094 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2dab9b-cec1-45ba-9b8d-b7db31036da5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:31.098554 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2dab9b-cec1-45ba-9b8d-b7db31036da5 service cinder] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:31.107369 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1330/2652] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 17:00:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:00:34.001191 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d77b99-bcc7-40bb-be5a-04488423285d None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:34.002713 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-d0d77b99-bcc7-40bb-be5a-04488423285d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:34.083646 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d77b99-bcc7-40bb-be5a-04488423285d None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:34.094299 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0d5723-d0b7-44a5-af99-24b933103420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:34.095178 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d5723-d0b7-44a5-af99-24b933103420 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:34.095801 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d5723-d0b7-44a5-af99-24b933103420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:34.096082 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d5723-d0b7-44a5-af99-24b933103420 admin admin] PATH_INFO: `/v3/users/b747973ab44346b3a88b0234d020aea6` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:34.097269 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0d5723-d0b7-44a5-af99-24b933103420 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b747973ab44346b3a88b0234d020aea6)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:34.099194 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0d5723-d0b7-44a5-af99-24b933103420 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:34.434084 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-af0d5723-d0b7-44a5-af99-24b933103420 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b747973ab44346b3a88b0234d020aea6'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:34.434748 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-af0d5723-d0b7-44a5-af99-24b933103420 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b747973ab44346b3a88b0234d020aea6'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:34.447137 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-af0d5723-d0b7-44a5-af99-24b933103420 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b747973ab44346b3a88b0234d020aea6'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:34.546305 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-af0d5723-d0b7-44a5-af99-24b933103420 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b747973ab44346b3a88b0234d020aea6'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:34.553820 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-af0d5723-d0b7-44a5-af99-24b933103420 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b747973ab44346b3a88b0234d020aea6'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:34.559828 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1323/2653] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 17:00:34 2022] DELETE /identity/v3/users/b747973ab44346b3a88b0234d020aea6 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:00:34.564981 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe2bd0-9d50-49b5-94b3-cee7f633781b None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:34.565487 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe2bd0-9d50-49b5-94b3-cee7f633781b None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:34.565589 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe2bd0-9d50-49b5-94b3-cee7f633781b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:34.583110 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-17fe2bd0-9d50-49b5-94b3-cee7f633781b None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:00:34.584315 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-17fe2bd0-9d50-49b5-94b3-cee7f633781b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:34.643403 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1331/2654] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:00:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 17:00:34.653295 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0d5723-d0b7-44a5-af99-24b933103420 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:34.654702 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-af0d5723-d0b7-44a5-af99-24b933103420 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:34.724759 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0d5723-d0b7-44a5-af99-24b933103420 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:34.728245 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f55e17a-f2fd-4682-8807-b0b511f852a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:34.731940 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55e17a-f2fd-4682-8807-b0b511f852a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:34.731940 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55e17a-f2fd-4682-8807-b0b511f852a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:34.731940 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55e17a-f2fd-4682-8807-b0b511f852a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:34.738124 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f55e17a-f2fd-4682-8807-b0b511f852a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:34.739521 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f55e17a-f2fd-4682-8807-b0b511f852a3 service neutron] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:34.748689 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1324/2655] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 17:00:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:00:35.239145 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fe2bd0-9d50-49b5-94b3-cee7f633781b None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:35.240593 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-17fe2bd0-9d50-49b5-94b3-cee7f633781b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:35.253591 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fe2bd0-9d50-49b5-94b3-cee7f633781b None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:35.258980 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9439a173-f0e3-4bc3-aa66-da8f58d8c167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:35.259887 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439a173-f0e3-4bc3-aa66-da8f58d8c167 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:35.260320 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439a173-f0e3-4bc3-aa66-da8f58d8c167 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:35.260600 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439a173-f0e3-4bc3-aa66-da8f58d8c167 admin admin] PATH_INFO: `/v3/projects/4e29525e9aa24e2984e98eeb5d4f50aa` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:35.261799 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9439a173-f0e3-4bc3-aa66-da8f58d8c167 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e29525e9aa24e2984e98eeb5d4f50aa)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:35.263740 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9439a173-f0e3-4bc3-aa66-da8f58d8c167 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:35.403768 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-9439a173-f0e3-4bc3-aa66-da8f58d8c167 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e29525e9aa24e2984e98eeb5d4f50aa', 'request_id': 'req-9439a173-f0e3-4bc3-aa66-da8f58d8c167'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:35.409556 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-9439a173-f0e3-4bc3-aa66-da8f58d8c167 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e29525e9aa24e2984e98eeb5d4f50aa', 'request_id': 'req-9439a173-f0e3-4bc3-aa66-da8f58d8c167'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:35.415687 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-9439a173-f0e3-4bc3-aa66-da8f58d8c167 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e29525e9aa24e2984e98eeb5d4f50aa', 'request_id': 'req-9439a173-f0e3-4bc3-aa66-da8f58d8c167'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:35.511578 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-9439a173-f0e3-4bc3-aa66-da8f58d8c167 admin admin] The token cache is being invalidate because project 4e29525e9aa24e2984e98eeb5d4f50aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:00:35.511851 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-9439a173-f0e3-4bc3-aa66-da8f58d8c167 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:35.512472 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-9439a173-f0e3-4bc3-aa66-da8f58d8c167 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:35.514030 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1332/2656] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 17:00:35 2022] DELETE /identity/v3/projects/4e29525e9aa24e2984e98eeb5d4f50aa => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:00:35.518591 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f55e17a-f2fd-4682-8807-b0b511f852a3 service neutron] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:35.528535 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f55e17a-f2fd-4682-8807-b0b511f852a3 service neutron] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:35.540752 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:35.584344 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195b10f-5217-408e-a91e-32acb44ae067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:35.585209 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195b10f-5217-408e-a91e-32acb44ae067 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:35.585496 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195b10f-5217-408e-a91e-32acb44ae067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:35.585774 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195b10f-5217-408e-a91e-32acb44ae067 admin admin] PATH_INFO: `/v3/users/792909d9e2584f1ea0f188216e02670a` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:35.586943 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3195b10f-5217-408e-a91e-32acb44ae067 admin admin] RBAC: Authorizing `identity:delete_user(user_id=792909d9e2584f1ea0f188216e02670a)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:35.588917 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3195b10f-5217-408e-a91e-32acb44ae067 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:35.743265 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9439a173-f0e3-4bc3-aa66-da8f58d8c167 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:35.744678 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-9439a173-f0e3-4bc3-aa66-da8f58d8c167 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:35.801462 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9439a173-f0e3-4bc3-aa66-da8f58d8c167 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:35.805055 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e7145-4b3d-4fed-87bc-ef11776a49c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:35.805700 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e7145-4b3d-4fed-87bc-ef11776a49c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:35.805985 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e7145-4b3d-4fed-87bc-ef11776a49c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:35.806264 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e7145-4b3d-4fed-87bc-ef11776a49c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:35.808083 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-078e7145-4b3d-4fed-87bc-ef11776a49c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:35.814338 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:35.871047 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078e7145-4b3d-4fed-87bc-ef11776a49c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:35.872510 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078e7145-4b3d-4fed-87bc-ef11776a49c5 service cinder] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:35.882270 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1333/2657] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 17:00:35 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 17:00:35.903208 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-3195b10f-5217-408e-a91e-32acb44ae067 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '792909d9e2584f1ea0f188216e02670a'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:35.903935 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-3195b10f-5217-408e-a91e-32acb44ae067 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '792909d9e2584f1ea0f188216e02670a'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:35.918081 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-3195b10f-5217-408e-a91e-32acb44ae067 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '792909d9e2584f1ea0f188216e02670a'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:36.037455 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-3195b10f-5217-408e-a91e-32acb44ae067 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '792909d9e2584f1ea0f188216e02670a'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:36.045303 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-3195b10f-5217-408e-a91e-32acb44ae067 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '792909d9e2584f1ea0f188216e02670a'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:36.051657 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1325/2658] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 17:00:35 2022] DELETE /identity/v3/users/792909d9e2584f1ea0f188216e02670a => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:00:36.575946 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e7145-4b3d-4fed-87bc-ef11776a49c5 service cinder] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:36.577933 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-078e7145-4b3d-4fed-87bc-ef11776a49c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:36.592362 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e7145-4b3d-4fed-87bc-ef11776a49c5 service cinder] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:36.650135 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7149d01-03e3-4806-a8e9-0115904a0ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:36.650995 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7149d01-03e3-4806-a8e9-0115904a0ee4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:36.651279 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7149d01-03e3-4806-a8e9-0115904a0ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:36.651557 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7149d01-03e3-4806-a8e9-0115904a0ee4 admin admin] PATH_INFO: `/v3/projects/1cc0dfead1284ecab652c1b999c9b422` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:36.652783 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7149d01-03e3-4806-a8e9-0115904a0ee4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cc0dfead1284ecab652c1b999c9b422)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:36.654746 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7149d01-03e3-4806-a8e9-0115904a0ee4 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:36.786450 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-d7149d01-03e3-4806-a8e9-0115904a0ee4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cc0dfead1284ecab652c1b999c9b422', 'request_id': 'req-d7149d01-03e3-4806-a8e9-0115904a0ee4'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:36.791969 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-d7149d01-03e3-4806-a8e9-0115904a0ee4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cc0dfead1284ecab652c1b999c9b422', 'request_id': 'req-d7149d01-03e3-4806-a8e9-0115904a0ee4'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:36.798230 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-d7149d01-03e3-4806-a8e9-0115904a0ee4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cc0dfead1284ecab652c1b999c9b422', 'request_id': 'req-d7149d01-03e3-4806-a8e9-0115904a0ee4'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:36.934408 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-d7149d01-03e3-4806-a8e9-0115904a0ee4 admin admin] The token cache is being invalidate because project 1cc0dfead1284ecab652c1b999c9b422 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:00:36.934673 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-d7149d01-03e3-4806-a8e9-0115904a0ee4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:36.935306 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-d7149d01-03e3-4806-a8e9-0115904a0ee4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:36.937401 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1334/2659] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 17:00:36 2022] DELETE /identity/v3/projects/1cc0dfead1284ecab652c1b999c9b422 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:00:36.942425 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0df514-c9dc-48af-b12d-171b063058a0 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:36.942897 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0df514-c9dc-48af-b12d-171b063058a0 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:36.943027 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0df514-c9dc-48af-b12d-171b063058a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:36.961687 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-bb0df514-c9dc-48af-b12d-171b063058a0 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:00:36.962888 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-bb0df514-c9dc-48af-b12d-171b063058a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:37.021557 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1326/2660] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:00:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:00:37.029404 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c4fb0-badc-4025-9dc3-2c6fb0bfd40f None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:37.029697 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c4fb0-badc-4025-9dc3-2c6fb0bfd40f None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:37.030060 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c4fb0-badc-4025-9dc3-2c6fb0bfd40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:37.048132 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-8b6c4fb0-badc-4025-9dc3-2c6fb0bfd40f None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:00:37.049318 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-8b6c4fb0-badc-4025-9dc3-2c6fb0bfd40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:37.057440 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1335/2661] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:00:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:00:37.062063 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0df514-c9dc-48af-b12d-171b063058a0 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:37.071575 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0df514-c9dc-48af-b12d-171b063058a0 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:37.076240 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765492fc-6f45-45b8-a87a-f0b0416f81c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:37.076877 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765492fc-6f45-45b8-a87a-f0b0416f81c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:37.077752 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765492fc-6f45-45b8-a87a-f0b0416f81c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:37.078065 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765492fc-6f45-45b8-a87a-f0b0416f81c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:37.078776 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765492fc-6f45-45b8-a87a-f0b0416f81c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 17:00:37.079075 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765492fc-6f45-45b8-a87a-f0b0416f81c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:37.080683 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765492fc-6f45-45b8-a87a-f0b0416f81c6 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:37.091973 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1327/2662] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Jul 18 17:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 17:00:37.096258 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c4fb0-badc-4025-9dc3-2c6fb0bfd40f None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:37.105345 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c4fb0-badc-4025-9dc3-2c6fb0bfd40f None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:37.109950 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f427f87-da38-43a5-9460-4d979be68b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:37.110620 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f427f87-da38-43a5-9460-4d979be68b94 admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:37.110910 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f427f87-da38-43a5-9460-4d979be68b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:37.111190 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f427f87-da38-43a5-9460-4d979be68b94 admin admin] PATH_INFO: `/v3/projects` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:37.111944 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f427f87-da38-43a5-9460-4d979be68b94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:37.113863 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f427f87-da38-43a5-9460-4d979be68b94 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:37.221555 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1336/2663] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 17:00:37 2022] POST /identity/v3/projects => generated 369 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 17:00:37.225389 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765492fc-6f45-45b8-a87a-f0b0416f81c6 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:37.236072 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765492fc-6f45-45b8-a87a-f0b0416f81c6 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:37.254676 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:37.291427 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54da94ae-3f4b-4245-8110-ac2f1f59160b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:37.292181 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da94ae-3f4b-4245-8110-ac2f1f59160b admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:37.292468 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da94ae-3f4b-4245-8110-ac2f1f59160b admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:37.292750 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da94ae-3f4b-4245-8110-ac2f1f59160b admin admin] PATH_INFO: `/v3/users` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:37.293433 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54da94ae-3f4b-4245-8110-ac2f1f59160b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:37.295372 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54da94ae-3f4b-4245-8110-ac2f1f59160b admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:37.408576 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1328/2664] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 17:00:37 2022] POST /identity/v3/users => generated 285 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:00:37.412696 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f427f87-da38-43a5-9460-4d979be68b94 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:37.419460 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:37.423657 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f427f87-da38-43a5-9460-4d979be68b94 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:37.428457 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6cc1d2-3ff7-489a-9087-62158de80ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:37.429206 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6cc1d2-3ff7-489a-9087-62158de80ec5 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:37.429676 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6cc1d2-3ff7-489a-9087-62158de80ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:37.429997 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6cc1d2-3ff7-489a-9087-62158de80ec5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:37.430807 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6cc1d2-3ff7-489a-9087-62158de80ec5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:37.432430 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6cc1d2-3ff7-489a-9087-62158de80ec5 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:37.443584 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1337/2665] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 17:00:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:00:37.447470 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54da94ae-3f4b-4245-8110-ac2f1f59160b admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:37.457614 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54da94ae-3f4b-4245-8110-ac2f1f59160b admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:37.462444 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7beab6-5ded-433d-a222-79b865fdde2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:37.463117 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7beab6-5ded-433d-a222-79b865fdde2c admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:37.463409 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7beab6-5ded-433d-a222-79b865fdde2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:37.463689 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7beab6-5ded-433d-a222-79b865fdde2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:37.464453 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7beab6-5ded-433d-a222-79b865fdde2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:37.466554 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7beab6-5ded-433d-a222-79b865fdde2c admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:37.476696 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1329/2666] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 17:00:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:00:37.481049 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6cc1d2-3ff7-489a-9087-62158de80ec5 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:37.491459 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6cc1d2-3ff7-489a-9087-62158de80ec5 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:37.496029 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81a3a4e-1d88-4774-b7d9-9754ef93a9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:37.496898 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a3a4e-1d88-4774-b7d9-9754ef93a9fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:37.497249 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a3a4e-1d88-4774-b7d9-9754ef93a9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:37.497446 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a3a4e-1d88-4774-b7d9-9754ef93a9fd admin admin] PATH_INFO: `/v3/projects/c8e5cc681c194c6ca512a503e3377e3b/users/59922a2ad6284c8087519deedf29df16/roles/ad3a2bc7b2094a4da1a95a143c8d9436` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:37.512898 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81a3a4e-1d88-4774-b7d9-9754ef93a9fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8e5cc681c194c6ca512a503e3377e3b, user_id=59922a2ad6284c8087519deedf29df16, role_id=ad3a2bc7b2094a4da1a95a143c8d9436)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:37.515525 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81a3a4e-1d88-4774-b7d9-9754ef93a9fd admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:37.615049 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1338/2667] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 17:00:37 2022] PUT /identity/v3/projects/c8e5cc681c194c6ca512a503e3377e3b/users/59922a2ad6284c8087519deedf29df16/roles/ad3a2bc7b2094a4da1a95a143c8d9436 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:00:37.625571 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4b9e7-8adb-4ca7-a488-8fb265fe8b01 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:37.625850 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4b9e7-8adb-4ca7-a488-8fb265fe8b01 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:37.626136 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4b9e7-8adb-4ca7-a488-8fb265fe8b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:37.652636 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-d7d4b9e7-8adb-4ca7-a488-8fb265fe8b01 None None] MFA Rules not processed for user `59922a2ad6284c8087519deedf29df16`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:00:37.653849 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-d7d4b9e7-8adb-4ca7-a488-8fb265fe8b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:37.717408 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1330/2668] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:00:37 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:00:37.729439 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81a3a4e-1d88-4774-b7d9-9754ef93a9fd admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:37.731151 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-c81a3a4e-1d88-4774-b7d9-9754ef93a9fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:37.788978 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81a3a4e-1d88-4774-b7d9-9754ef93a9fd admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:37.792841 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bf9d22-c71c-4000-8c88-74158ed6322c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:37.793491 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf9d22-c71c-4000-8c88-74158ed6322c service cinder] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:37.793778 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf9d22-c71c-4000-8c88-74158ed6322c service cinder] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:37.794057 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf9d22-c71c-4000-8c88-74158ed6322c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:37.803436 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bf9d22-c71c-4000-8c88-74158ed6322c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:37.804903 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bf9d22-c71c-4000-8c88-74158ed6322c service cinder] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:37.813994 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1339/2669] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 17:00:37 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:00:37.833586 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d4b9e7-8adb-4ca7-a488-8fb265fe8b01 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:37.899488 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d4b9e7-8adb-4ca7-a488-8fb265fe8b01 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:37.904162 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e226574-93a4-4bbc-9755-e6f703e67641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:37.905032 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e226574-93a4-4bbc-9755-e6f703e67641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:37.905315 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e226574-93a4-4bbc-9755-e6f703e67641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:37.905600 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e226574-93a4-4bbc-9755-e6f703e67641 admin admin] PATH_INFO: `/v3/users/59922a2ad6284c8087519deedf29df16` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:37.907616 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e226574-93a4-4bbc-9755-e6f703e67641 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59922a2ad6284c8087519deedf29df16)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:37.909432 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e226574-93a4-4bbc-9755-e6f703e67641 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:38.090809 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:38.104672 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-9e226574-93a4-4bbc-9755-e6f703e67641 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59922a2ad6284c8087519deedf29df16'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:38.105344 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-9e226574-93a4-4bbc-9755-e6f703e67641 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59922a2ad6284c8087519deedf29df16'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:38.117025 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-9e226574-93a4-4bbc-9755-e6f703e67641 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59922a2ad6284c8087519deedf29df16'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:38.191808 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-9e226574-93a4-4bbc-9755-e6f703e67641 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59922a2ad6284c8087519deedf29df16'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:38.199289 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-9e226574-93a4-4bbc-9755-e6f703e67641 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59922a2ad6284c8087519deedf29df16'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:38.205749 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1331/2670] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 17:00:37 2022] DELETE /identity/v3/users/59922a2ad6284c8087519deedf29df16 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:00:38.210261 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee3816-a0dd-409c-8cc7-8f96e819b268 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:38.210579 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee3816-a0dd-409c-8cc7-8f96e819b268 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:38.210856 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee3816-a0dd-409c-8cc7-8f96e819b268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:38.228772 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-32ee3816-a0dd-409c-8cc7-8f96e819b268 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:00:38.229970 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-32ee3816-a0dd-409c-8cc7-8f96e819b268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:38.288513 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1340/2671] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:00:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:00:38.297971 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e226574-93a4-4bbc-9755-e6f703e67641 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:38.299371 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-9e226574-93a4-4bbc-9755-e6f703e67641 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:38.356641 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e226574-93a4-4bbc-9755-e6f703e67641 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:38.360362 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c735d-58bd-4b5f-b0ce-01d257ff4f3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:38.361001 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c735d-58bd-4b5f-b0ce-01d257ff4f3d service neutron] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:38.361285 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c735d-58bd-4b5f-b0ce-01d257ff4f3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:38.361637 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c735d-58bd-4b5f-b0ce-01d257ff4f3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:38.370940 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8c735d-58bd-4b5f-b0ce-01d257ff4f3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:38.372395 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8c735d-58bd-4b5f-b0ce-01d257ff4f3d service neutron] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:38.382577 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1332/2672] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 17:00:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:00:38.769942 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ee3816-a0dd-409c-8cc7-8f96e819b268 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:38.771412 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-32ee3816-a0dd-409c-8cc7-8f96e819b268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:38.784159 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ee3816-a0dd-409c-8cc7-8f96e819b268 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:38.788836 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67361f7-6cb4-4cf9-88d9-e856170e3620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:38.789764 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67361f7-6cb4-4cf9-88d9-e856170e3620 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:38.790331 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67361f7-6cb4-4cf9-88d9-e856170e3620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:38.790331 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67361f7-6cb4-4cf9-88d9-e856170e3620 admin admin] PATH_INFO: `/v3/projects/c8e5cc681c194c6ca512a503e3377e3b` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:38.791443 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67361f7-6cb4-4cf9-88d9-e856170e3620 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8e5cc681c194c6ca512a503e3377e3b)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:38.793396 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67361f7-6cb4-4cf9-88d9-e856170e3620 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:38.929054 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-b67361f7-6cb4-4cf9-88d9-e856170e3620 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8e5cc681c194c6ca512a503e3377e3b', 'request_id': 'req-b67361f7-6cb4-4cf9-88d9-e856170e3620'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:38.934493 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-b67361f7-6cb4-4cf9-88d9-e856170e3620 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8e5cc681c194c6ca512a503e3377e3b', 'request_id': 'req-b67361f7-6cb4-4cf9-88d9-e856170e3620'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:38.941245 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-b67361f7-6cb4-4cf9-88d9-e856170e3620 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8e5cc681c194c6ca512a503e3377e3b', 'request_id': 'req-b67361f7-6cb4-4cf9-88d9-e856170e3620'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:38.945004 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:39.025049 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-b67361f7-6cb4-4cf9-88d9-e856170e3620 admin admin] The token cache is being invalidate because project c8e5cc681c194c6ca512a503e3377e3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:00:39.025340 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-b67361f7-6cb4-4cf9-88d9-e856170e3620 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:39.026047 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-b67361f7-6cb4-4cf9-88d9-e856170e3620 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:39.027616 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1341/2673] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 17:00:38 2022] DELETE /identity/v3/projects/c8e5cc681c194c6ca512a503e3377e3b => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:00:39.033148 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e619eced-64ac-4fcc-8b6e-e6b156219573 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:39.033432 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e619eced-64ac-4fcc-8b6e-e6b156219573 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:39.033707 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e619eced-64ac-4fcc-8b6e-e6b156219573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:39.052428 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-e619eced-64ac-4fcc-8b6e-e6b156219573 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:00:39.053590 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-e619eced-64ac-4fcc-8b6e-e6b156219573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:39.114022 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1333/2674] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:00:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:00:39.122763 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab2da9-854e-4c57-8fca-184253bb4f88 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:39.123059 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab2da9-854e-4c57-8fca-184253bb4f88 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:39.123339 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab2da9-854e-4c57-8fca-184253bb4f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:39.141877 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-a9ab2da9-854e-4c57-8fca-184253bb4f88 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:00:39.143077 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-a9ab2da9-854e-4c57-8fca-184253bb4f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:39.151026 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1342/2675] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:00:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:00:39.155249 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e619eced-64ac-4fcc-8b6e-e6b156219573 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:39.165782 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e619eced-64ac-4fcc-8b6e-e6b156219573 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:39.170430 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e369a646-fa90-40d4-8eb1-8bbd6a8223c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:39.171077 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369a646-fa90-40d4-8eb1-8bbd6a8223c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:39.171360 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369a646-fa90-40d4-8eb1-8bbd6a8223c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:39.171635 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369a646-fa90-40d4-8eb1-8bbd6a8223c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:39.172415 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e369a646-fa90-40d4-8eb1-8bbd6a8223c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 17:00:39.173301 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e369a646-fa90-40d4-8eb1-8bbd6a8223c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:39.174884 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e369a646-fa90-40d4-8eb1-8bbd6a8223c8 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:39.186778 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1334/2676] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Jul 18 17:00:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 17:00:39.191106 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ab2da9-854e-4c57-8fca-184253bb4f88 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:39.200456 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ab2da9-854e-4c57-8fca-184253bb4f88 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:39.207521 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab6791-510a-47cb-acc4-0fa44dade26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:39.208210 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab6791-510a-47cb-acc4-0fa44dade26a admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:39.208486 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab6791-510a-47cb-acc4-0fa44dade26a admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:39.208784 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab6791-510a-47cb-acc4-0fa44dade26a admin admin] PATH_INFO: `/v3/projects` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:39.209443 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfab6791-510a-47cb-acc4-0fa44dade26a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:39.211330 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfab6791-510a-47cb-acc4-0fa44dade26a admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:39.349181 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1343/2677] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 17:00:39 2022] POST /identity/v3/projects => generated 397 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:00:39.352674 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e369a646-fa90-40d4-8eb1-8bbd6a8223c8 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:39.363323 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e369a646-fa90-40d4-8eb1-8bbd6a8223c8 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:39.402095 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:39.420420 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f95cdc-7ac2-4f52-b5fa-daca6fc6d8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:39.421085 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f95cdc-7ac2-4f52-b5fa-daca6fc6d8ff admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:39.421366 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f95cdc-7ac2-4f52-b5fa-daca6fc6d8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:39.421640 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f95cdc-7ac2-4f52-b5fa-daca6fc6d8ff admin admin] PATH_INFO: `/v3/users` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:39.422344 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f95cdc-7ac2-4f52-b5fa-daca6fc6d8ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:39.424276 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f95cdc-7ac2-4f52-b5fa-daca6fc6d8ff admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:39.540323 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1335/2678] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 17:00:39 2022] POST /identity/v3/users => generated 299 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:00:39.544519 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab6791-510a-47cb-acc4-0fa44dade26a admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:39.554826 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab6791-510a-47cb-acc4-0fa44dade26a admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:39.559417 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a84c4f1-9df3-46d3-ae3e-e06f7c007232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:39.560112 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84c4f1-9df3-46d3-ae3e-e06f7c007232 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:39.560395 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84c4f1-9df3-46d3-ae3e-e06f7c007232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:39.560671 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84c4f1-9df3-46d3-ae3e-e06f7c007232 admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:39.561422 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a84c4f1-9df3-46d3-ae3e-e06f7c007232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:39.563006 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a84c4f1-9df3-46d3-ae3e-e06f7c007232 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:39.573307 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1344/2679] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 17:00:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:00:39.577085 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f95cdc-7ac2-4f52-b5fa-daca6fc6d8ff admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:39.587319 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f95cdc-7ac2-4f52-b5fa-daca6fc6d8ff admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:39.591962 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da502c99-971c-48e6-b092-c838044a5ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:39.592605 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da502c99-971c-48e6-b092-c838044a5ce4 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:39.592883 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da502c99-971c-48e6-b092-c838044a5ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:39.593156 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da502c99-971c-48e6-b092-c838044a5ce4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:39.593864 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da502c99-971c-48e6-b092-c838044a5ce4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:39.596079 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da502c99-971c-48e6-b092-c838044a5ce4 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:39.605723 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1336/2680] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 17:00:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:00:39.609796 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a84c4f1-9df3-46d3-ae3e-e06f7c007232 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:39.620411 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a84c4f1-9df3-46d3-ae3e-e06f7c007232 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:39.626412 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079fb07f-ed90-4c84-8dfa-8e7f6c27590e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:39.627789 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079fb07f-ed90-4c84-8dfa-8e7f6c27590e admin admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:39.627789 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079fb07f-ed90-4c84-8dfa-8e7f6c27590e admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:39.627984 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079fb07f-ed90-4c84-8dfa-8e7f6c27590e admin admin] PATH_INFO: `/v3/projects/829acca1e5c5474e827a4cf5e35a3f22/users/0dd0a26591b845e8a861502ade2100e5/roles/ad3a2bc7b2094a4da1a95a143c8d9436` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:39.644874 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079fb07f-ed90-4c84-8dfa-8e7f6c27590e admin admin] RBAC: Authorizing `identity:create_grant(project_id=829acca1e5c5474e827a4cf5e35a3f22, user_id=0dd0a26591b845e8a861502ade2100e5, role_id=ad3a2bc7b2094a4da1a95a143c8d9436)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:39.647536 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079fb07f-ed90-4c84-8dfa-8e7f6c27590e admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:39.717839 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1345/2681] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 17:00:39 2022] PUT /identity/v3/projects/829acca1e5c5474e827a4cf5e35a3f22/users/0dd0a26591b845e8a861502ade2100e5/roles/ad3a2bc7b2094a4da1a95a143c8d9436 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 17:00:39.728961 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f98e9-3ab3-4a23-a51c-0c3fa6971b5a None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:39.729252 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f98e9-3ab3-4a23-a51c-0c3fa6971b5a None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:39.729537 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f98e9-3ab3-4a23-a51c-0c3fa6971b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:39.756539 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-944f98e9-3ab3-4a23-a51c-0c3fa6971b5a None None] MFA Rules not processed for user `0dd0a26591b845e8a861502ade2100e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:00:39.757742 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-944f98e9-3ab3-4a23-a51c-0c3fa6971b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:39.820800 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1337/2682] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:00:39 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:00:39.832571 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079fb07f-ed90-4c84-8dfa-8e7f6c27590e admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:39.834276 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-079fb07f-ed90-4c84-8dfa-8e7f6c27590e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:39.891569 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079fb07f-ed90-4c84-8dfa-8e7f6c27590e admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:39.895171 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb77a1ab-d3c7-44e3-a303-3f89c2b7da9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:39.895834 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77a1ab-d3c7-44e3-a303-3f89c2b7da9f service cinder] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:39.896115 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77a1ab-d3c7-44e3-a303-3f89c2b7da9f service cinder] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:39.896385 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77a1ab-d3c7-44e3-a303-3f89c2b7da9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:39.904533 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb77a1ab-d3c7-44e3-a303-3f89c2b7da9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:39.905935 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb77a1ab-d3c7-44e3-a303-3f89c2b7da9f service cinder] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:39.915375 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1346/2683] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 17:00:39 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:00:46.071972 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944f98e9-3ab3-4a23-a51c-0c3fa6971b5a None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:46.134286 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944f98e9-3ab3-4a23-a51c-0c3fa6971b5a None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:46.138733 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b17494-acd1-48c1-a52c-afab0c647f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:46.139583 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b17494-acd1-48c1-a52c-afab0c647f61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:46.139893 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b17494-acd1-48c1-a52c-afab0c647f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:46.140168 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b17494-acd1-48c1-a52c-afab0c647f61 admin admin] PATH_INFO: `/v3/users/0dd0a26591b845e8a861502ade2100e5` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:46.141337 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b17494-acd1-48c1-a52c-afab0c647f61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dd0a26591b845e8a861502ade2100e5)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:46.143790 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b17494-acd1-48c1-a52c-afab0c647f61 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:46.330899 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-07b17494-acd1-48c1-a52c-afab0c647f61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dd0a26591b845e8a861502ade2100e5'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:46.331581 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-07b17494-acd1-48c1-a52c-afab0c647f61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dd0a26591b845e8a861502ade2100e5'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:46.333513 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:46.343462 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-07b17494-acd1-48c1-a52c-afab0c647f61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dd0a26591b845e8a861502ade2100e5'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:46.413461 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-07b17494-acd1-48c1-a52c-afab0c647f61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dd0a26591b845e8a861502ade2100e5'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:46.420945 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-07b17494-acd1-48c1-a52c-afab0c647f61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dd0a26591b845e8a861502ade2100e5'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:46.426830 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1338/2684] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 17:00:46 2022] DELETE /identity/v3/users/0dd0a26591b845e8a861502ade2100e5 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:00:46.431455 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab520d1-25d5-4c0c-b3f2-367f0a9def31 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:46.431973 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab520d1-25d5-4c0c-b3f2-367f0a9def31 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:46.432081 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab520d1-25d5-4c0c-b3f2-367f0a9def31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:46.449327 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-eab520d1-25d5-4c0c-b3f2-367f0a9def31 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:00:46.450583 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-eab520d1-25d5-4c0c-b3f2-367f0a9def31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:46.520146 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1347/2685] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:00:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:00:46.532903 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b17494-acd1-48c1-a52c-afab0c647f61 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:46.534448 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-07b17494-acd1-48c1-a52c-afab0c647f61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:46.590878 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b17494-acd1-48c1-a52c-afab0c647f61 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:46.595191 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ba2365-b527-4d07-bf9f-4a4619810560 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:46.595859 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba2365-b527-4d07-bf9f-4a4619810560 service neutron] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:46.596142 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba2365-b527-4d07-bf9f-4a4619810560 service neutron] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:46.596417 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba2365-b527-4d07-bf9f-4a4619810560 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:46.605628 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ba2365-b527-4d07-bf9f-4a4619810560 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:46.607129 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ba2365-b527-4d07-bf9f-4a4619810560 service neutron] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:46.617429 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1339/2686] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 17:00:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:00:46.897791 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab520d1-25d5-4c0c-b3f2-367f0a9def31 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:46.899316 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-eab520d1-25d5-4c0c-b3f2-367f0a9def31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:46.947749 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:46.965845 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab520d1-25d5-4c0c-b3f2-367f0a9def31 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:46.969382 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89df9b5-9ecd-4143-8470-13b82d2a2ac3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:46.975928 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89df9b5-9ecd-4143-8470-13b82d2a2ac3 service cinder] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:46.975928 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89df9b5-9ecd-4143-8470-13b82d2a2ac3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:46.975928 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89df9b5-9ecd-4143-8470-13b82d2a2ac3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:46.975928 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-a89df9b5-9ecd-4143-8470-13b82d2a2ac3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:47.048740 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89df9b5-9ecd-4143-8470-13b82d2a2ac3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:47.050188 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89df9b5-9ecd-4143-8470-13b82d2a2ac3 service cinder] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:47.062153 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1348/2687] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 17:00:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:00:47.164817 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ba2365-b527-4d07-bf9f-4a4619810560 service neutron] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:47.166409 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-f7ba2365-b527-4d07-bf9f-4a4619810560 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:47.180133 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ba2365-b527-4d07-bf9f-4a4619810560 service neutron] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:47.185942 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b027f4-e39d-4901-bc78-544b24a5b439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:47.188434 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b027f4-e39d-4901-bc78-544b24a5b439 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:47.188434 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b027f4-e39d-4901-bc78-544b24a5b439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:47.188434 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b027f4-e39d-4901-bc78-544b24a5b439 admin admin] PATH_INFO: `/v3/projects/829acca1e5c5474e827a4cf5e35a3f22` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:47.189453 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b027f4-e39d-4901-bc78-544b24a5b439 admin admin] RBAC: Authorizing `identity:delete_project(project_id=829acca1e5c5474e827a4cf5e35a3f22)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:47.191445 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b027f4-e39d-4901-bc78-544b24a5b439 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:47.300065 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-e2b027f4-e39d-4901-bc78-544b24a5b439 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '829acca1e5c5474e827a4cf5e35a3f22', 'request_id': 'req-e2b027f4-e39d-4901-bc78-544b24a5b439'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:47.397081 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-e2b027f4-e39d-4901-bc78-544b24a5b439 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '829acca1e5c5474e827a4cf5e35a3f22', 'request_id': 'req-e2b027f4-e39d-4901-bc78-544b24a5b439'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:47.403171 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-e2b027f4-e39d-4901-bc78-544b24a5b439 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '829acca1e5c5474e827a4cf5e35a3f22', 'request_id': 'req-e2b027f4-e39d-4901-bc78-544b24a5b439'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:47.417010 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-e2b027f4-e39d-4901-bc78-544b24a5b439 admin admin] The token cache is being invalidate because project 829acca1e5c5474e827a4cf5e35a3f22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:00:47.417297 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-e2b027f4-e39d-4901-bc78-544b24a5b439 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:47.417965 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-e2b027f4-e39d-4901-bc78-544b24a5b439 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:47.419522 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1340/2688] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 17:00:47 2022] DELETE /identity/v3/projects/829acca1e5c5474e827a4cf5e35a3f22 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:00:47.426219 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8430a-5dc7-4142-91ff-6efe36d431aa None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:47.426511 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8430a-5dc7-4142-91ff-6efe36d431aa None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:47.426793 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8430a-5dc7-4142-91ff-6efe36d431aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:47.445874 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-6ea8430a-5dc7-4142-91ff-6efe36d431aa None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:00:47.447070 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-6ea8430a-5dc7-4142-91ff-6efe36d431aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:47.511603 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1349/2689] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:00:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:00:47.519625 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a97f28-d113-43c1-9d09-ffb4f0435460 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:47.519958 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a97f28-d113-43c1-9d09-ffb4f0435460 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:47.520238 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a97f28-d113-43c1-9d09-ffb4f0435460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:47.539744 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-60a97f28-d113-43c1-9d09-ffb4f0435460 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:00:47.540955 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-60a97f28-d113-43c1-9d09-ffb4f0435460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:47.549879 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1341/2690] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:00:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:00:47.554277 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea8430a-5dc7-4142-91ff-6efe36d431aa None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:47.566040 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea8430a-5dc7-4142-91ff-6efe36d431aa None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:47.569240 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2103adb5-4270-45af-88bc-bc6352f25999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:47.569921 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2103adb5-4270-45af-88bc-bc6352f25999 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:47.570207 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2103adb5-4270-45af-88bc-bc6352f25999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:47.570484 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2103adb5-4270-45af-88bc-bc6352f25999 admin admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:47.571242 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2103adb5-4270-45af-88bc-bc6352f25999 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 17:00:47.571550 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2103adb5-4270-45af-88bc-bc6352f25999 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:47.573216 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2103adb5-4270-45af-88bc-bc6352f25999 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:47.588551 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1350/2691] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Jul 18 17:00:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 17:00:47.589713 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a97f28-d113-43c1-9d09-ffb4f0435460 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:47.599830 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a97f28-d113-43c1-9d09-ffb4f0435460 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:47.606347 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d2093f-7301-41c5-a3f2-147699a6a533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:47.606967 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2093f-7301-41c5-a3f2-147699a6a533 admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:47.607269 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2093f-7301-41c5-a3f2-147699a6a533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:47.607520 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2093f-7301-41c5-a3f2-147699a6a533 admin admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:47.608238 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d2093f-7301-41c5-a3f2-147699a6a533 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:47.610121 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d2093f-7301-41c5-a3f2-147699a6a533 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:47.718505 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1342/2692] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 17:00:47 2022] POST /identity/v3/projects => generated 373 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:00:47.723313 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2103adb5-4270-45af-88bc-bc6352f25999 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:47.733706 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2103adb5-4270-45af-88bc-bc6352f25999 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:47.791895 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba4635d-04be-4107-9ee6-e210301cd9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:47.792563 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4635d-04be-4107-9ee6-e210301cd9b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:47.792852 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4635d-04be-4107-9ee6-e210301cd9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:47.793129 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4635d-04be-4107-9ee6-e210301cd9b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:47.793809 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba4635d-04be-4107-9ee6-e210301cd9b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:47.795902 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba4635d-04be-4107-9ee6-e210301cd9b8 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:47.804746 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:47.975046 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1351/2693] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 17:00:47 2022] POST /identity/v3/users => generated 287 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:00:47.979117 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d2093f-7301-41c5-a3f2-147699a6a533 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:47.989993 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d2093f-7301-41c5-a3f2-147699a6a533 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:47.994673 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a58bd-2866-42c7-bea3-9567ac17e1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:47.996236 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a58bd-2866-42c7-bea3-9567ac17e1d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:47.996236 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a58bd-2866-42c7-bea3-9567ac17e1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:47.996236 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a58bd-2866-42c7-bea3-9567ac17e1d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:47.996802 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21a58bd-2866-42c7-bea3-9567ac17e1d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:47.998396 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21a58bd-2866-42c7-bea3-9567ac17e1d5 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:48.011247 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1343/2694] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 17:00:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:00:48.015287 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba4635d-04be-4107-9ee6-e210301cd9b8 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:48.025259 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba4635d-04be-4107-9ee6-e210301cd9b8 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:48.029894 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14465e36-582a-46fe-bf64-7de8971b2684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:48.036403 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14465e36-582a-46fe-bf64-7de8971b2684 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:48.036403 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14465e36-582a-46fe-bf64-7de8971b2684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:48.036403 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14465e36-582a-46fe-bf64-7de8971b2684 admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:48.036403 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14465e36-582a-46fe-bf64-7de8971b2684 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:48.036403 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14465e36-582a-46fe-bf64-7de8971b2684 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:48.043699 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1352/2695] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 17:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:00:48.048542 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a58bd-2866-42c7-bea3-9567ac17e1d5 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:48.058428 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a58bd-2866-42c7-bea3-9567ac17e1d5 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:48.062867 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e091cb-784f-4388-ab82-a4de02e13307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:48.063726 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e091cb-784f-4388-ab82-a4de02e13307 admin admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:48.064014 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e091cb-784f-4388-ab82-a4de02e13307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:48.064291 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e091cb-784f-4388-ab82-a4de02e13307 admin admin] PATH_INFO: `/v3/projects/5c52bae4d58d4367b640bba767db1c64/users/ecc6bf8348ee4c9492066b3920ec4d9b/roles/ad3a2bc7b2094a4da1a95a143c8d9436` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:48.075369 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:48.079536 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e091cb-784f-4388-ab82-a4de02e13307 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c52bae4d58d4367b640bba767db1c64, user_id=ecc6bf8348ee4c9492066b3920ec4d9b, role_id=ad3a2bc7b2094a4da1a95a143c8d9436)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:48.088201 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e091cb-784f-4388-ab82-a4de02e13307 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:48.220528 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1344/2696] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 17:00:48 2022] PUT /identity/v3/projects/5c52bae4d58d4367b640bba767db1c64/users/ecc6bf8348ee4c9492066b3920ec4d9b/roles/ad3a2bc7b2094a4da1a95a143c8d9436 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:00:48.225742 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e210e6e-5a68-484d-afd3-bb1a3515bf79 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:48.226036 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e210e6e-5a68-484d-afd3-bb1a3515bf79 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:48.226321 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e210e6e-5a68-484d-afd3-bb1a3515bf79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:48.245871 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-1e210e6e-5a68-484d-afd3-bb1a3515bf79 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:00:48.247078 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-1e210e6e-5a68-484d-afd3-bb1a3515bf79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:48.305740 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1353/2697] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:00:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:00:48.315384 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e091cb-784f-4388-ab82-a4de02e13307 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:48.317121 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-d2e091cb-784f-4388-ab82-a4de02e13307 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:48.377364 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e091cb-784f-4388-ab82-a4de02e13307 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:48.381294 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d668c287-37da-492e-9ec7-146fce49e6ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:48.381940 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668c287-37da-492e-9ec7-146fce49e6ce service neutron] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:48.382226 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668c287-37da-492e-9ec7-146fce49e6ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:48.382502 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668c287-37da-492e-9ec7-146fce49e6ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:48.392123 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d668c287-37da-492e-9ec7-146fce49e6ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:48.393535 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d668c287-37da-492e-9ec7-146fce49e6ce service neutron] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:48.403045 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1345/2698] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 17:00:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:00:48.743687 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e210e6e-5a68-484d-afd3-bb1a3515bf79 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:48.755132 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e210e6e-5a68-484d-afd3-bb1a3515bf79 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:48.757480 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90597a0-f3be-4315-861f-019788151e8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:48.758116 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90597a0-f3be-4315-861f-019788151e8c service neutron] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:48.758397 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90597a0-f3be-4315-861f-019788151e8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:48.758672 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90597a0-f3be-4315-861f-019788151e8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:48.760419 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-c90597a0-f3be-4315-861f-019788151e8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:48.832446 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90597a0-f3be-4315-861f-019788151e8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:48.833878 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90597a0-f3be-4315-861f-019788151e8c service neutron] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:48.852432 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1354/2699] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 17:00:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 17:00:50.443209 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d668c287-37da-492e-9ec7-146fce49e6ce service neutron] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:50.446009 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-d668c287-37da-492e-9ec7-146fce49e6ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:50.475235 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d668c287-37da-492e-9ec7-146fce49e6ce service neutron] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:50.482666 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adfb353-c80d-4c51-a429-7c56cbb21d9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07f0c5bf1bee48a0bafdf7a9e4537c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:50.483449 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adfb353-c80d-4c51-a429-7c56cbb21d9b service nova] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:50.484449 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adfb353-c80d-4c51-a429-7c56cbb21d9b service nova] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:50.486028 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adfb353-c80d-4c51-a429-7c56cbb21d9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:50.492108 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-8adfb353-c80d-4c51-a429-7c56cbb21d9b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:50.512448 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adfb353-c80d-4c51-a429-7c56cbb21d9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:50.514003 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adfb353-c80d-4c51-a429-7c56cbb21d9b service nova] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:50.548973 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1346/2700] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 17:00:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:00:51.612728 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90597a0-f3be-4315-861f-019788151e8c service neutron] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:51.614164 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-c90597a0-f3be-4315-861f-019788151e8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:51.628872 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90597a0-f3be-4315-861f-019788151e8c service neutron] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:51.635831 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d3d703-334d-4068-b087-0d00655154e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:51.637076 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d3d703-334d-4068-b087-0d00655154e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:51.637598 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d3d703-334d-4068-b087-0d00655154e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:51.637970 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d3d703-334d-4068-b087-0d00655154e5 admin admin] PATH_INFO: `/v3/users/201c91e0de9546eea299d7e0a9771fd8` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:51.639426 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d3d703-334d-4068-b087-0d00655154e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=201c91e0de9546eea299d7e0a9771fd8)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:51.642993 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d3d703-334d-4068-b087-0d00655154e5 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:51.942138 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-85d3d703-334d-4068-b087-0d00655154e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '201c91e0de9546eea299d7e0a9771fd8'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:51.973212 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:INSERT=1,keystone:SELECT=90,keystone:DELETE=9 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:51.974784 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-85d3d703-334d-4068-b087-0d00655154e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '201c91e0de9546eea299d7e0a9771fd8'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:51.975856 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-85d3d703-334d-4068-b087-0d00655154e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '201c91e0de9546eea299d7e0a9771fd8'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:51.988436 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-85d3d703-334d-4068-b087-0d00655154e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '201c91e0de9546eea299d7e0a9771fd8'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:52.107906 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-85d3d703-334d-4068-b087-0d00655154e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '201c91e0de9546eea299d7e0a9771fd8'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:52.117521 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1355/2701] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 17:00:51 2022] DELETE /identity/v3/users/201c91e0de9546eea299d7e0a9771fd8 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 17:00:52.122167 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b999b6-f949-4ae3-9727-af3797cec5e4 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:52.122661 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b999b6-f949-4ae3-9727-af3797cec5e4 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:52.124252 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b999b6-f949-4ae3-9727-af3797cec5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:52.143559 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-a5b999b6-f949-4ae3-9727-af3797cec5e4 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:00:52.145109 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-a5b999b6-f949-4ae3-9727-af3797cec5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:52.218458 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1347/2702] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:00:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:00:52.228623 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d3d703-334d-4068-b087-0d00655154e5 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:52.230128 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-85d3d703-334d-4068-b087-0d00655154e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:52.291855 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d3d703-334d-4068-b087-0d00655154e5 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:52.296051 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659945bf-17c7-43d3-ac7a-f6f3fc855896 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:52.296901 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659945bf-17c7-43d3-ac7a-f6f3fc855896 service neutron] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:52.297290 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659945bf-17c7-43d3-ac7a-f6f3fc855896 service neutron] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:52.297714 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659945bf-17c7-43d3-ac7a-f6f3fc855896 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:52.308581 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659945bf-17c7-43d3-ac7a-f6f3fc855896 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:52.310350 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659945bf-17c7-43d3-ac7a-f6f3fc855896 service neutron] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:52.322239 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1356/2703] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 17:00:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:00:53.393967 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b999b6-f949-4ae3-9727-af3797cec5e4 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:53.396570 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-a5b999b6-f949-4ae3-9727-af3797cec5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:53.409329 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b999b6-f949-4ae3-9727-af3797cec5e4 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:53.414275 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62595f34-e1ba-46b1-a56a-f8abf2ec2940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:53.415139 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62595f34-e1ba-46b1-a56a-f8abf2ec2940 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:53.415422 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62595f34-e1ba-46b1-a56a-f8abf2ec2940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:53.415697 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62595f34-e1ba-46b1-a56a-f8abf2ec2940 admin admin] PATH_INFO: `/v3/projects/f98ca2aa84a8462898ea36d1a65e909a` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:53.416903 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62595f34-e1ba-46b1-a56a-f8abf2ec2940 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f98ca2aa84a8462898ea36d1a65e909a)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:53.418800 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62595f34-e1ba-46b1-a56a-f8abf2ec2940 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:53.589778 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-62595f34-e1ba-46b1-a56a-f8abf2ec2940 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f98ca2aa84a8462898ea36d1a65e909a', 'request_id': 'req-62595f34-e1ba-46b1-a56a-f8abf2ec2940'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:53.700320 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-62595f34-e1ba-46b1-a56a-f8abf2ec2940 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f98ca2aa84a8462898ea36d1a65e909a', 'request_id': 'req-62595f34-e1ba-46b1-a56a-f8abf2ec2940'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:53.708591 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-62595f34-e1ba-46b1-a56a-f8abf2ec2940 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f98ca2aa84a8462898ea36d1a65e909a', 'request_id': 'req-62595f34-e1ba-46b1-a56a-f8abf2ec2940'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:53.726523 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-62595f34-e1ba-46b1-a56a-f8abf2ec2940 admin admin] The token cache is being invalidate because project f98ca2aa84a8462898ea36d1a65e909a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:00:53.726824 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-62595f34-e1ba-46b1-a56a-f8abf2ec2940 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:53.727524 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-62595f34-e1ba-46b1-a56a-f8abf2ec2940 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:53.731765 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1348/2704] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 17:00:53 2022] DELETE /identity/v3/projects/f98ca2aa84a8462898ea36d1a65e909a => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:00:53.733468 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659945bf-17c7-43d3-ac7a-f6f3fc855896 service neutron] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:53.744105 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659945bf-17c7-43d3-ac7a-f6f3fc855896 service neutron] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:53.807633 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86d4114-19c6-4afb-9424-e807ade3b1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:53.808545 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d4114-19c6-4afb-9424-e807ade3b1b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:53.809156 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d4114-19c6-4afb-9424-e807ade3b1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:53.809422 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d4114-19c6-4afb-9424-e807ade3b1b8 admin admin] PATH_INFO: `/v3/users/698727bcc4bb4a8bb38c06a3e3a9b32b` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:53.810978 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86d4114-19c6-4afb-9424-e807ade3b1b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=698727bcc4bb4a8bb38c06a3e3a9b32b)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:53.812779 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86d4114-19c6-4afb-9424-e807ade3b1b8 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:54.062574 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-a86d4114-19c6-4afb-9424-e807ade3b1b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '698727bcc4bb4a8bb38c06a3e3a9b32b'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:54.077619 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-a86d4114-19c6-4afb-9424-e807ade3b1b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '698727bcc4bb4a8bb38c06a3e3a9b32b'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:54.078655 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-a86d4114-19c6-4afb-9424-e807ade3b1b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '698727bcc4bb4a8bb38c06a3e3a9b32b'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:54.086280 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-a86d4114-19c6-4afb-9424-e807ade3b1b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '698727bcc4bb4a8bb38c06a3e3a9b32b'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:54.197075 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-a86d4114-19c6-4afb-9424-e807ade3b1b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '698727bcc4bb4a8bb38c06a3e3a9b32b'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:54.212244 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1357/2705] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 17:00:53 2022] DELETE /identity/v3/users/698727bcc4bb4a8bb38c06a3e3a9b32b => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:00:54.808187 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62595f34-e1ba-46b1-a56a-f8abf2ec2940 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:54.814819 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-62595f34-e1ba-46b1-a56a-f8abf2ec2940 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:54.827392 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:54.853316 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62595f34-e1ba-46b1-a56a-f8abf2ec2940 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:54.952341 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bef880-c0b2-4a24-870e-5b1b4c01bac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:54.953683 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bef880-c0b2-4a24-870e-5b1b4c01bac2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:54.955309 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bef880-c0b2-4a24-870e-5b1b4c01bac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:54.955990 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bef880-c0b2-4a24-870e-5b1b4c01bac2 admin admin] PATH_INFO: `/v3/projects/1223b2cea1bf43e4807f3aef14133856` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:54.958064 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bef880-c0b2-4a24-870e-5b1b4c01bac2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1223b2cea1bf43e4807f3aef14133856)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:54.960366 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bef880-c0b2-4a24-870e-5b1b4c01bac2 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:55.037579 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b28da-fe3a-4db8-b532-2ffbef8e3882 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:55.038135 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b28da-fe3a-4db8-b532-2ffbef8e3882 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:55.038237 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b28da-fe3a-4db8-b532-2ffbef8e3882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:55.045468 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:55.069027 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-fe5b28da-fe3a-4db8-b532-2ffbef8e3882 None None] MFA Rules not processed for user `ecc6bf8348ee4c9492066b3920ec4d9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:00:55.073532 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-fe5b28da-fe3a-4db8-b532-2ffbef8e3882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:55.116179 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-f3bef880-c0b2-4a24-870e-5b1b4c01bac2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1223b2cea1bf43e4807f3aef14133856', 'request_id': 'req-f3bef880-c0b2-4a24-870e-5b1b4c01bac2'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:55.154059 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1358/2706] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:00:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:00:55.159145 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b28da-fe3a-4db8-b532-2ffbef8e3882 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:55.160488 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-fe5b28da-fe3a-4db8-b532-2ffbef8e3882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:55.176760 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b28da-fe3a-4db8-b532-2ffbef8e3882 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:55.236896 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-f3bef880-c0b2-4a24-870e-5b1b4c01bac2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1223b2cea1bf43e4807f3aef14133856', 'request_id': 'req-f3bef880-c0b2-4a24-870e-5b1b4c01bac2'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:55.237540 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53402668-5c57-4adc-a6c2-7597138f74ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:55.238323 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53402668-5c57-4adc-a6c2-7597138f74ca admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:55.238714 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53402668-5c57-4adc-a6c2-7597138f74ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:55.239087 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53402668-5c57-4adc-a6c2-7597138f74ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:55.239841 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53402668-5c57-4adc-a6c2-7597138f74ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:55.241763 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53402668-5c57-4adc-a6c2-7597138f74ca admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:55.244619 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-f3bef880-c0b2-4a24-870e-5b1b4c01bac2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1223b2cea1bf43e4807f3aef14133856', 'request_id': 'req-f3bef880-c0b2-4a24-870e-5b1b4c01bac2'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:55.257937 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-f3bef880-c0b2-4a24-870e-5b1b4c01bac2 admin admin] The token cache is being invalidate because project 1223b2cea1bf43e4807f3aef14133856 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:00:55.258208 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-f3bef880-c0b2-4a24-870e-5b1b4c01bac2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:55.258872 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-f3bef880-c0b2-4a24-870e-5b1b4c01bac2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:55.260441 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1349/2707] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 17:00:54 2022] DELETE /identity/v3/projects/1223b2cea1bf43e4807f3aef14133856 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:00:55.265073 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e22b9-3a3c-40ee-a6b8-3789df408390 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:55.265424 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e22b9-3a3c-40ee-a6b8-3789df408390 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:55.265795 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e22b9-3a3c-40ee-a6b8-3789df408390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:55.290880 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-8b9e22b9-3a3c-40ee-a6b8-3789df408390 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:00:55.292217 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-8b9e22b9-3a3c-40ee-a6b8-3789df408390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:55.302512 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1350/2708] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:00:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:00:55.311589 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87bdc0-ec11-4c91-b0e2-3a0c0b0f6d3f None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:55.312507 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87bdc0-ec11-4c91-b0e2-3a0c0b0f6d3f None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:55.312790 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87bdc0-ec11-4c91-b0e2-3a0c0b0f6d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:55.333104 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1359/2709] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 17:00:55 2022] POST /identity/v3/projects => generated 373 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 17:00:55.340804 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-6b87bdc0-ec11-4c91-b0e2-3a0c0b0f6d3f None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:00:55.340804 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-6b87bdc0-ec11-4c91-b0e2-3a0c0b0f6d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:55.342123 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53402668-5c57-4adc-a6c2-7597138f74ca admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:55.343985 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-53402668-5c57-4adc-a6c2-7597138f74ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:55.406508 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1351/2710] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:00:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:00:55.411240 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b87bdc0-ec11-4c91-b0e2-3a0c0b0f6d3f None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:55.420648 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b87bdc0-ec11-4c91-b0e2-3a0c0b0f6d3f None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:55.425907 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d6487-2391-4eb9-93bc-1ced6916cde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:55.426290 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d6487-2391-4eb9-93bc-1ced6916cde2 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:55.426718 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d6487-2391-4eb9-93bc-1ced6916cde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:55.426844 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d6487-2391-4eb9-93bc-1ced6916cde2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:55.427547 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271d6487-2391-4eb9-93bc-1ced6916cde2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 17:00:55.427886 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271d6487-2391-4eb9-93bc-1ced6916cde2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:55.428307 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53402668-5c57-4adc-a6c2-7597138f74ca admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:55.429480 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271d6487-2391-4eb9-93bc-1ced6916cde2 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:55.433556 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc58ea-e2c9-4459-bf0c-3ad8b82f7e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:55.434223 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc58ea-e2c9-4459-bf0c-3ad8b82f7e20 admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:55.434507 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc58ea-e2c9-4459-bf0c-3ad8b82f7e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:55.434789 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc58ea-e2c9-4459-bf0c-3ad8b82f7e20 admin admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:55.435498 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fc58ea-e2c9-4459-bf0c-3ad8b82f7e20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:55.437468 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fc58ea-e2c9-4459-bf0c-3ad8b82f7e20 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:55.441501 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1352/2711] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Jul 18 17:00:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 17:00:55.445792 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d6487-2391-4eb9-93bc-1ced6916cde2 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:55.456708 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d6487-2391-4eb9-93bc-1ced6916cde2 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:55.461547 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0fdaa3-fcb6-4d07-be72-a43b1d8413a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:55.462191 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0fdaa3-fcb6-4d07-be72-a43b1d8413a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:55.462574 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0fdaa3-fcb6-4d07-be72-a43b1d8413a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:55.462889 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0fdaa3-fcb6-4d07-be72-a43b1d8413a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:55.463582 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0fdaa3-fcb6-4d07-be72-a43b1d8413a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:55.465914 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0fdaa3-fcb6-4d07-be72-a43b1d8413a5 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:55.479794 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:55.534955 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1360/2712] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 17:00:55 2022] POST /identity/v3/users => generated 293 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:00:55.535682 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc58ea-e2c9-4459-bf0c-3ad8b82f7e20 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:55.537298 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-a7fc58ea-e2c9-4459-bf0c-3ad8b82f7e20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:55.546326 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:55.567994 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1353/2713] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 17:00:55 2022] POST /identity/v3/projects => generated 367 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 17:00:55.567994 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0fdaa3-fcb6-4d07-be72-a43b1d8413a5 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:55.593909 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc58ea-e2c9-4459-bf0c-3ad8b82f7e20 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:55.629859 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0fdaa3-fcb6-4d07-be72-a43b1d8413a5 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:55.634903 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03871f34-52f9-4451-a765-c1b41b9c05cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:55.635620 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03871f34-52f9-4451-a765-c1b41b9c05cd admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:55.635938 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03871f34-52f9-4451-a765-c1b41b9c05cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:55.636214 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03871f34-52f9-4451-a765-c1b41b9c05cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:55.636936 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03871f34-52f9-4451-a765-c1b41b9c05cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:55.638547 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03871f34-52f9-4451-a765-c1b41b9c05cd admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:55.643554 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387fd5f-58d5-4af7-b937-dd2fe9a1ac63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:55.644265 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387fd5f-58d5-4af7-b937-dd2fe9a1ac63 service neutron] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:55.644682 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387fd5f-58d5-4af7-b937-dd2fe9a1ac63 service neutron] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:55.645038 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387fd5f-58d5-4af7-b937-dd2fe9a1ac63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:55.646740 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-5387fd5f-58d5-4af7-b937-dd2fe9a1ac63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:55.649303 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1354/2714] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 17:00:55 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:00:55.649303 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03871f34-52f9-4451-a765-c1b41b9c05cd admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:55.657364 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5387fd5f-58d5-4af7-b937-dd2fe9a1ac63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:55.658811 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5387fd5f-58d5-4af7-b937-dd2fe9a1ac63 service neutron] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:55.660359 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03871f34-52f9-4451-a765-c1b41b9c05cd admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:55.666649 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed92fc-614c-4fee-ac6c-726c0edad99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:55.667270 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1361/2715] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 17:00:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:00:55.667950 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387fd5f-58d5-4af7-b937-dd2fe9a1ac63 service neutron] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:55.668219 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed92fc-614c-4fee-ac6c-726c0edad99b admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:55.668855 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed92fc-614c-4fee-ac6c-726c0edad99b admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:55.669575 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed92fc-614c-4fee-ac6c-726c0edad99b admin admin] PATH_INFO: `/v3/users` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:55.671111 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ed92fc-614c-4fee-ac6c-726c0edad99b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:55.674053 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ed92fc-614c-4fee-ac6c-726c0edad99b admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:55.680535 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387fd5f-58d5-4af7-b937-dd2fe9a1ac63 service neutron] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:55.686090 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712cf73e-bdb2-4c18-acdc-375bfe9252bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:55.686993 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712cf73e-bdb2-4c18-acdc-375bfe9252bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:55.687279 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712cf73e-bdb2-4c18-acdc-375bfe9252bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:55.687558 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712cf73e-bdb2-4c18-acdc-375bfe9252bc admin admin] PATH_INFO: `/v3/projects/a0eacaa1adc241dca3c99268c2ccbd22/users/e370db6f143f4cf5aaec84c0c550d574/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:55.706376 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712cf73e-bdb2-4c18-acdc-375bfe9252bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0eacaa1adc241dca3c99268c2ccbd22, user_id=e370db6f143f4cf5aaec84c0c550d574, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:55.709080 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712cf73e-bdb2-4c18-acdc-375bfe9252bc admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:55.786671 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1355/2716] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 17:00:55 2022] POST /identity/v3/users => generated 284 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:00:55.790472 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed92fc-614c-4fee-ac6c-726c0edad99b admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:55.797698 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1362/2717] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 17:00:55 2022] PUT /identity/v3/projects/a0eacaa1adc241dca3c99268c2ccbd22/users/e370db6f143f4cf5aaec84c0c550d574/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:00:55.802651 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed92fc-614c-4fee-ac6c-726c0edad99b admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:55.806069 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712cf73e-bdb2-4c18-acdc-375bfe9252bc admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:55.872757 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f0076d-7dd7-4401-b3a2-efc80bb84dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:55.873513 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f0076d-7dd7-4401-b3a2-efc80bb84dda admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:55.873869 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f0076d-7dd7-4401-b3a2-efc80bb84dda admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:55.874216 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f0076d-7dd7-4401-b3a2-efc80bb84dda admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:55.874514 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712cf73e-bdb2-4c18-acdc-375bfe9252bc admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:55.875086 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f0076d-7dd7-4401-b3a2-efc80bb84dda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:55.876815 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f0076d-7dd7-4401-b3a2-efc80bb84dda admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:55.879658 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ee0c2c-83e1-4e33-83b1-600a67634fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:55.880841 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee0c2c-83e1-4e33-83b1-600a67634fdf admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:55.881191 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee0c2c-83e1-4e33-83b1-600a67634fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:55.881532 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee0c2c-83e1-4e33-83b1-600a67634fdf admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:55.882340 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ee0c2c-83e1-4e33-83b1-600a67634fdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:55.884194 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ee0c2c-83e1-4e33-83b1-600a67634fdf admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:55.900780 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1363/2718] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 17:00:55 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 17:00:55.901877 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ee0c2c-83e1-4e33-83b1-600a67634fdf admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:55.907414 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1356/2719] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 17:00:55 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:00:55.911748 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f0076d-7dd7-4401-b3a2-efc80bb84dda admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:55.924182 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ee0c2c-83e1-4e33-83b1-600a67634fdf admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:55.928315 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f0076d-7dd7-4401-b3a2-efc80bb84dda admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:55.936514 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b776b3-c7c1-4863-b0d9-496151567466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:55.936514 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b776b3-c7c1-4863-b0d9-496151567466 admin admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:55.936514 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b776b3-c7c1-4863-b0d9-496151567466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:55.936514 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b776b3-c7c1-4863-b0d9-496151567466 admin admin] PATH_INFO: `/v3/projects/a0eacaa1adc241dca3c99268c2ccbd22/users/e370db6f143f4cf5aaec84c0c550d574/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:55.939061 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b776b3-c7c1-4863-b0d9-496151567466 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0eacaa1adc241dca3c99268c2ccbd22, user_id=e370db6f143f4cf5aaec84c0c550d574, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:55.940113 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8803086-5557-4f2c-b775-c28fd4e1852a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:55.940789 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8803086-5557-4f2c-b775-c28fd4e1852a admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:55.941146 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8803086-5557-4f2c-b775-c28fd4e1852a admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:55.941358 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8803086-5557-4f2c-b775-c28fd4e1852a admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:55.942096 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8803086-5557-4f2c-b775-c28fd4e1852a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:55.943692 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8803086-5557-4f2c-b775-c28fd4e1852a admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:55.946128 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b776b3-c7c1-4863-b0d9-496151567466 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:55.961087 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1357/2720] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 17:00:55 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:00:55.965376 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8803086-5557-4f2c-b775-c28fd4e1852a admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:55.968854 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1364/2721] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 17:00:55 2022] PUT /identity/v3/projects/a0eacaa1adc241dca3c99268c2ccbd22/users/e370db6f143f4cf5aaec84c0c550d574/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:00:55.985643 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8803086-5557-4f2c-b775-c28fd4e1852a admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:56.056238 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:56.065167 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c4f8c-27a4-423f-b974-1f3f94b74a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:56.066615 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c4f8c-27a4-423f-b974-1f3f94b74a15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:56.066615 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c4f8c-27a4-423f-b974-1f3f94b74a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:56.067118 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c4f8c-27a4-423f-b974-1f3f94b74a15 admin admin] PATH_INFO: `/v3/projects/16af59f502e34bd0a70d76c08476bdc3/users/bf643f82fe35457bb3d08b4d31ac6110/roles/ad3a2bc7b2094a4da1a95a143c8d9436` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:56.090290 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019c4f8c-27a4-423f-b974-1f3f94b74a15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16af59f502e34bd0a70d76c08476bdc3, user_id=bf643f82fe35457bb3d08b4d31ac6110, role_id=ad3a2bc7b2094a4da1a95a143c8d9436)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:56.104199 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019c4f8c-27a4-423f-b974-1f3f94b74a15 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:56.228599 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1358/2722] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 17:00:55 2022] PUT /identity/v3/projects/16af59f502e34bd0a70d76c08476bdc3/users/bf643f82fe35457bb3d08b4d31ac6110/roles/ad3a2bc7b2094a4da1a95a143c8d9436 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 17:00:56.240237 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556faedc-f58c-4ec3-a997-b1c120597041 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:56.240759 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556faedc-f58c-4ec3-a997-b1c120597041 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:56.240862 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556faedc-f58c-4ec3-a997-b1c120597041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:56.272977 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-556faedc-f58c-4ec3-a997-b1c120597041 None None] MFA Rules not processed for user `bf643f82fe35457bb3d08b4d31ac6110`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:00:56.274235 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-556faedc-f58c-4ec3-a997-b1c120597041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:56.290208 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:56.393586 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1365/2723] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:00:56 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:00:56.394358 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c4f8c-27a4-423f-b974-1f3f94b74a15 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:56.514954 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c4f8c-27a4-423f-b974-1f3f94b74a15 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:56.519794 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc3d87b-67c1-4839-837f-199233d67a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:56.520568 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3d87b-67c1-4839-837f-199233d67a97 admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:56.520858 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3d87b-67c1-4839-837f-199233d67a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:56.521138 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3d87b-67c1-4839-837f-199233d67a97 admin admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:56.521842 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc3d87b-67c1-4839-837f-199233d67a97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:56.524027 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc3d87b-67c1-4839-837f-199233d67a97 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:56.632119 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1359/2724] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 17:00:56 2022] POST /identity/v3/projects => generated 369 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 17:00:56.632604 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556faedc-f58c-4ec3-a997-b1c120597041 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:56.645195 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556faedc-f58c-4ec3-a997-b1c120597041 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:56.726231 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc19486b-6e4f-471c-9849-8a3b1a64ca78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:56.726424 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc19486b-6e4f-471c-9849-8a3b1a64ca78 admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:56.726716 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc19486b-6e4f-471c-9849-8a3b1a64ca78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:56.727076 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc19486b-6e4f-471c-9849-8a3b1a64ca78 admin admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:56.727942 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc19486b-6e4f-471c-9849-8a3b1a64ca78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:56.730473 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc19486b-6e4f-471c-9849-8a3b1a64ca78 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:56.826227 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1366/2725] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 17:00:56 2022] POST /identity/v3/users => generated 291 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 17:00:56.832438 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc3d87b-67c1-4839-837f-199233d67a97 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:56.841649 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc3d87b-67c1-4839-837f-199233d67a97 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:56.847498 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f92dea1-b8e1-4f9a-a212-11cd836cede9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:56.848294 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92dea1-b8e1-4f9a-a212-11cd836cede9 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:56.848575 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92dea1-b8e1-4f9a-a212-11cd836cede9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:56.848846 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92dea1-b8e1-4f9a-a212-11cd836cede9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:56.849619 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f92dea1-b8e1-4f9a-a212-11cd836cede9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:56.851207 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f92dea1-b8e1-4f9a-a212-11cd836cede9 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:56.862304 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1360/2726] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 17:00:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 17:00:56.866697 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc19486b-6e4f-471c-9849-8a3b1a64ca78 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:56.878742 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc19486b-6e4f-471c-9849-8a3b1a64ca78 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:56.885396 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd01ff9-c678-4fd4-885a-ec101032edbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:56.886677 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd01ff9-c678-4fd4-885a-ec101032edbf admin admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:56.887977 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd01ff9-c678-4fd4-885a-ec101032edbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:56.888282 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd01ff9-c678-4fd4-885a-ec101032edbf admin admin] PATH_INFO: `/v3/projects/a45679a2de7f488aaa1c517b5e073145/users/d229cc569fd249c988f4bd738a604dfe/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:56.913291 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd01ff9-c678-4fd4-885a-ec101032edbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a45679a2de7f488aaa1c517b5e073145, user_id=d229cc569fd249c988f4bd738a604dfe, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:56.916131 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd01ff9-c678-4fd4-885a-ec101032edbf admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:57.062028 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1367/2727] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 17:00:56 2022] PUT /identity/v3/projects/a45679a2de7f488aaa1c517b5e073145/users/d229cc569fd249c988f4bd738a604dfe/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:00:57.064411 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f92dea1-b8e1-4f9a-a212-11cd836cede9 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:57.074467 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f92dea1-b8e1-4f9a-a212-11cd836cede9 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:57.133506 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af2b2b5-7bfb-427d-9f0f-202b7fc25040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:57.134175 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2b2b5-7bfb-427d-9f0f-202b7fc25040 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:57.134462 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2b2b5-7bfb-427d-9f0f-202b7fc25040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:57.134737 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2b2b5-7bfb-427d-9f0f-202b7fc25040 admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:57.135461 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af2b2b5-7bfb-427d-9f0f-202b7fc25040 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:57.137086 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af2b2b5-7bfb-427d-9f0f-202b7fc25040 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:57.149203 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1361/2728] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 17:00:57 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:00:57.153434 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd01ff9-c678-4fd4-885a-ec101032edbf admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:57.165531 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd01ff9-c678-4fd4-885a-ec101032edbf admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:57.170269 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5254eab-33d8-446f-95a2-1f61e7665986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:57.171184 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5254eab-33d8-446f-95a2-1f61e7665986 admin admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:57.171484 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5254eab-33d8-446f-95a2-1f61e7665986 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:57.171773 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5254eab-33d8-446f-95a2-1f61e7665986 admin admin] PATH_INFO: `/v3/projects/a45679a2de7f488aaa1c517b5e073145/users/d229cc569fd249c988f4bd738a604dfe/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:57.174340 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5254eab-33d8-446f-95a2-1f61e7665986 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a45679a2de7f488aaa1c517b5e073145, user_id=d229cc569fd249c988f4bd738a604dfe, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:57.177005 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5254eab-33d8-446f-95a2-1f61e7665986 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:57.187233 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1368/2729] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 17:00:57 2022] PUT /identity/v3/projects/a45679a2de7f488aaa1c517b5e073145/users/d229cc569fd249c988f4bd738a604dfe/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:00:57.200200 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d636df6-a8aa-4cd9-ab19-5a8f85990f4f None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:57.200486 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d636df6-a8aa-4cd9-ab19-5a8f85990f4f None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:57.200812 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d636df6-a8aa-4cd9-ab19-5a8f85990f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:57.228471 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-4d636df6-a8aa-4cd9-ab19-5a8f85990f4f None None] MFA Rules not processed for user `d229cc569fd249c988f4bd738a604dfe`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:00:57.229859 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-4d636df6-a8aa-4cd9-ab19-5a8f85990f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:57.277414 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:57.317040 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1362/2730] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:00:57 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:00:57.343236 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5254eab-33d8-446f-95a2-1f61e7665986 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:57.345559 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-f5254eab-33d8-446f-95a2-1f61e7665986 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:57.423642 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5254eab-33d8-446f-95a2-1f61e7665986 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:57.427494 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d3779f-1c9e-4993-b848-f64a43be7b67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:57.429050 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3779f-1c9e-4993-b848-f64a43be7b67 service cinder] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:57.429329 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3779f-1c9e-4993-b848-f64a43be7b67 service cinder] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:57.429603 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3779f-1c9e-4993-b848-f64a43be7b67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:57.445204 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d3779f-1c9e-4993-b848-f64a43be7b67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:57.446892 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d3779f-1c9e-4993-b848-f64a43be7b67 service cinder] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:57.458611 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1369/2731] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 17:00:57 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:00:57.642316 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d636df6-a8aa-4cd9-ab19-5a8f85990f4f None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:57.642316 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-4d636df6-a8aa-4cd9-ab19-5a8f85990f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:57.660743 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d636df6-a8aa-4cd9-ab19-5a8f85990f4f None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:57.666395 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a26cb-15c0-4b29-9fcd-9cddf422127d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:57.667135 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a26cb-15c0-4b29-9fcd-9cddf422127d service cinder] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:57.667473 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a26cb-15c0-4b29-9fcd-9cddf422127d service cinder] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:57.668450 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a26cb-15c0-4b29-9fcd-9cddf422127d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:57.749412 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5a26cb-15c0-4b29-9fcd-9cddf422127d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:57.752070 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5a26cb-15c0-4b29-9fcd-9cddf422127d service cinder] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:57.763867 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1363/2732] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 17:00:57 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:01:02.970305 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1114da-968a-46e9-ad7d-19199b722be8 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:02.970815 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1114da-968a-46e9-ad7d-19199b722be8 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:02.970943 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1114da-968a-46e9-ad7d-19199b722be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:02.990628 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:01:03.001438 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-fd1114da-968a-46e9-ad7d-19199b722be8 None None] MFA Rules not processed for user `e370db6f143f4cf5aaec84c0c550d574`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:01:03.004961 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-fd1114da-968a-46e9-ad7d-19199b722be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:01:03.097672 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1370/2733] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:01:02 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:01:03.110734 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a26cb-15c0-4b29-9fcd-9cddf422127d service cinder] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:03.112936 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-5c5a26cb-15c0-4b29-9fcd-9cddf422127d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:01:03.202341 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a26cb-15c0-4b29-9fcd-9cddf422127d service cinder] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:03.208315 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aa9c78-724f-46f7-954d-c8b7035a6e72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07f0c5bf1bee48a0bafdf7a9e4537c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:03.208975 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa9c78-724f-46f7-954d-c8b7035a6e72 service nova] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:03.209272 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa9c78-724f-46f7-954d-c8b7035a6e72 service nova] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:03.209535 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa9c78-724f-46f7-954d-c8b7035a6e72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:03.211345 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-47aa9c78-724f-46f7-954d-c8b7035a6e72 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:01:03.274175 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aa9c78-724f-46f7-954d-c8b7035a6e72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:03.276051 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aa9c78-724f-46f7-954d-c8b7035a6e72 service nova] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:03.286646 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1364/2734] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 17:01:03 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:01:03.811818 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1114da-968a-46e9-ad7d-19199b722be8 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:03.875627 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1114da-968a-46e9-ad7d-19199b722be8 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:03.880491 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92473d7f-8895-4cbe-bdea-e61488561991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:03.881501 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92473d7f-8895-4cbe-bdea-e61488561991 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:03.881790 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92473d7f-8895-4cbe-bdea-e61488561991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:03.882068 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92473d7f-8895-4cbe-bdea-e61488561991 admin admin] PATH_INFO: `/v3/users/bf643f82fe35457bb3d08b4d31ac6110` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:03.883272 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92473d7f-8895-4cbe-bdea-e61488561991 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf643f82fe35457bb3d08b4d31ac6110)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:03.885260 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92473d7f-8895-4cbe-bdea-e61488561991 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:04.162509 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-92473d7f-8895-4cbe-bdea-e61488561991 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf643f82fe35457bb3d08b4d31ac6110'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:04.175372 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-92473d7f-8895-4cbe-bdea-e61488561991 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf643f82fe35457bb3d08b4d31ac6110'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:04.176101 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-92473d7f-8895-4cbe-bdea-e61488561991 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf643f82fe35457bb3d08b4d31ac6110'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:04.184114 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-92473d7f-8895-4cbe-bdea-e61488561991 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf643f82fe35457bb3d08b4d31ac6110'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:04.317437 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-92473d7f-8895-4cbe-bdea-e61488561991 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf643f82fe35457bb3d08b4d31ac6110'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:04.324729 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1371/2735] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 17:01:03 2022] DELETE /identity/v3/users/bf643f82fe35457bb3d08b4d31ac6110 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:01:04.330600 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c3f686-cbfc-4cd0-b628-3dcdf004fb91 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:04.331116 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c3f686-cbfc-4cd0-b628-3dcdf004fb91 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:04.331346 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c3f686-cbfc-4cd0-b628-3dcdf004fb91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:04.350345 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-84c3f686-cbfc-4cd0-b628-3dcdf004fb91 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:01:04.351587 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-84c3f686-cbfc-4cd0-b628-3dcdf004fb91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:01:04.355619 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:01:04.414417 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1365/2736] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:01:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:01:04.424853 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92473d7f-8895-4cbe-bdea-e61488561991 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:04.426262 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-92473d7f-8895-4cbe-bdea-e61488561991 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:01:04.441624 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:01:04.489479 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92473d7f-8895-4cbe-bdea-e61488561991 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:04.495595 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4229457c-e304-45c2-b5a0-a344aca1da3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:04.495595 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4229457c-e304-45c2-b5a0-a344aca1da3c service neutron] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:04.495595 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4229457c-e304-45c2-b5a0-a344aca1da3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:04.495595 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4229457c-e304-45c2-b5a0-a344aca1da3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:04.506301 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4229457c-e304-45c2-b5a0-a344aca1da3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:04.507977 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4229457c-e304-45c2-b5a0-a344aca1da3c service neutron] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:04.518288 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1372/2737] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 17:01:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:01:05.021654 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c3f686-cbfc-4cd0-b628-3dcdf004fb91 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:05.023091 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-84c3f686-cbfc-4cd0-b628-3dcdf004fb91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:01:05.037673 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c3f686-cbfc-4cd0-b628-3dcdf004fb91 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:05.041245 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29bdbb6-1371-44e4-91c5-af84f6c96481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:05.042221 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29bdbb6-1371-44e4-91c5-af84f6c96481 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:05.042733 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29bdbb6-1371-44e4-91c5-af84f6c96481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:05.043249 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29bdbb6-1371-44e4-91c5-af84f6c96481 admin admin] PATH_INFO: `/v3/projects/16af59f502e34bd0a70d76c08476bdc3` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:05.044559 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29bdbb6-1371-44e4-91c5-af84f6c96481 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16af59f502e34bd0a70d76c08476bdc3)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:05.046682 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29bdbb6-1371-44e4-91c5-af84f6c96481 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:05.270856 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-d29bdbb6-1371-44e4-91c5-af84f6c96481 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16af59f502e34bd0a70d76c08476bdc3', 'request_id': 'req-d29bdbb6-1371-44e4-91c5-af84f6c96481'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:05.431331 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-d29bdbb6-1371-44e4-91c5-af84f6c96481 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16af59f502e34bd0a70d76c08476bdc3', 'request_id': 'req-d29bdbb6-1371-44e4-91c5-af84f6c96481'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:05.438962 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-d29bdbb6-1371-44e4-91c5-af84f6c96481 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16af59f502e34bd0a70d76c08476bdc3', 'request_id': 'req-d29bdbb6-1371-44e4-91c5-af84f6c96481'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:05.453206 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-d29bdbb6-1371-44e4-91c5-af84f6c96481 admin admin] The token cache is being invalidate because project 16af59f502e34bd0a70d76c08476bdc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:01:05.453751 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-d29bdbb6-1371-44e4-91c5-af84f6c96481 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:05.454889 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-d29bdbb6-1371-44e4-91c5-af84f6c96481 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:05.457306 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1366/2738] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 17:01:05 2022] DELETE /identity/v3/projects/16af59f502e34bd0a70d76c08476bdc3 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:01:05.461533 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4229457c-e304-45c2-b5a0-a344aca1da3c service neutron] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:05.472510 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4229457c-e304-45c2-b5a0-a344aca1da3c service neutron] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:05.541956 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d39545d-2d4b-4d64-9ba3-56db2a3b1fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:05.542510 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39545d-2d4b-4d64-9ba3-56db2a3b1fe8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:05.542795 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39545d-2d4b-4d64-9ba3-56db2a3b1fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:05.543077 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39545d-2d4b-4d64-9ba3-56db2a3b1fe8 admin admin] PATH_INFO: `/v3/users/d229cc569fd249c988f4bd738a604dfe` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:05.544344 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d39545d-2d4b-4d64-9ba3-56db2a3b1fe8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d229cc569fd249c988f4bd738a604dfe)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:05.548312 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d39545d-2d4b-4d64-9ba3-56db2a3b1fe8 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:05.796131 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-5d39545d-2d4b-4d64-9ba3-56db2a3b1fe8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd229cc569fd249c988f4bd738a604dfe'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:05.814551 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-5d39545d-2d4b-4d64-9ba3-56db2a3b1fe8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd229cc569fd249c988f4bd738a604dfe'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:05.815508 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-5d39545d-2d4b-4d64-9ba3-56db2a3b1fe8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd229cc569fd249c988f4bd738a604dfe'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:05.828748 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-5d39545d-2d4b-4d64-9ba3-56db2a3b1fe8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd229cc569fd249c988f4bd738a604dfe'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:05.910947 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-5d39545d-2d4b-4d64-9ba3-56db2a3b1fe8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd229cc569fd249c988f4bd738a604dfe'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:05.927549 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1373/2739] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 17:01:05 2022] DELETE /identity/v3/users/d229cc569fd249c988f4bd738a604dfe => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:01:06.737919 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29bdbb6-1371-44e4-91c5-af84f6c96481 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:06.739520 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-d29bdbb6-1371-44e4-91c5-af84f6c96481 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:01:06.759096 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29bdbb6-1371-44e4-91c5-af84f6c96481 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:06.851678 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae787c2-dbb1-4220-9a4f-bcbdc0d310b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:06.853809 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae787c2-dbb1-4220-9a4f-bcbdc0d310b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:06.854212 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae787c2-dbb1-4220-9a4f-bcbdc0d310b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:06.855044 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae787c2-dbb1-4220-9a4f-bcbdc0d310b7 admin admin] PATH_INFO: `/v3/projects/a45679a2de7f488aaa1c517b5e073145` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:06.858154 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae787c2-dbb1-4220-9a4f-bcbdc0d310b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a45679a2de7f488aaa1c517b5e073145)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:06.861743 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae787c2-dbb1-4220-9a4f-bcbdc0d310b7 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:06.990374 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f9f53-4a8c-4586-bc72-fa8e180b5cf3 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:06.990876 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f9f53-4a8c-4586-bc72-fa8e180b5cf3 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:06.991155 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f9f53-4a8c-4586-bc72-fa8e180b5cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:07.017373 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-f98f9f53-4a8c-4586-bc72-fa8e180b5cf3 None None] MFA Rules not processed for user `ecc6bf8348ee4c9492066b3920ec4d9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:01:07.018573 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-f98f9f53-4a8c-4586-bc72-fa8e180b5cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:01:07.059439 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:01:07.085056 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1374/2740] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:01:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:01:07.108769 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711c478-9528-4b8f-a8b4-171ed99939ce None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:07.109063 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711c478-9528-4b8f-a8b4-171ed99939ce None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:07.109220 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:01:07.109371 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711c478-9528-4b8f-a8b4-171ed99939ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:07.114789 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-7ae787c2-dbb1-4220-9a4f-bcbdc0d310b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a45679a2de7f488aaa1c517b5e073145', 'request_id': 'req-7ae787c2-dbb1-4220-9a4f-bcbdc0d310b7'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:07.128825 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-9711c478-9528-4b8f-a8b4-171ed99939ce None None] MFA Rules not processed for user `1d601d9805b840e0b9f5f998b6e7327d`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:01:07.130082 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-9711c478-9528-4b8f-a8b4-171ed99939ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:01:07.190427 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1375/2741] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:01:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:01:07.216070 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-7ae787c2-dbb1-4220-9a4f-bcbdc0d310b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a45679a2de7f488aaa1c517b5e073145', 'request_id': 'req-7ae787c2-dbb1-4220-9a4f-bcbdc0d310b7'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:07.216450 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-7ae787c2-dbb1-4220-9a4f-bcbdc0d310b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a45679a2de7f488aaa1c517b5e073145', 'request_id': 'req-7ae787c2-dbb1-4220-9a4f-bcbdc0d310b7'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:07.236372 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-7ae787c2-dbb1-4220-9a4f-bcbdc0d310b7 admin admin] The token cache is being invalidate because project a45679a2de7f488aaa1c517b5e073145 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:01:07.236844 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-7ae787c2-dbb1-4220-9a4f-bcbdc0d310b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:07.238046 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-7ae787c2-dbb1-4220-9a4f-bcbdc0d310b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:07.244094 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1367/2742] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 17:01:06 2022] DELETE /identity/v3/projects/a45679a2de7f488aaa1c517b5e073145 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:01:07.245347 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096a202-3679-419e-a5c7-c42f587cf957 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:07.245634 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096a202-3679-419e-a5c7-c42f587cf957 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:07.245907 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096a202-3679-419e-a5c7-c42f587cf957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:07.280456 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-5096a202-3679-419e-a5c7-c42f587cf957 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:01:07.282230 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-5096a202-3679-419e-a5c7-c42f587cf957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:01:07.365179 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1376/2743] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:01:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:01:07.373456 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e28aa6-a8f2-4fd6-b9a2-a372fa22edbf None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:07.374308 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e28aa6-a8f2-4fd6-b9a2-a372fa22edbf None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:07.374799 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e28aa6-a8f2-4fd6-b9a2-a372fa22edbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:07.398610 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-13e28aa6-a8f2-4fd6-b9a2-a372fa22edbf None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:01:07.400244 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-13e28aa6-a8f2-4fd6-b9a2-a372fa22edbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:01:07.413886 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1368/2744] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:01:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:01:07.418430 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5096a202-3679-419e-a5c7-c42f587cf957 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:07.428446 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5096a202-3679-419e-a5c7-c42f587cf957 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:07.433730 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6781db-961e-45ba-b1cd-bda9a93a256f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:07.434790 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6781db-961e-45ba-b1cd-bda9a93a256f admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:07.435143 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6781db-961e-45ba-b1cd-bda9a93a256f admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:07.435532 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6781db-961e-45ba-b1cd-bda9a93a256f admin admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:07.436403 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6781db-961e-45ba-b1cd-bda9a93a256f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 17:01:07.436792 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6781db-961e-45ba-b1cd-bda9a93a256f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:07.439016 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6781db-961e-45ba-b1cd-bda9a93a256f admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:07.452795 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1377/2745] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Jul 18 17:01:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 17:01:07.457845 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e28aa6-a8f2-4fd6-b9a2-a372fa22edbf None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:07.476946 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e28aa6-a8f2-4fd6-b9a2-a372fa22edbf None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:07.483275 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccbf738-5f07-487b-aaa0-b4b0a8e20f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:07.483275 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccbf738-5f07-487b-aaa0-b4b0a8e20f77 admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:07.483275 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccbf738-5f07-487b-aaa0-b4b0a8e20f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:07.483586 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccbf738-5f07-487b-aaa0-b4b0a8e20f77 admin admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:07.484093 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccbf738-5f07-487b-aaa0-b4b0a8e20f77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:07.487086 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccbf738-5f07-487b-aaa0-b4b0a8e20f77 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:07.588447 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1369/2746] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 17:01:07 2022] POST /identity/v3/projects => generated 407 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:01:07.593321 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6781db-961e-45ba-b1cd-bda9a93a256f admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:07.610545 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6781db-961e-45ba-b1cd-bda9a93a256f admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:07.692599 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cf96ce-5ec5-42bd-819d-0eb932c1ac96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:07.693274 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf96ce-5ec5-42bd-819d-0eb932c1ac96 admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:07.693554 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf96ce-5ec5-42bd-819d-0eb932c1ac96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:07.693826 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf96ce-5ec5-42bd-819d-0eb932c1ac96 admin admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:07.694525 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cf96ce-5ec5-42bd-819d-0eb932c1ac96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:07.696493 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cf96ce-5ec5-42bd-819d-0eb932c1ac96 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:07.775585 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1378/2747] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 17:01:07 2022] POST /identity/v3/users => generated 304 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:01:07.779618 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccbf738-5f07-487b-aaa0-b4b0a8e20f77 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:07.790461 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccbf738-5f07-487b-aaa0-b4b0a8e20f77 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:07.795350 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd93df6-6fa9-46e7-bf6a-54a712e5c4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:07.796082 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd93df6-6fa9-46e7-bf6a-54a712e5c4b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:07.796434 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd93df6-6fa9-46e7-bf6a-54a712e5c4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:07.796782 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd93df6-6fa9-46e7-bf6a-54a712e5c4b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:07.798115 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd93df6-6fa9-46e7-bf6a-54a712e5c4b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:07.799941 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd93df6-6fa9-46e7-bf6a-54a712e5c4b0 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:07.812900 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1370/2748] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 17:01:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:01:07.814572 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cf96ce-5ec5-42bd-819d-0eb932c1ac96 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:07.819916 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:01:07.825179 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cf96ce-5ec5-42bd-819d-0eb932c1ac96 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:07.830303 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd92f17-dc57-4264-a2f5-69fc3a74465f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:07.831040 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd92f17-dc57-4264-a2f5-69fc3a74465f admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:07.831439 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd92f17-dc57-4264-a2f5-69fc3a74465f admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:07.831730 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd92f17-dc57-4264-a2f5-69fc3a74465f admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:07.832461 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd92f17-dc57-4264-a2f5-69fc3a74465f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:07.834117 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd92f17-dc57-4264-a2f5-69fc3a74465f admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:07.844798 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1379/2749] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 17:01:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:01:07.849081 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd93df6-6fa9-46e7-bf6a-54a712e5c4b0 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:07.858856 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd93df6-6fa9-46e7-bf6a-54a712e5c4b0 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:07.863986 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b24fac2-2d48-4a82-92dc-d925a7dc1116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:07.864878 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24fac2-2d48-4a82-92dc-d925a7dc1116 admin admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:07.865146 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24fac2-2d48-4a82-92dc-d925a7dc1116 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:07.865423 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24fac2-2d48-4a82-92dc-d925a7dc1116 admin admin] PATH_INFO: `/v3/projects/76f65c4a1ac84b80a2b2c22f0985ae21/users/fc51ae3b428943d5a3dd9de320d5938d/roles/ad3a2bc7b2094a4da1a95a143c8d9436` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:07.880632 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b24fac2-2d48-4a82-92dc-d925a7dc1116 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76f65c4a1ac84b80a2b2c22f0985ae21, user_id=fc51ae3b428943d5a3dd9de320d5938d, role_id=ad3a2bc7b2094a4da1a95a143c8d9436)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:07.883281 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b24fac2-2d48-4a82-92dc-d925a7dc1116 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:08.019523 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1371/2750] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 17:01:07 2022] PUT /identity/v3/projects/76f65c4a1ac84b80a2b2c22f0985ae21/users/fc51ae3b428943d5a3dd9de320d5938d/roles/ad3a2bc7b2094a4da1a95a143c8d9436 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 17:01:08.033837 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f612585-5d78-44cf-b845-44cbb382239e None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:08.034556 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f612585-5d78-44cf-b845-44cbb382239e None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:08.034989 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f612585-5d78-44cf-b845-44cbb382239e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:08.067199 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-3f612585-5d78-44cf-b845-44cbb382239e None None] MFA Rules not processed for user `fc51ae3b428943d5a3dd9de320d5938d`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:01:08.079420 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-3f612585-5d78-44cf-b845-44cbb382239e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:01:08.187204 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1380/2751] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:01:08 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:01:08.192146 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b24fac2-2d48-4a82-92dc-d925a7dc1116 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:08.257397 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b24fac2-2d48-4a82-92dc-d925a7dc1116 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:08.262063 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9177964b-7905-4ccb-80bd-2b0c77404b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:08.262726 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177964b-7905-4ccb-80bd-2b0c77404b47 admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:08.263022 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177964b-7905-4ccb-80bd-2b0c77404b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:08.263290 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177964b-7905-4ccb-80bd-2b0c77404b47 admin admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:08.264044 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9177964b-7905-4ccb-80bd-2b0c77404b47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:08.265968 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9177964b-7905-4ccb-80bd-2b0c77404b47 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:08.381232 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1372/2752] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 17:01:08 2022] POST /identity/v3/projects => generated 407 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:01:08.385221 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f612585-5d78-44cf-b845-44cbb382239e None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:08.395632 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f612585-5d78-44cf-b845-44cbb382239e None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:08.464030 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b1d7f7-3bfb-491e-99f1-50cec6a51614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:08.467573 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b1d7f7-3bfb-491e-99f1-50cec6a51614 admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:08.467573 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b1d7f7-3bfb-491e-99f1-50cec6a51614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:08.467573 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b1d7f7-3bfb-491e-99f1-50cec6a51614 admin admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:08.468616 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b1d7f7-3bfb-491e-99f1-50cec6a51614 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:08.471397 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b1d7f7-3bfb-491e-99f1-50cec6a51614 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:08.586214 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1381/2753] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 17:01:08 2022] POST /identity/v3/users => generated 310 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:01:08.590189 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9177964b-7905-4ccb-80bd-2b0c77404b47 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:08.601394 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9177964b-7905-4ccb-80bd-2b0c77404b47 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:08.606336 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ee4864-18ee-4315-8325-a467e25e06eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:08.607083 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee4864-18ee-4315-8325-a467e25e06eb admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:08.607473 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee4864-18ee-4315-8325-a467e25e06eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:08.607816 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee4864-18ee-4315-8325-a467e25e06eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:08.609012 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ee4864-18ee-4315-8325-a467e25e06eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:08.610956 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ee4864-18ee-4315-8325-a467e25e06eb admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:08.622480 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1373/2754] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 17:01:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:01:08.627258 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b1d7f7-3bfb-491e-99f1-50cec6a51614 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:08.638670 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b1d7f7-3bfb-491e-99f1-50cec6a51614 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:08.645188 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc6d09f-3cf3-468f-bb39-7771edc0f1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:08.646212 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc6d09f-3cf3-468f-bb39-7771edc0f1df admin admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:08.646537 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc6d09f-3cf3-468f-bb39-7771edc0f1df admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:08.646820 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc6d09f-3cf3-468f-bb39-7771edc0f1df admin admin] PATH_INFO: `/v3/projects/ad6b222523cb4ffabd391dabd7275d0c/users/e472a48ba1204bc88adb54a65e5bc7b7/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:08.665839 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc6d09f-3cf3-468f-bb39-7771edc0f1df admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad6b222523cb4ffabd391dabd7275d0c, user_id=e472a48ba1204bc88adb54a65e5bc7b7, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:08.669107 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc6d09f-3cf3-468f-bb39-7771edc0f1df admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:08.745538 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1382/2755] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 17:01:08 2022] PUT /identity/v3/projects/ad6b222523cb4ffabd391dabd7275d0c/users/e472a48ba1204bc88adb54a65e5bc7b7/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 17:01:08.749483 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ee4864-18ee-4315-8325-a467e25e06eb admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:08.759902 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ee4864-18ee-4315-8325-a467e25e06eb admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:08.793280 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:01:08.820263 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0477abb3-8f60-4db3-9f85-cfddc047d4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:08.826713 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477abb3-8f60-4db3-9f85-cfddc047d4eb admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:08.826713 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477abb3-8f60-4db3-9f85-cfddc047d4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:08.826713 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477abb3-8f60-4db3-9f85-cfddc047d4eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:08.826713 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0477abb3-8f60-4db3-9f85-cfddc047d4eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:08.826713 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0477abb3-8f60-4db3-9f85-cfddc047d4eb admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:08.834138 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1374/2756] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 17:01:08 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:01:08.838418 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc6d09f-3cf3-468f-bb39-7771edc0f1df admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:08.849291 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc6d09f-3cf3-468f-bb39-7771edc0f1df admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:08.853901 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6011d6f6-e8d5-40eb-95c7-e2fce17c7532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:08.854808 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011d6f6-e8d5-40eb-95c7-e2fce17c7532 admin admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:08.855092 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011d6f6-e8d5-40eb-95c7-e2fce17c7532 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:08.855367 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011d6f6-e8d5-40eb-95c7-e2fce17c7532 admin admin] PATH_INFO: `/v3/projects/ad6b222523cb4ffabd391dabd7275d0c/users/e472a48ba1204bc88adb54a65e5bc7b7/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:08.857369 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6011d6f6-e8d5-40eb-95c7-e2fce17c7532 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad6b222523cb4ffabd391dabd7275d0c, user_id=e472a48ba1204bc88adb54a65e5bc7b7, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:08.860344 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6011d6f6-e8d5-40eb-95c7-e2fce17c7532 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:08.870713 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1383/2757] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 17:01:08 2022] PUT /identity/v3/projects/ad6b222523cb4ffabd391dabd7275d0c/users/e472a48ba1204bc88adb54a65e5bc7b7/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:01:08.946808 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb0de67-dad8-4866-b01a-d02620ff8414 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:08.947096 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb0de67-dad8-4866-b01a-d02620ff8414 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:08.947374 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb0de67-dad8-4866-b01a-d02620ff8414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:08.977277 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-1bb0de67-dad8-4866-b01a-d02620ff8414 None None] MFA Rules not processed for user `e472a48ba1204bc88adb54a65e5bc7b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:01:08.978520 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-1bb0de67-dad8-4866-b01a-d02620ff8414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:01:09.052534 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1375/2758] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:01:08 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:01:09.063050 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6011d6f6-e8d5-40eb-95c7-e2fce17c7532 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:09.064925 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-6011d6f6-e8d5-40eb-95c7-e2fce17c7532 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:01:09.101523 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:01:09.127435 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6011d6f6-e8d5-40eb-95c7-e2fce17c7532 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:09.132401 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0090034-0cbe-427c-98eb-d3b2ec18d7dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:09.133330 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0090034-0cbe-427c-98eb-d3b2ec18d7dd service cinder] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:09.133603 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0090034-0cbe-427c-98eb-d3b2ec18d7dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:09.133912 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0090034-0cbe-427c-98eb-d3b2ec18d7dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:09.145132 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0090034-0cbe-427c-98eb-d3b2ec18d7dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:09.146728 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0090034-0cbe-427c-98eb-d3b2ec18d7dd service cinder] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:09.157775 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1384/2759] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 17:01:09 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:01:09.737668 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb0de67-dad8-4866-b01a-d02620ff8414 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:09.747416 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb0de67-dad8-4866-b01a-d02620ff8414 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:09.751660 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b54276-5fe3-4fe5-8791-460a8c9acb55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:09.755950 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b54276-5fe3-4fe5-8791-460a8c9acb55 service cinder] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:09.755950 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b54276-5fe3-4fe5-8791-460a8c9acb55 service cinder] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:09.755950 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b54276-5fe3-4fe5-8791-460a8c9acb55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:09.809954 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b54276-5fe3-4fe5-8791-460a8c9acb55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:09.811378 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b54276-5fe3-4fe5-8791-460a8c9acb55 service cinder] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:09.821968 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1376/2760] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 17:01:09 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:01:18.319467 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0090034-0cbe-427c-98eb-d3b2ec18d7dd service cinder] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:18.383524 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0090034-0cbe-427c-98eb-d3b2ec18d7dd service cinder] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:18.388132 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2918121-db42-4e15-bcdd-31213791f20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:18.389004 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2918121-db42-4e15-bcdd-31213791f20d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:18.389285 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2918121-db42-4e15-bcdd-31213791f20d admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:18.389561 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2918121-db42-4e15-bcdd-31213791f20d admin admin] PATH_INFO: `/v3/users/fc51ae3b428943d5a3dd9de320d5938d` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:18.390763 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2918121-db42-4e15-bcdd-31213791f20d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc51ae3b428943d5a3dd9de320d5938d)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:18.392740 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2918121-db42-4e15-bcdd-31213791f20d admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:18.638304 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-f2918121-db42-4e15-bcdd-31213791f20d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc51ae3b428943d5a3dd9de320d5938d'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:18.650698 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-f2918121-db42-4e15-bcdd-31213791f20d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc51ae3b428943d5a3dd9de320d5938d'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:18.651333 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-f2918121-db42-4e15-bcdd-31213791f20d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc51ae3b428943d5a3dd9de320d5938d'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:18.658376 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-f2918121-db42-4e15-bcdd-31213791f20d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc51ae3b428943d5a3dd9de320d5938d'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:18.761856 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-f2918121-db42-4e15-bcdd-31213791f20d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc51ae3b428943d5a3dd9de320d5938d'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:18.769035 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1385/2761] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 17:01:18 2022] DELETE /identity/v3/users/fc51ae3b428943d5a3dd9de320d5938d => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:01:18.773585 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37545e8f-432f-4ac8-be71-3712f8ee4a64 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:18.774079 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37545e8f-432f-4ac8-be71-3712f8ee4a64 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:18.774196 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37545e8f-432f-4ac8-be71-3712f8ee4a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:18.791444 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-37545e8f-432f-4ac8-be71-3712f8ee4a64 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:01:18.792684 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-37545e8f-432f-4ac8-be71-3712f8ee4a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:01:18.838866 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:01:18.850615 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1377/2762] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:01:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:01:18.860304 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2918121-db42-4e15-bcdd-31213791f20d admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:18.861729 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-f2918121-db42-4e15-bcdd-31213791f20d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:01:18.919497 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2918121-db42-4e15-bcdd-31213791f20d admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:18.923222 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbc475c-f1bd-431a-820a-970df6e6a96f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:18.923900 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc475c-f1bd-431a-820a-970df6e6a96f service neutron] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:18.924180 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc475c-f1bd-431a-820a-970df6e6a96f service neutron] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:18.924455 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc475c-f1bd-431a-820a-970df6e6a96f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:18.933605 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbc475c-f1bd-431a-820a-970df6e6a96f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:18.935143 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbc475c-f1bd-431a-820a-970df6e6a96f service neutron] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:18.939166 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:01:18.945993 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1386/2763] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 17:01:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:01:19.351796 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37545e8f-432f-4ac8-be71-3712f8ee4a64 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:19.353288 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-37545e8f-432f-4ac8-be71-3712f8ee4a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:01:19.366623 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37545e8f-432f-4ac8-be71-3712f8ee4a64 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:19.371269 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92401e5a-10a9-4f3b-a761-ac0df24204dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:19.375366 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92401e5a-10a9-4f3b-a761-ac0df24204dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:19.375366 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92401e5a-10a9-4f3b-a761-ac0df24204dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:19.375366 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92401e5a-10a9-4f3b-a761-ac0df24204dc admin admin] PATH_INFO: `/v3/projects/76f65c4a1ac84b80a2b2c22f0985ae21` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:19.375366 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92401e5a-10a9-4f3b-a761-ac0df24204dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=76f65c4a1ac84b80a2b2c22f0985ae21)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:19.375796 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92401e5a-10a9-4f3b-a761-ac0df24204dc admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:19.496849 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-92401e5a-10a9-4f3b-a761-ac0df24204dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76f65c4a1ac84b80a2b2c22f0985ae21', 'request_id': 'req-92401e5a-10a9-4f3b-a761-ac0df24204dc'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:19.584776 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-92401e5a-10a9-4f3b-a761-ac0df24204dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76f65c4a1ac84b80a2b2c22f0985ae21', 'request_id': 'req-92401e5a-10a9-4f3b-a761-ac0df24204dc'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:19.590969 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-92401e5a-10a9-4f3b-a761-ac0df24204dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76f65c4a1ac84b80a2b2c22f0985ae21', 'request_id': 'req-92401e5a-10a9-4f3b-a761-ac0df24204dc'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:19.602520 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-92401e5a-10a9-4f3b-a761-ac0df24204dc admin admin] The token cache is being invalidate because project 76f65c4a1ac84b80a2b2c22f0985ae21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:01:19.602809 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-92401e5a-10a9-4f3b-a761-ac0df24204dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:19.603462 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-92401e5a-10a9-4f3b-a761-ac0df24204dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:19.605040 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1378/2764] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 17:01:19 2022] DELETE /identity/v3/projects/76f65c4a1ac84b80a2b2c22f0985ae21 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:01:19.608988 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbc475c-f1bd-431a-820a-970df6e6a96f service neutron] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:19.619061 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbc475c-f1bd-431a-820a-970df6e6a96f service neutron] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:19.680160 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0186f-ad23-43c2-b72e-607f667c61f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:19.681221 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0186f-ad23-43c2-b72e-607f667c61f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:19.681569 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0186f-ad23-43c2-b72e-607f667c61f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:19.681919 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0186f-ad23-43c2-b72e-607f667c61f4 admin admin] PATH_INFO: `/v3/users/e472a48ba1204bc88adb54a65e5bc7b7` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:19.683218 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e0186f-ad23-43c2-b72e-607f667c61f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e472a48ba1204bc88adb54a65e5bc7b7)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:19.685344 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e0186f-ad23-43c2-b72e-607f667c61f4 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:19.936256 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-58e0186f-ad23-43c2-b72e-607f667c61f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e472a48ba1204bc88adb54a65e5bc7b7'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:19.948259 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-58e0186f-ad23-43c2-b72e-607f667c61f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e472a48ba1204bc88adb54a65e5bc7b7'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:19.948926 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-58e0186f-ad23-43c2-b72e-607f667c61f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e472a48ba1204bc88adb54a65e5bc7b7'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:19.956259 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-58e0186f-ad23-43c2-b72e-607f667c61f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e472a48ba1204bc88adb54a65e5bc7b7'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:20.015131 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-58e0186f-ad23-43c2-b72e-607f667c61f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e472a48ba1204bc88adb54a65e5bc7b7'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:20.022422 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1387/2765] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 17:01:19 2022] DELETE /identity/v3/users/e472a48ba1204bc88adb54a65e5bc7b7 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:01:20.688532 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92401e5a-10a9-4f3b-a761-ac0df24204dc admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:20.690600 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-92401e5a-10a9-4f3b-a761-ac0df24204dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:01:20.703787 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92401e5a-10a9-4f3b-a761-ac0df24204dc admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:20.762836 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e4e8a7-f845-4c5a-b224-d9afd73b4620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:20.763798 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e4e8a7-f845-4c5a-b224-d9afd73b4620 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:20.764088 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e4e8a7-f845-4c5a-b224-d9afd73b4620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:20.764387 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e4e8a7-f845-4c5a-b224-d9afd73b4620 admin admin] PATH_INFO: `/v3/projects/ad6b222523cb4ffabd391dabd7275d0c` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:20.765683 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e4e8a7-f845-4c5a-b224-d9afd73b4620 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad6b222523cb4ffabd391dabd7275d0c)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:20.768138 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e4e8a7-f845-4c5a-b224-d9afd73b4620 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:20.917382 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-47e4e8a7-f845-4c5a-b224-d9afd73b4620 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad6b222523cb4ffabd391dabd7275d0c', 'request_id': 'req-47e4e8a7-f845-4c5a-b224-d9afd73b4620'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:21.007435 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-47e4e8a7-f845-4c5a-b224-d9afd73b4620 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad6b222523cb4ffabd391dabd7275d0c', 'request_id': 'req-47e4e8a7-f845-4c5a-b224-d9afd73b4620'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:21.014170 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-47e4e8a7-f845-4c5a-b224-d9afd73b4620 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad6b222523cb4ffabd391dabd7275d0c', 'request_id': 'req-47e4e8a7-f845-4c5a-b224-d9afd73b4620'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:21.025460 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-47e4e8a7-f845-4c5a-b224-d9afd73b4620 admin admin] The token cache is being invalidate because project ad6b222523cb4ffabd391dabd7275d0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:01:21.025752 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-47e4e8a7-f845-4c5a-b224-d9afd73b4620 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:21.026388 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-47e4e8a7-f845-4c5a-b224-d9afd73b4620 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:21.028016 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1379/2766] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 17:01:20 2022] DELETE /identity/v3/projects/ad6b222523cb4ffabd391dabd7275d0c => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:01:21.032988 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a42845-9c5a-4a1d-80c7-ee61fa574371 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:21.034064 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a42845-9c5a-4a1d-80c7-ee61fa574371 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:21.034222 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a42845-9c5a-4a1d-80c7-ee61fa574371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:21.053800 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-94a42845-9c5a-4a1d-80c7-ee61fa574371 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:01:21.055011 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-94a42845-9c5a-4a1d-80c7-ee61fa574371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:01:21.116058 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1388/2767] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:01:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:01:21.124165 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa4d4d-5938-4436-88b3-1191eff13dcb None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:21.124478 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa4d4d-5938-4436-88b3-1191eff13dcb None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:21.124762 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa4d4d-5938-4436-88b3-1191eff13dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:21.138275 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:01:21.143687 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-40fa4d4d-5938-4436-88b3-1191eff13dcb None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:01:21.144929 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-40fa4d4d-5938-4436-88b3-1191eff13dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:01:21.153045 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1380/2768] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:01:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:01:21.157508 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a42845-9c5a-4a1d-80c7-ee61fa574371 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:21.180556 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a42845-9c5a-4a1d-80c7-ee61fa574371 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:21.185385 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e70f16-be07-4089-be44-60f4366a876c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:21.186049 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e70f16-be07-4089-be44-60f4366a876c admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:21.186331 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e70f16-be07-4089-be44-60f4366a876c admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:21.186603 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e70f16-be07-4089-be44-60f4366a876c admin admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:21.187329 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e70f16-be07-4089-be44-60f4366a876c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 17:01:21.187634 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e70f16-be07-4089-be44-60f4366a876c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:21.190507 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e70f16-be07-4089-be44-60f4366a876c admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:21.206017 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1389/2769] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Jul 18 17:01:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 17:01:21.210498 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa4d4d-5938-4436-88b3-1191eff13dcb None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:21.220201 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa4d4d-5938-4436-88b3-1191eff13dcb None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:21.225611 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9568f3-dd5c-42bf-afcc-a7e17619f124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:21.226595 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9568f3-dd5c-42bf-afcc-a7e17619f124 admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:21.226915 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9568f3-dd5c-42bf-afcc-a7e17619f124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:21.227219 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9568f3-dd5c-42bf-afcc-a7e17619f124 admin admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:21.227935 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9568f3-dd5c-42bf-afcc-a7e17619f124 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:21.229845 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9568f3-dd5c-42bf-afcc-a7e17619f124 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:21.317343 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1381/2770] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 17:01:21 2022] POST /identity/v3/projects => generated 361 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:01:21.321592 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e70f16-be07-4089-be44-60f4366a876c admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:21.327815 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:01:21.332007 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e70f16-be07-4089-be44-60f4366a876c admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:21.387833 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366dd77d-9e77-4622-b70f-f29593ecd8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:21.388504 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366dd77d-9e77-4622-b70f-f29593ecd8d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:21.388783 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366dd77d-9e77-4622-b70f-f29593ecd8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:21.389055 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366dd77d-9e77-4622-b70f-f29593ecd8d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:21.389728 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366dd77d-9e77-4622-b70f-f29593ecd8d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:21.391621 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366dd77d-9e77-4622-b70f-f29593ecd8d9 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:21.499652 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1390/2771] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 17:01:21 2022] POST /identity/v3/users => generated 281 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:01:21.504422 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9568f3-dd5c-42bf-afcc-a7e17619f124 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:21.515110 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9568f3-dd5c-42bf-afcc-a7e17619f124 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:21.520334 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f5f08-d193-4f1c-a4a4-8786e2161eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:21.520971 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f5f08-d193-4f1c-a4a4-8786e2161eb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:21.521280 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f5f08-d193-4f1c-a4a4-8786e2161eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:21.521563 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f5f08-d193-4f1c-a4a4-8786e2161eb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:21.522341 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7f5f08-d193-4f1c-a4a4-8786e2161eb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:21.524005 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7f5f08-d193-4f1c-a4a4-8786e2161eb1 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:21.535637 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1382/2772] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 17:01:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 17:01:21.541020 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366dd77d-9e77-4622-b70f-f29593ecd8d9 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:21.552242 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366dd77d-9e77-4622-b70f-f29593ecd8d9 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:21.561190 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f3c54-2cc3-436b-a50c-1c88053e5081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:21.561851 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f3c54-2cc3-436b-a50c-1c88053e5081 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:21.562131 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f3c54-2cc3-436b-a50c-1c88053e5081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:21.562403 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f3c54-2cc3-436b-a50c-1c88053e5081 admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:21.563122 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8f3c54-2cc3-436b-a50c-1c88053e5081 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:21.564732 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8f3c54-2cc3-436b-a50c-1c88053e5081 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:21.577779 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1391/2773] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 17:01:21 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:01:21.582276 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f5f08-d193-4f1c-a4a4-8786e2161eb1 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:21.592454 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f5f08-d193-4f1c-a4a4-8786e2161eb1 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:21.597736 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cfc9dd-832a-437a-9e2a-6644abde1605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:21.598649 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cfc9dd-832a-437a-9e2a-6644abde1605 admin admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:21.599043 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cfc9dd-832a-437a-9e2a-6644abde1605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:21.599323 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cfc9dd-832a-437a-9e2a-6644abde1605 admin admin] PATH_INFO: `/v3/projects/32880a0915c24e288e0f44a6fac41dbb/users/b3f95d855c1649b586d2324454aef936/roles/ad3a2bc7b2094a4da1a95a143c8d9436` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:21.614388 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cfc9dd-832a-437a-9e2a-6644abde1605 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32880a0915c24e288e0f44a6fac41dbb, user_id=b3f95d855c1649b586d2324454aef936, role_id=ad3a2bc7b2094a4da1a95a143c8d9436)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:21.617072 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cfc9dd-832a-437a-9e2a-6644abde1605 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:21.693765 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1383/2774] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 17:01:21 2022] PUT /identity/v3/projects/32880a0915c24e288e0f44a6fac41dbb/users/b3f95d855c1649b586d2324454aef936/roles/ad3a2bc7b2094a4da1a95a143c8d9436 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:01:21.704332 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db10ea50-e3f1-4da8-b417-55dfef484071 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:21.705958 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db10ea50-e3f1-4da8-b417-55dfef484071 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:21.705958 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db10ea50-e3f1-4da8-b417-55dfef484071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:21.731517 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-db10ea50-e3f1-4da8-b417-55dfef484071 None None] MFA Rules not processed for user `b3f95d855c1649b586d2324454aef936`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:01:21.732765 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-db10ea50-e3f1-4da8-b417-55dfef484071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:01:21.799029 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1392/2775] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:01:21 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:01:21.836686 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cfc9dd-832a-437a-9e2a-6644abde1605 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:21.838395 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-d9cfc9dd-832a-437a-9e2a-6644abde1605 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:01:21.900278 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cfc9dd-832a-437a-9e2a-6644abde1605 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:21.905257 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de0494-7b0d-4467-9b0c-e4789988ff8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:21.905906 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de0494-7b0d-4467-9b0c-e4789988ff8b service cinder] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:21.906185 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de0494-7b0d-4467-9b0c-e4789988ff8b service cinder] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:21.906459 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de0494-7b0d-4467-9b0c-e4789988ff8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:21.916138 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de0494-7b0d-4467-9b0c-e4789988ff8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:21.917645 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de0494-7b0d-4467-9b0c-e4789988ff8b service cinder] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:21.928025 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1384/2776] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 17:01:21 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:01:21.942648 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db10ea50-e3f1-4da8-b417-55dfef484071 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:22.008948 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db10ea50-e3f1-4da8-b417-55dfef484071 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:22.013603 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ce83c-0830-478e-b68f-ea998157a168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:22.015073 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ce83c-0830-478e-b68f-ea998157a168 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:22.015073 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ce83c-0830-478e-b68f-ea998157a168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:22.015073 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ce83c-0830-478e-b68f-ea998157a168 admin admin] PATH_INFO: `/v3/users/b3f95d855c1649b586d2324454aef936` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:22.016255 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221ce83c-0830-478e-b68f-ea998157a168 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3f95d855c1649b586d2324454aef936)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:22.018208 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221ce83c-0830-478e-b68f-ea998157a168 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:22.032704 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:01:22.268273 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-221ce83c-0830-478e-b68f-ea998157a168 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3f95d855c1649b586d2324454aef936'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:22.281007 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-221ce83c-0830-478e-b68f-ea998157a168 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3f95d855c1649b586d2324454aef936'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:22.281788 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-221ce83c-0830-478e-b68f-ea998157a168 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3f95d855c1649b586d2324454aef936'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:22.288856 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-221ce83c-0830-478e-b68f-ea998157a168 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3f95d855c1649b586d2324454aef936'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:22.384789 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-221ce83c-0830-478e-b68f-ea998157a168 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3f95d855c1649b586d2324454aef936'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:22.391295 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1393/2777] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 17:01:21 2022] DELETE /identity/v3/users/b3f95d855c1649b586d2324454aef936 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:01:22.395923 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc66223-f75e-4802-942a-5cd9846cbfea None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:22.396216 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc66223-f75e-4802-942a-5cd9846cbfea None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:22.396509 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc66223-f75e-4802-942a-5cd9846cbfea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:22.415197 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-5bc66223-f75e-4802-942a-5cd9846cbfea None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:01:22.416471 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-5bc66223-f75e-4802-942a-5cd9846cbfea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:01:22.476681 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1385/2778] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:01:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:01:22.486261 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ce83c-0830-478e-b68f-ea998157a168 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:22.488271 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-221ce83c-0830-478e-b68f-ea998157a168 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:01:22.550055 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ce83c-0830-478e-b68f-ea998157a168 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:22.573279 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55f4c72-d533-4c5b-8f67-4d27000acd7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:22.573942 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f4c72-d533-4c5b-8f67-4d27000acd7b service neutron] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:22.574269 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f4c72-d533-4c5b-8f67-4d27000acd7b service neutron] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:22.574613 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f4c72-d533-4c5b-8f67-4d27000acd7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:22.595665 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55f4c72-d533-4c5b-8f67-4d27000acd7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:22.597348 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55f4c72-d533-4c5b-8f67-4d27000acd7b service neutron] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:22.607066 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1394/2779] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 17:01:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 17:01:23.021105 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc66223-f75e-4802-942a-5cd9846cbfea None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:23.022602 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-5bc66223-f75e-4802-942a-5cd9846cbfea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:01:23.036919 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc66223-f75e-4802-942a-5cd9846cbfea None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:23.041691 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cc8b2d-3a53-4dc2-951a-ce75233bd90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:23.043603 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc8b2d-3a53-4dc2-951a-ce75233bd90d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:23.044061 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc8b2d-3a53-4dc2-951a-ce75233bd90d admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:23.044188 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc8b2d-3a53-4dc2-951a-ce75233bd90d admin admin] PATH_INFO: `/v3/projects/32880a0915c24e288e0f44a6fac41dbb` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:23.045397 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cc8b2d-3a53-4dc2-951a-ce75233bd90d admin admin] RBAC: Authorizing `identity:delete_project(project_id=32880a0915c24e288e0f44a6fac41dbb)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:23.047357 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cc8b2d-3a53-4dc2-951a-ce75233bd90d admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:23.140808 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:01:23.146675 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-c9cc8b2d-3a53-4dc2-951a-ce75233bd90d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32880a0915c24e288e0f44a6fac41dbb', 'request_id': 'req-c9cc8b2d-3a53-4dc2-951a-ce75233bd90d'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:23.213528 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-c9cc8b2d-3a53-4dc2-951a-ce75233bd90d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32880a0915c24e288e0f44a6fac41dbb', 'request_id': 'req-c9cc8b2d-3a53-4dc2-951a-ce75233bd90d'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:23.219884 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-c9cc8b2d-3a53-4dc2-951a-ce75233bd90d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32880a0915c24e288e0f44a6fac41dbb', 'request_id': 'req-c9cc8b2d-3a53-4dc2-951a-ce75233bd90d'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:23.232973 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-c9cc8b2d-3a53-4dc2-951a-ce75233bd90d admin admin] The token cache is being invalidate because project 32880a0915c24e288e0f44a6fac41dbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:01:23.233260 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-c9cc8b2d-3a53-4dc2-951a-ce75233bd90d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:23.233921 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-c9cc8b2d-3a53-4dc2-951a-ce75233bd90d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:23.235791 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1386/2780] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 17:01:23 2022] DELETE /identity/v3/projects/32880a0915c24e288e0f44a6fac41dbb => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:01:23.241235 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d8a792-b4a3-47b0-8f81-6bbf559d8867 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:23.241529 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d8a792-b4a3-47b0-8f81-6bbf559d8867 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:23.241809 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d8a792-b4a3-47b0-8f81-6bbf559d8867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:23.261769 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-77d8a792-b4a3-47b0-8f81-6bbf559d8867 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:01:23.263010 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-77d8a792-b4a3-47b0-8f81-6bbf559d8867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:01:23.327175 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1395/2781] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:01:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:01:23.336558 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f5d06-36d1-47c5-b3d6-d1478c9728f5 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:23.336876 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f5d06-36d1-47c5-b3d6-d1478c9728f5 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:23.337170 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f5d06-36d1-47c5-b3d6-d1478c9728f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:23.356472 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-3a4f5d06-36d1-47c5-b3d6-d1478c9728f5 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:01:23.357756 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-3a4f5d06-36d1-47c5-b3d6-d1478c9728f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:01:23.367057 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1387/2782] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:01:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:01:23.371397 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d8a792-b4a3-47b0-8f81-6bbf559d8867 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:23.382065 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d8a792-b4a3-47b0-8f81-6bbf559d8867 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:23.386802 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1ff112-1dea-4416-9357-505d9e47fecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:23.387471 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ff112-1dea-4416-9357-505d9e47fecb admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:23.387785 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ff112-1dea-4416-9357-505d9e47fecb admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:23.388067 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ff112-1dea-4416-9357-505d9e47fecb admin admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:23.388821 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1ff112-1dea-4416-9357-505d9e47fecb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 17:01:23.389129 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1ff112-1dea-4416-9357-505d9e47fecb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:23.390745 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1ff112-1dea-4416-9357-505d9e47fecb admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:23.403222 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1396/2783] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Jul 18 17:01:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 17:01:23.407700 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f5d06-36d1-47c5-b3d6-d1478c9728f5 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:23.421421 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f5d06-36d1-47c5-b3d6-d1478c9728f5 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:23.429463 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83250ad-b1f0-4a1a-9a83-4a328b7973c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:23.430153 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83250ad-b1f0-4a1a-9a83-4a328b7973c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:23.430624 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83250ad-b1f0-4a1a-9a83-4a328b7973c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:23.430906 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83250ad-b1f0-4a1a-9a83-4a328b7973c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:23.431610 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83250ad-b1f0-4a1a-9a83-4a328b7973c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:23.433828 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83250ad-b1f0-4a1a-9a83-4a328b7973c7 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:23.652162 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1388/2784] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 17:01:23 2022] POST /identity/v3/projects => generated 369 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 17:01:23.656574 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1ff112-1dea-4416-9357-505d9e47fecb admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:23.667625 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1ff112-1dea-4416-9357-505d9e47fecb admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:23.693958 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:01:23.738727 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46306407-4030-440a-aa77-b5adfed2160f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:23.739422 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46306407-4030-440a-aa77-b5adfed2160f admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:23.739706 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46306407-4030-440a-aa77-b5adfed2160f admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:23.740126 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46306407-4030-440a-aa77-b5adfed2160f admin admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:23.740825 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46306407-4030-440a-aa77-b5adfed2160f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:23.742749 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46306407-4030-440a-aa77-b5adfed2160f admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:23.842357 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1397/2785] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 17:01:23 2022] POST /identity/v3/users => generated 285 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:01:23.847104 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83250ad-b1f0-4a1a-9a83-4a328b7973c7 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:23.858292 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83250ad-b1f0-4a1a-9a83-4a328b7973c7 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:23.863261 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f12022c-5c5f-4ab1-84af-1dbe86ecf7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:23.864020 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12022c-5c5f-4ab1-84af-1dbe86ecf7b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:23.864388 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12022c-5c5f-4ab1-84af-1dbe86ecf7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:23.864731 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12022c-5c5f-4ab1-84af-1dbe86ecf7b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:23.865548 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f12022c-5c5f-4ab1-84af-1dbe86ecf7b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:23.867189 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f12022c-5c5f-4ab1-84af-1dbe86ecf7b5 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:23.879564 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1389/2786] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 17:01:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:01:23.891524 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46306407-4030-440a-aa77-b5adfed2160f admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:23.902486 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46306407-4030-440a-aa77-b5adfed2160f admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:23.907603 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e650e-0cb1-4e9e-8e7f-ec960589ce84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:23.908335 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e650e-0cb1-4e9e-8e7f-ec960589ce84 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:23.908627 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e650e-0cb1-4e9e-8e7f-ec960589ce84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:23.908908 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e650e-0cb1-4e9e-8e7f-ec960589ce84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:23.909636 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905e650e-0cb1-4e9e-8e7f-ec960589ce84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:23.911368 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905e650e-0cb1-4e9e-8e7f-ec960589ce84 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:23.921524 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1398/2787] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 17:01:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:01:23.926990 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f12022c-5c5f-4ab1-84af-1dbe86ecf7b5 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:23.937075 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f12022c-5c5f-4ab1-84af-1dbe86ecf7b5 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:23.942319 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753b03d3-8fe3-48d8-a7e0-16bfbf8eaae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:23.943244 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b03d3-8fe3-48d8-a7e0-16bfbf8eaae2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:23.943546 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b03d3-8fe3-48d8-a7e0-16bfbf8eaae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:23.943885 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b03d3-8fe3-48d8-a7e0-16bfbf8eaae2 admin admin] PATH_INFO: `/v3/projects/104766027c7a41d49cf02c37645bba13/users/4a3d92bbd31c44dc8165819af8addebd/roles/ad3a2bc7b2094a4da1a95a143c8d9436` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:23.958627 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753b03d3-8fe3-48d8-a7e0-16bfbf8eaae2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=104766027c7a41d49cf02c37645bba13, user_id=4a3d92bbd31c44dc8165819af8addebd, role_id=ad3a2bc7b2094a4da1a95a143c8d9436)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:23.961549 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753b03d3-8fe3-48d8-a7e0-16bfbf8eaae2 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:24.059367 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1390/2788] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 17:01:23 2022] PUT /identity/v3/projects/104766027c7a41d49cf02c37645bba13/users/4a3d92bbd31c44dc8165819af8addebd/roles/ad3a2bc7b2094a4da1a95a143c8d9436 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:01:24.069844 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b32e8a-f2cc-4f6f-9f5b-463499453ae9 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:24.070132 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b32e8a-f2cc-4f6f-9f5b-463499453ae9 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:24.070415 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b32e8a-f2cc-4f6f-9f5b-463499453ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:24.097876 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-16b32e8a-f2cc-4f6f-9f5b-463499453ae9 None None] MFA Rules not processed for user `4a3d92bbd31c44dc8165819af8addebd`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:01:24.099108 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-16b32e8a-f2cc-4f6f-9f5b-463499453ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:01:24.164145 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1399/2789] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:01:24 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:01:24.176021 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753b03d3-8fe3-48d8-a7e0-16bfbf8eaae2 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:24.177759 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-753b03d3-8fe3-48d8-a7e0-16bfbf8eaae2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:01:24.238953 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753b03d3-8fe3-48d8-a7e0-16bfbf8eaae2 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:24.241486 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce08248-8b0a-4772-bc2d-aca22aaf133d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e638fbc5f1f3447c8e189c228bbae530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:24.242081 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce08248-8b0a-4772-bc2d-aca22aaf133d service glance] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:24.242365 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce08248-8b0a-4772-bc2d-aca22aaf133d service glance] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:24.242642 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce08248-8b0a-4772-bc2d-aca22aaf133d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:24.251456 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce08248-8b0a-4772-bc2d-aca22aaf133d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:24.254081 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce08248-8b0a-4772-bc2d-aca22aaf133d service glance] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:24.263796 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1391/2790] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 17:01:24 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:01:24.690548 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b32e8a-f2cc-4f6f-9f5b-463499453ae9 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:24.692025 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-16b32e8a-f2cc-4f6f-9f5b-463499453ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:01:24.771351 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b32e8a-f2cc-4f6f-9f5b-463499453ae9 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:24.777157 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66438a48-ba5b-45f2-a2f6-cfecae2aad28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07f0c5bf1bee48a0bafdf7a9e4537c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:24.778047 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66438a48-ba5b-45f2-a2f6-cfecae2aad28 service nova] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:24.778245 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66438a48-ba5b-45f2-a2f6-cfecae2aad28 service nova] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:24.778527 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66438a48-ba5b-45f2-a2f6-cfecae2aad28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:24.780837 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-66438a48-ba5b-45f2-a2f6-cfecae2aad28 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:01:24.793959 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66438a48-ba5b-45f2-a2f6-cfecae2aad28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:24.795549 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66438a48-ba5b-45f2-a2f6-cfecae2aad28 service nova] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:24.815922 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1400/2791] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 17:01:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:01:28.281434 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce08248-8b0a-4772-bc2d-aca22aaf133d service glance] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:28.283870 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-0ce08248-8b0a-4772-bc2d-aca22aaf133d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:01:28.342458 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce08248-8b0a-4772-bc2d-aca22aaf133d service glance] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:28.346613 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4e3921-b619-4a7c-b9df-e20dd0b96512 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:28.347253 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e3921-b619-4a7c-b9df-e20dd0b96512 service neutron] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:28.347536 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e3921-b619-4a7c-b9df-e20dd0b96512 service neutron] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:28.347843 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e3921-b619-4a7c-b9df-e20dd0b96512 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:28.349586 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-fd4e3921-b619-4a7c-b9df-e20dd0b96512 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:01:28.361028 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4e3921-b619-4a7c-b9df-e20dd0b96512 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:28.362546 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4e3921-b619-4a7c-b9df-e20dd0b96512 service neutron] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:28.371338 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1392/2792] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 17:01:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:01:30.283899 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66438a48-ba5b-45f2-a2f6-cfecae2aad28 service nova] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:30.285302 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-66438a48-ba5b-45f2-a2f6-cfecae2aad28 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:01:30.304432 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:01:30.364830 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66438a48-ba5b-45f2-a2f6-cfecae2aad28 service nova] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:30.369866 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466b1cba-fa3e-431c-8884-c196a8296803 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700ad7df774415b89737c7dddcc5b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:30.370561 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b1cba-fa3e-431c-8884-c196a8296803 service placement] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:30.370845 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b1cba-fa3e-431c-8884-c196a8296803 service placement] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:30.371147 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b1cba-fa3e-431c-8884-c196a8296803 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:30.373047 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-466b1cba-fa3e-431c-8884-c196a8296803 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:01:30.386934 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466b1cba-fa3e-431c-8884-c196a8296803 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:30.388618 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466b1cba-fa3e-431c-8884-c196a8296803 service placement] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:30.399691 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1401/2793] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 17:01:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:01:38.367552 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=88,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:01:40.395560 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=25 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:01:45.992622 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4e3921-b619-4a7c-b9df-e20dd0b96512 service neutron] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:46.006287 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4e3921-b619-4a7c-b9df-e20dd0b96512 service neutron] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:46.012218 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31657dfd-6691-4f68-b8c4-b8aaab833633 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07f0c5bf1bee48a0bafdf7a9e4537c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:46.012771 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31657dfd-6691-4f68-b8c4-b8aaab833633 service nova] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:46.013054 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31657dfd-6691-4f68-b8c4-b8aaab833633 service nova] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:46.013330 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31657dfd-6691-4f68-b8c4-b8aaab833633 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:46.015085 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-31657dfd-6691-4f68-b8c4-b8aaab833633 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:01:46.027580 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31657dfd-6691-4f68-b8c4-b8aaab833633 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:46.029265 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31657dfd-6691-4f68-b8c4-b8aaab833633 service nova] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:46.040464 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1393/2794] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 17:01:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:01:48.893226 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466b1cba-fa3e-431c-8884-c196a8296803 service placement] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:48.902398 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466b1cba-fa3e-431c-8884-c196a8296803 service placement] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:48.905873 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8223d3-b9f8-4ade-a63d-17a427fef1ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:48.906497 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8223d3-b9f8-4ade-a63d-17a427fef1ea service neutron] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:48.906775 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8223d3-b9f8-4ade-a63d-17a427fef1ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:48.907045 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8223d3-b9f8-4ade-a63d-17a427fef1ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:48.909285 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-6d8223d3-b9f8-4ade-a63d-17a427fef1ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:01:48.970949 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8223d3-b9f8-4ade-a63d-17a427fef1ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:48.972408 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8223d3-b9f8-4ade-a63d-17a427fef1ea service neutron] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:48.982037 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1402/2795] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 17:01:48 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:01:56.036032 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=6 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:01:58.851501 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31657dfd-6691-4f68-b8c4-b8aaab833633 service nova] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:58.915276 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31657dfd-6691-4f68-b8c4-b8aaab833633 service nova] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:58.919879 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c348dcd-99ff-4112-ad11-7ff37f3c9ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:58.920753 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c348dcd-99ff-4112-ad11-7ff37f3c9ce1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:58.921035 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c348dcd-99ff-4112-ad11-7ff37f3c9ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:58.921309 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c348dcd-99ff-4112-ad11-7ff37f3c9ce1 admin admin] PATH_INFO: `/v3/users/4a3d92bbd31c44dc8165819af8addebd` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:58.922495 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c348dcd-99ff-4112-ad11-7ff37f3c9ce1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a3d92bbd31c44dc8165819af8addebd)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:58.924978 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c348dcd-99ff-4112-ad11-7ff37f3c9ce1 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:58.977570 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=30 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:01:59.089055 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-3c348dcd-99ff-4112-ad11-7ff37f3c9ce1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a3d92bbd31c44dc8165819af8addebd'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:59.089635 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-3c348dcd-99ff-4112-ad11-7ff37f3c9ce1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a3d92bbd31c44dc8165819af8addebd'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:59.101520 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-3c348dcd-99ff-4112-ad11-7ff37f3c9ce1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a3d92bbd31c44dc8165819af8addebd'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:59.177866 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-3c348dcd-99ff-4112-ad11-7ff37f3c9ce1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a3d92bbd31c44dc8165819af8addebd'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:59.185126 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-3c348dcd-99ff-4112-ad11-7ff37f3c9ce1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a3d92bbd31c44dc8165819af8addebd'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:59.191110 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1394/2796] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 17:01:58 2022] DELETE /identity/v3/users/4a3d92bbd31c44dc8165819af8addebd => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:01:59.195678 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad4405-9a0f-4672-82f2-2a93b5075b9a None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:59.196094 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad4405-9a0f-4672-82f2-2a93b5075b9a None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:59.196380 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad4405-9a0f-4672-82f2-2a93b5075b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:59.214167 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-dcad4405-9a0f-4672-82f2-2a93b5075b9a None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:01:59.215364 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-dcad4405-9a0f-4672-82f2-2a93b5075b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:01:59.274769 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1403/2797] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:01:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:01:59.284825 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c348dcd-99ff-4112-ad11-7ff37f3c9ce1 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:59.286320 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-3c348dcd-99ff-4112-ad11-7ff37f3c9ce1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:01:59.341578 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c348dcd-99ff-4112-ad11-7ff37f3c9ce1 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:59.345132 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d627f766-0025-459d-9437-fce360f6cf29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:59.346260 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627f766-0025-459d-9437-fce360f6cf29 service neutron] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:59.346541 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627f766-0025-459d-9437-fce360f6cf29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:59.346818 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627f766-0025-459d-9437-fce360f6cf29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:59.355682 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d627f766-0025-459d-9437-fce360f6cf29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:59.357116 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d627f766-0025-459d-9437-fce360f6cf29 service neutron] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:59.367078 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1395/2798] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 17:01:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:01:59.774093 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcad4405-9a0f-4672-82f2-2a93b5075b9a None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:59.775569 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-dcad4405-9a0f-4672-82f2-2a93b5075b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:01:59.788482 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcad4405-9a0f-4672-82f2-2a93b5075b9a None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:59.793160 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df12e3-be15-4ef5-83f5-f90238522f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:59.794029 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df12e3-be15-4ef5-83f5-f90238522f7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:59.794311 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df12e3-be15-4ef5-83f5-f90238522f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:59.794584 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df12e3-be15-4ef5-83f5-f90238522f7b admin admin] PATH_INFO: `/v3/projects/104766027c7a41d49cf02c37645bba13` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:59.795794 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0df12e3-be15-4ef5-83f5-f90238522f7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=104766027c7a41d49cf02c37645bba13)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:59.797687 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0df12e3-be15-4ef5-83f5-f90238522f7b admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:59.934025 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-c0df12e3-be15-4ef5-83f5-f90238522f7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '104766027c7a41d49cf02c37645bba13', 'request_id': 'req-c0df12e3-be15-4ef5-83f5-f90238522f7b'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:59.940038 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-c0df12e3-be15-4ef5-83f5-f90238522f7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '104766027c7a41d49cf02c37645bba13', 'request_id': 'req-c0df12e3-be15-4ef5-83f5-f90238522f7b'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:59.946233 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-c0df12e3-be15-4ef5-83f5-f90238522f7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '104766027c7a41d49cf02c37645bba13', 'request_id': 'req-c0df12e3-be15-4ef5-83f5-f90238522f7b'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:02:00.051086 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-c0df12e3-be15-4ef5-83f5-f90238522f7b admin admin] The token cache is being invalidate because project 104766027c7a41d49cf02c37645bba13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:02:00.051761 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-c0df12e3-be15-4ef5-83f5-f90238522f7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:02:00.052084 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-c0df12e3-be15-4ef5-83f5-f90238522f7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:02:00.053633 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1404/2799] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 17:01:59 2022] DELETE /identity/v3/projects/104766027c7a41d49cf02c37645bba13 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:02:00.058657 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e555ce4-e260-4cad-8394-36ce6e87bfd9 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:02:00.065984 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e555ce4-e260-4cad-8394-36ce6e87bfd9 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:02:00.065984 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e555ce4-e260-4cad-8394-36ce6e87bfd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:02:00.077856 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-2e555ce4-e260-4cad-8394-36ce6e87bfd9 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:02:00.079198 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-2e555ce4-e260-4cad-8394-36ce6e87bfd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:02:00.096005 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:02:00.138048 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1396/2800] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:02:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:02:00.147837 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf3530-0c92-4b0f-8877-2720a37ad979 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:02:00.148201 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf3530-0c92-4b0f-8877-2720a37ad979 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:02:00.148550 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf3530-0c92-4b0f-8877-2720a37ad979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:02:00.166630 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-1adf3530-0c92-4b0f-8877-2720a37ad979 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:02:00.167864 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-1adf3530-0c92-4b0f-8877-2720a37ad979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:02:00.175823 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1405/2801] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:02:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:02:00.179975 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e555ce4-e260-4cad-8394-36ce6e87bfd9 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:02:00.190500 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e555ce4-e260-4cad-8394-36ce6e87bfd9 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:02:00.195032 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd774b70-b669-40a9-9a91-28fac49413d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:02:00.195679 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd774b70-b669-40a9-9a91-28fac49413d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:02:00.195985 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd774b70-b669-40a9-9a91-28fac49413d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:02:00.196264 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd774b70-b669-40a9-9a91-28fac49413d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:02:00.196972 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd774b70-b669-40a9-9a91-28fac49413d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 17:02:00.197277 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd774b70-b669-40a9-9a91-28fac49413d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:02:00.198858 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd774b70-b669-40a9-9a91-28fac49413d6 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:02:00.210685 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1397/2802] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Jul 18 17:02:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 17:02:00.214778 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adf3530-0c92-4b0f-8877-2720a37ad979 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:02:00.224049 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adf3530-0c92-4b0f-8877-2720a37ad979 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:02:00.228655 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe31e41-fc2d-4add-b86e-91d226fbc2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:02:00.229298 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe31e41-fc2d-4add-b86e-91d226fbc2a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:02:00.229584 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe31e41-fc2d-4add-b86e-91d226fbc2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:02:00.229863 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe31e41-fc2d-4add-b86e-91d226fbc2a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:02:00.230549 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe31e41-fc2d-4add-b86e-91d226fbc2a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:02:00.232484 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe31e41-fc2d-4add-b86e-91d226fbc2a5 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:02:00.319764 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1406/2803] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 17:02:00 2022] POST /identity/v3/projects => generated 369 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:02:00.321346 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd774b70-b669-40a9-9a91-28fac49413d6 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:02:00.331192 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd774b70-b669-40a9-9a91-28fac49413d6 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:02:00.385946 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d1b98d-13cb-4c40-8ec7-b134ef42c49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:02:00.386633 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d1b98d-13cb-4c40-8ec7-b134ef42c49e admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:02:00.386922 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d1b98d-13cb-4c40-8ec7-b134ef42c49e admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:02:00.387200 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d1b98d-13cb-4c40-8ec7-b134ef42c49e admin admin] PATH_INFO: `/v3/users` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:02:00.387924 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d1b98d-13cb-4c40-8ec7-b134ef42c49e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:02:00.389876 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d1b98d-13cb-4c40-8ec7-b134ef42c49e admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:02:00.481392 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1398/2804] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 17:02:00 2022] POST /identity/v3/users => generated 285 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:02:00.485625 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe31e41-fc2d-4add-b86e-91d226fbc2a5 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:02:00.496523 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe31e41-fc2d-4add-b86e-91d226fbc2a5 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:02:00.501237 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b43ecfe-472b-45ad-b673-3cc21ae3d16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:02:00.501920 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43ecfe-472b-45ad-b673-3cc21ae3d16b admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:02:00.502720 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43ecfe-472b-45ad-b673-3cc21ae3d16b admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:02:00.503008 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43ecfe-472b-45ad-b673-3cc21ae3d16b admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:02:00.503733 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b43ecfe-472b-45ad-b673-3cc21ae3d16b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:02:00.505639 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b43ecfe-472b-45ad-b673-3cc21ae3d16b admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:02:00.516470 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1407/2805] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 17:02:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:02:00.520287 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d1b98d-13cb-4c40-8ec7-b134ef42c49e admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:02:00.530277 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d1b98d-13cb-4c40-8ec7-b134ef42c49e admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:02:00.534851 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101335c3-981b-4ab3-b84a-84fc777d3929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:02:00.535505 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101335c3-981b-4ab3-b84a-84fc777d3929 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:02:00.535819 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101335c3-981b-4ab3-b84a-84fc777d3929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:02:00.536129 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101335c3-981b-4ab3-b84a-84fc777d3929 admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:02:00.536844 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101335c3-981b-4ab3-b84a-84fc777d3929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:02:00.538427 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101335c3-981b-4ab3-b84a-84fc777d3929 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:02:00.548207 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1399/2806] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 17:02:00 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:02:00.552519 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b43ecfe-472b-45ad-b673-3cc21ae3d16b admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:02:00.562334 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b43ecfe-472b-45ad-b673-3cc21ae3d16b admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:02:00.567736 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb104990-cba9-4f69-9bef-44ccf7363030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:02:00.568632 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb104990-cba9-4f69-9bef-44ccf7363030 admin admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:02:00.568916 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb104990-cba9-4f69-9bef-44ccf7363030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:02:00.569191 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb104990-cba9-4f69-9bef-44ccf7363030 admin admin] PATH_INFO: `/v3/projects/465fd1d5fc814ecf9dca882307234808/users/87506aec00e5487a88e8798857d1d80d/roles/ad3a2bc7b2094a4da1a95a143c8d9436` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:02:00.583434 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb104990-cba9-4f69-9bef-44ccf7363030 admin admin] RBAC: Authorizing `identity:create_grant(project_id=465fd1d5fc814ecf9dca882307234808, user_id=87506aec00e5487a88e8798857d1d80d, role_id=ad3a2bc7b2094a4da1a95a143c8d9436)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:02:00.586122 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb104990-cba9-4f69-9bef-44ccf7363030 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:02:00.657712 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1408/2807] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 17:02:00 2022] PUT /identity/v3/projects/465fd1d5fc814ecf9dca882307234808/users/87506aec00e5487a88e8798857d1d80d/roles/ad3a2bc7b2094a4da1a95a143c8d9436 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:02:00.668548 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fff257-edc8-4a63-a7ad-019fc0b180cc None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:02:00.668947 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fff257-edc8-4a63-a7ad-019fc0b180cc None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:02:00.669236 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fff257-edc8-4a63-a7ad-019fc0b180cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:02:00.696410 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-73fff257-edc8-4a63-a7ad-019fc0b180cc None None] MFA Rules not processed for user `87506aec00e5487a88e8798857d1d80d`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:02:00.697598 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-73fff257-edc8-4a63-a7ad-019fc0b180cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:02:00.759440 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1400/2808] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:02:00 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:02:00.770830 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb104990-cba9-4f69-9bef-44ccf7363030 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:02:00.772605 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-bb104990-cba9-4f69-9bef-44ccf7363030 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:02:00.796180 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:02:00.852797 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb104990-cba9-4f69-9bef-44ccf7363030 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:02:00.856427 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ed19e-c6d6-4125-b1a3-e07281cd3e0e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e638fbc5f1f3447c8e189c228bbae530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:02:00.857063 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ed19e-c6d6-4125-b1a3-e07281cd3e0e service glance] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:02:00.857344 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ed19e-c6d6-4125-b1a3-e07281cd3e0e service glance] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:02:00.857633 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ed19e-c6d6-4125-b1a3-e07281cd3e0e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:02:00.866362 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97ed19e-c6d6-4125-b1a3-e07281cd3e0e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:02:00.867795 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97ed19e-c6d6-4125-b1a3-e07281cd3e0e service glance] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:02:00.876816 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1409/2809] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 17:02:00 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:02:10.756802 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:02:10.903778 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=26 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:02:31.069019 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fff257-edc8-4a63-a7ad-019fc0b180cc None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:02:31.130395 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fff257-edc8-4a63-a7ad-019fc0b180cc None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:02:31.134908 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd6a8ce-2719-450f-a9cc-2493e9029aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:02:31.135862 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6a8ce-2719-450f-a9cc-2493e9029aad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:02:31.136146 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6a8ce-2719-450f-a9cc-2493e9029aad admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:02:31.136423 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6a8ce-2719-450f-a9cc-2493e9029aad admin admin] PATH_INFO: `/v3/users/87506aec00e5487a88e8798857d1d80d` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:02:31.137679 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd6a8ce-2719-450f-a9cc-2493e9029aad admin admin] RBAC: Authorizing `identity:delete_user(user_id=87506aec00e5487a88e8798857d1d80d)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:02:31.139575 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd6a8ce-2719-450f-a9cc-2493e9029aad admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:02:31.350437 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-3cd6a8ce-2719-450f-a9cc-2493e9029aad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87506aec00e5487a88e8798857d1d80d'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:02:31.351322 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-3cd6a8ce-2719-450f-a9cc-2493e9029aad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87506aec00e5487a88e8798857d1d80d'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:02:31.363094 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-3cd6a8ce-2719-450f-a9cc-2493e9029aad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87506aec00e5487a88e8798857d1d80d'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:02:31.445543 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-3cd6a8ce-2719-450f-a9cc-2493e9029aad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87506aec00e5487a88e8798857d1d80d'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:02:31.452874 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-3cd6a8ce-2719-450f-a9cc-2493e9029aad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87506aec00e5487a88e8798857d1d80d'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:02:31.459126 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1401/2810] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 17:02:31 2022] DELETE /identity/v3/users/87506aec00e5487a88e8798857d1d80d => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:02:31.464029 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eff1cb-49f8-41b3-bcc8-d34064ecdc64 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:02:31.464537 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eff1cb-49f8-41b3-bcc8-d34064ecdc64 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:02:31.464642 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eff1cb-49f8-41b3-bcc8-d34064ecdc64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:02:31.482703 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-b1eff1cb-49f8-41b3-bcc8-d34064ecdc64 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:02:31.483940 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-b1eff1cb-49f8-41b3-bcc8-d34064ecdc64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:02:31.541975 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1410/2811] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:02:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:02:31.551703 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd6a8ce-2719-450f-a9cc-2493e9029aad admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:02:31.553647 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-3cd6a8ce-2719-450f-a9cc-2493e9029aad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:02:31.609769 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd6a8ce-2719-450f-a9cc-2493e9029aad admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:02:31.613315 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc510a4-9bcf-4a9f-ab29-eb8522061eab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:02:31.613951 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc510a4-9bcf-4a9f-ab29-eb8522061eab service neutron] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:02:31.614236 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc510a4-9bcf-4a9f-ab29-eb8522061eab service neutron] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:02:31.614575 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc510a4-9bcf-4a9f-ab29-eb8522061eab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:02:31.623939 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc510a4-9bcf-4a9f-ab29-eb8522061eab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:02:31.625355 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc510a4-9bcf-4a9f-ab29-eb8522061eab service neutron] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:02:31.634962 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1402/2812] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 17:02:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:02:32.116331 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eff1cb-49f8-41b3-bcc8-d34064ecdc64 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:02:32.119202 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-b1eff1cb-49f8-41b3-bcc8-d34064ecdc64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:02:32.129277 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eff1cb-49f8-41b3-bcc8-d34064ecdc64 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:02:32.134137 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d16431f-1abc-46b8-bb92-b4ff549690cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:02:32.134961 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d16431f-1abc-46b8-bb92-b4ff549690cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:02:32.135276 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d16431f-1abc-46b8-bb92-b4ff549690cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:02:32.135515 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d16431f-1abc-46b8-bb92-b4ff549690cc admin admin] PATH_INFO: `/v3/projects/465fd1d5fc814ecf9dca882307234808` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:02:32.136747 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d16431f-1abc-46b8-bb92-b4ff549690cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=465fd1d5fc814ecf9dca882307234808)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:02:32.138628 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d16431f-1abc-46b8-bb92-b4ff549690cc admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:02:32.315114 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-7d16431f-1abc-46b8-bb92-b4ff549690cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '465fd1d5fc814ecf9dca882307234808', 'request_id': 'req-7d16431f-1abc-46b8-bb92-b4ff549690cc'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:02:32.320737 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-7d16431f-1abc-46b8-bb92-b4ff549690cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '465fd1d5fc814ecf9dca882307234808', 'request_id': 'req-7d16431f-1abc-46b8-bb92-b4ff549690cc'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:02:32.326852 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-7d16431f-1abc-46b8-bb92-b4ff549690cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '465fd1d5fc814ecf9dca882307234808', 'request_id': 'req-7d16431f-1abc-46b8-bb92-b4ff549690cc'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:02:32.474646 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-7d16431f-1abc-46b8-bb92-b4ff549690cc admin admin] The token cache is being invalidate because project 465fd1d5fc814ecf9dca882307234808 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:02:32.475244 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-7d16431f-1abc-46b8-bb92-b4ff549690cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:02:32.475533 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-7d16431f-1abc-46b8-bb92-b4ff549690cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:02:32.477097 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1411/2813] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 17:02:32 2022] DELETE /identity/v3/projects/465fd1d5fc814ecf9dca882307234808 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:02:41.630829 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:02:42.470724 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:02:52.009285 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc510a4-9bcf-4a9f-ab29-eb8522061eab service neutron] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:02:52.013995 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-edc510a4-9bcf-4a9f-ab29-eb8522061eab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:02:52.084199 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc510a4-9bcf-4a9f-ab29-eb8522061eab service neutron] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:02:52.144222 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e65b2e-7aba-4f31-ba0b-940cdba6fc6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07f0c5bf1bee48a0bafdf7a9e4537c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:02:52.145500 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e65b2e-7aba-4f31-ba0b-940cdba6fc6e service nova] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:02:52.145790 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e65b2e-7aba-4f31-ba0b-940cdba6fc6e service nova] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:02:52.146068 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e65b2e-7aba-4f31-ba0b-940cdba6fc6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:02:52.147954 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-78e65b2e-7aba-4f31-ba0b-940cdba6fc6e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:02:52.203433 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e65b2e-7aba-4f31-ba0b-940cdba6fc6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:02:52.205025 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e65b2e-7aba-4f31-ba0b-940cdba6fc6e service nova] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:02:52.214571 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1403/2814] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 17:02:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:02:59.541718 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d16431f-1abc-46b8-bb92-b4ff549690cc admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:02:59.543117 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-7d16431f-1abc-46b8-bb92-b4ff549690cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:02:59.614934 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d16431f-1abc-46b8-bb92-b4ff549690cc admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:02:59.620364 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0519c622-5060-4c90-bc05-829dc3aa3d7c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700ad7df774415b89737c7dddcc5b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:02:59.621028 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0519c622-5060-4c90-bc05-829dc3aa3d7c service placement] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:02:59.621327 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0519c622-5060-4c90-bc05-829dc3aa3d7c service placement] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:02:59.621601 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0519c622-5060-4c90-bc05-829dc3aa3d7c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:02:59.623417 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-0519c622-5060-4c90-bc05-829dc3aa3d7c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:02:59.635391 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0519c622-5060-4c90-bc05-829dc3aa3d7c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:02:59.637093 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0519c622-5060-4c90-bc05-829dc3aa3d7c service placement] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:02:59.647288 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1412/2815] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 17:02:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:03:02.210491 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=84 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:03:08.411909 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef73de-f32b-46b0-9f4b-006c12a6fc44 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:08.412540 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef73de-f32b-46b0-9f4b-006c12a6fc44 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:08.412687 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef73de-f32b-46b0-9f4b-006c12a6fc44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:08.430704 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-32ef73de-f32b-46b0-9f4b-006c12a6fc44 None None] MFA Rules not processed for user `1d601d9805b840e0b9f5f998b6e7327d`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:03:08.431930 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-32ef73de-f32b-46b0-9f4b-006c12a6fc44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:08.438818 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1404/2816] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:03:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:03:08.742250 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0519c622-5060-4c90-bc05-829dc3aa3d7c service placement] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:08.743654 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-0519c622-5060-4c90-bc05-829dc3aa3d7c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:08.798750 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0519c622-5060-4c90-bc05-829dc3aa3d7c service placement] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:08.802321 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5266de-4da8-491f-853c-bd8a7cf589bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:08.802964 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5266de-4da8-491f-853c-bd8a7cf589bc service neutron] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:08.803247 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5266de-4da8-491f-853c-bd8a7cf589bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:08.803525 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5266de-4da8-491f-853c-bd8a7cf589bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:08.805279 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-fd5266de-4da8-491f-853c-bd8a7cf589bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:08.814718 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5266de-4da8-491f-853c-bd8a7cf589bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:08.816762 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5266de-4da8-491f-853c-bd8a7cf589bc service neutron] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:08.824735 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1413/2817] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 17:03:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:03:18.425003 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=3 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:03:18.821137 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=58 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:04:43.687662 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef73de-f32b-46b0-9f4b-006c12a6fc44 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:43.689154 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-32ef73de-f32b-46b0-9f4b-006c12a6fc44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:43.702551 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef73de-f32b-46b0-9f4b-006c12a6fc44 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:43.706671 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e485850-b243-4ec3-8f3d-c0804d494698 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:43.710467 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e485850-b243-4ec3-8f3d-c0804d494698 service neutron] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:43.710467 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e485850-b243-4ec3-8f3d-c0804d494698 service neutron] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:43.710467 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e485850-b243-4ec3-8f3d-c0804d494698 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:43.710467 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-6e485850-b243-4ec3-8f3d-c0804d494698 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:43.719104 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e485850-b243-4ec3-8f3d-c0804d494698 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:43.720492 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e485850-b243-4ec3-8f3d-c0804d494698 service neutron] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:43.728333 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1405/2818] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 17:04:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:04:43.811183 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5266de-4da8-491f-853c-bd8a7cf589bc service neutron] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:43.819946 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5266de-4da8-491f-853c-bd8a7cf589bc service neutron] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:43.823837 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5815bc33-4ff1-4001-a2c1-f0de3ba24bfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:43.824482 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815bc33-4ff1-4001-a2c1-f0de3ba24bfe service neutron] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:43.824773 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815bc33-4ff1-4001-a2c1-f0de3ba24bfe service neutron] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:43.825053 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815bc33-4ff1-4001-a2c1-f0de3ba24bfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:43.826822 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-5815bc33-4ff1-4001-a2c1-f0de3ba24bfe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:43.840496 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5815bc33-4ff1-4001-a2c1-f0de3ba24bfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:43.841954 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5815bc33-4ff1-4001-a2c1-f0de3ba24bfe service neutron] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:43.853717 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1414/2819] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 17:04:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:04:53.724862 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=6 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:04:53.848793 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=6 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:05:00.309047 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e485850-b243-4ec3-8f3d-c0804d494698 service neutron] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:00.318085 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e485850-b243-4ec3-8f3d-c0804d494698 service neutron] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:00.321826 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb78e03-fb61-47d5-8781-06d89993c320 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:00.322453 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb78e03-fb61-47d5-8781-06d89993c320 service neutron] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:00.322735 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb78e03-fb61-47d5-8781-06d89993c320 service neutron] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:00.323010 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb78e03-fb61-47d5-8781-06d89993c320 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:00.324883 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-1eb78e03-fb61-47d5-8781-06d89993c320 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:00.390941 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb78e03-fb61-47d5-8781-06d89993c320 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:00.392409 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb78e03-fb61-47d5-8781-06d89993c320 service neutron] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:00.401873 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1406/2820] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 17:05:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:05:03.964387 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5815bc33-4ff1-4001-a2c1-f0de3ba24bfe service neutron] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:03.975931 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5815bc33-4ff1-4001-a2c1-f0de3ba24bfe service neutron] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:03.981311 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2477ce7-327b-4b2b-b981-741b95e3bdc5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700ad7df774415b89737c7dddcc5b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:03.981960 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2477ce7-327b-4b2b-b981-741b95e3bdc5 service placement] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:03.982742 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2477ce7-327b-4b2b-b981-741b95e3bdc5 service placement] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:03.983017 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2477ce7-327b-4b2b-b981-741b95e3bdc5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:03.984851 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-b2477ce7-327b-4b2b-b981-741b95e3bdc5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:03.997034 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2477ce7-327b-4b2b-b981-741b95e3bdc5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:03.999190 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2477ce7-327b-4b2b-b981-741b95e3bdc5 service placement] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:04.010052 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1415/2821] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 17:05:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:05:04.124433 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb78e03-fb61-47d5-8781-06d89993c320 service neutron] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:04.126043 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-1eb78e03-fb61-47d5-8781-06d89993c320 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:04.143554 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb78e03-fb61-47d5-8781-06d89993c320 service neutron] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:04.148938 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb396368-12e1-4945-8d87-00a0ed5647e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:04.149829 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb396368-12e1-4945-8d87-00a0ed5647e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:04.150100 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb396368-12e1-4945-8d87-00a0ed5647e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:04.150861 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb396368-12e1-4945-8d87-00a0ed5647e2 admin admin] PATH_INFO: `/v3/users/1d601d9805b840e0b9f5f998b6e7327d` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:04.151961 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb396368-12e1-4945-8d87-00a0ed5647e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d601d9805b840e0b9f5f998b6e7327d)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:04.153870 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb396368-12e1-4945-8d87-00a0ed5647e2 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:04.368901 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-eb396368-12e1-4945-8d87-00a0ed5647e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d601d9805b840e0b9f5f998b6e7327d'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:04.369505 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-eb396368-12e1-4945-8d87-00a0ed5647e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d601d9805b840e0b9f5f998b6e7327d'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:04.381878 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-eb396368-12e1-4945-8d87-00a0ed5647e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d601d9805b840e0b9f5f998b6e7327d'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:04.458513 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-eb396368-12e1-4945-8d87-00a0ed5647e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d601d9805b840e0b9f5f998b6e7327d'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:04.469307 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-eb396368-12e1-4945-8d87-00a0ed5647e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d601d9805b840e0b9f5f998b6e7327d'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:04.475351 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1407/2822] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 17:05:04 2022] DELETE /identity/v3/users/1d601d9805b840e0b9f5f998b6e7327d => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:05:04.740619 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2477ce7-327b-4b2b-b981-741b95e3bdc5 service placement] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:04.753598 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2477ce7-327b-4b2b-b981-741b95e3bdc5 service placement] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:04.811121 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d84a40-b7b9-4a7f-b621-211b55d5cbae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:04.812003 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d84a40-b7b9-4a7f-b621-211b55d5cbae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:04.812287 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d84a40-b7b9-4a7f-b621-211b55d5cbae admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:04.812560 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d84a40-b7b9-4a7f-b621-211b55d5cbae admin admin] PATH_INFO: `/v3/projects/372a083dcdbe4b6996689ddf25e46c0d` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:04.813735 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d84a40-b7b9-4a7f-b621-211b55d5cbae admin admin] RBAC: Authorizing `identity:delete_project(project_id=372a083dcdbe4b6996689ddf25e46c0d)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:04.815629 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d84a40-b7b9-4a7f-b621-211b55d5cbae admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:04.967727 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-f3d84a40-b7b9-4a7f-b621-211b55d5cbae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '372a083dcdbe4b6996689ddf25e46c0d', 'request_id': 'req-f3d84a40-b7b9-4a7f-b621-211b55d5cbae'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:04.973179 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-f3d84a40-b7b9-4a7f-b621-211b55d5cbae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '372a083dcdbe4b6996689ddf25e46c0d', 'request_id': 'req-f3d84a40-b7b9-4a7f-b621-211b55d5cbae'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:04.979308 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-f3d84a40-b7b9-4a7f-b621-211b55d5cbae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '372a083dcdbe4b6996689ddf25e46c0d', 'request_id': 'req-f3d84a40-b7b9-4a7f-b621-211b55d5cbae'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:05.064304 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-f3d84a40-b7b9-4a7f-b621-211b55d5cbae admin admin] The token cache is being invalidate because project 372a083dcdbe4b6996689ddf25e46c0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:05:05.064511 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-f3d84a40-b7b9-4a7f-b621-211b55d5cbae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:05.065148 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-f3d84a40-b7b9-4a7f-b621-211b55d5cbae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:05.066699 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1416/2823] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 17:05:04 2022] DELETE /identity/v3/projects/372a083dcdbe4b6996689ddf25e46c0d => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:05:05.071865 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420ad7b-cc4c-40cf-8fdb-d28db01fbaac None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:05.072158 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420ad7b-cc4c-40cf-8fdb-d28db01fbaac None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:05.072435 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420ad7b-cc4c-40cf-8fdb-d28db01fbaac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:05.091026 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-a420ad7b-cc4c-40cf-8fdb-d28db01fbaac None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:05:05.092303 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-a420ad7b-cc4c-40cf-8fdb-d28db01fbaac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:05.151283 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1408/2824] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:05:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:05:05.159145 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e3714-b32e-4d7e-9dc1-89d3bca4b04f None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:05.159438 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e3714-b32e-4d7e-9dc1-89d3bca4b04f None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:05.159737 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e3714-b32e-4d7e-9dc1-89d3bca4b04f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:05.178452 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-283e3714-b32e-4d7e-9dc1-89d3bca4b04f None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:05:05.179653 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-283e3714-b32e-4d7e-9dc1-89d3bca4b04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:05.188217 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1417/2825] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:05:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:05:05.192315 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420ad7b-cc4c-40cf-8fdb-d28db01fbaac None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:05.201832 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420ad7b-cc4c-40cf-8fdb-d28db01fbaac None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:05.206328 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6a729e-20c4-49f7-ac67-8cad1d7b5ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:05.206968 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a729e-20c4-49f7-ac67-8cad1d7b5ade admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:05.207242 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a729e-20c4-49f7-ac67-8cad1d7b5ade admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:05.207512 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a729e-20c4-49f7-ac67-8cad1d7b5ade admin admin] PATH_INFO: `/v3/domains` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:05.208257 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6a729e-20c4-49f7-ac67-8cad1d7b5ade admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 17:05:05.208558 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6a729e-20c4-49f7-ac67-8cad1d7b5ade admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:05.210134 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6a729e-20c4-49f7-ac67-8cad1d7b5ade admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:05.211619 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:05:05.221781 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1409/2826] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Jul 18 17:05:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 17:05:05.225936 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283e3714-b32e-4d7e-9dc1-89d3bca4b04f None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:05.235667 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283e3714-b32e-4d7e-9dc1-89d3bca4b04f None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:05.240328 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabe8279-831f-4821-b522-c9577cb30e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:05.240973 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe8279-831f-4821-b522-c9577cb30e70 admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:05.241258 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe8279-831f-4821-b522-c9577cb30e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:05.241536 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe8279-831f-4821-b522-c9577cb30e70 admin admin] PATH_INFO: `/v3/projects` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:05.242227 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabe8279-831f-4821-b522-c9577cb30e70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:05.244162 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabe8279-831f-4821-b522-c9577cb30e70 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:05.300364 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1418/2827] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 17:05:05 2022] POST /identity/v3/projects => generated 373 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 17:05:05.304451 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6a729e-20c4-49f7-ac67-8cad1d7b5ade admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:05.315121 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6a729e-20c4-49f7-ac67-8cad1d7b5ade admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:05.368782 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29646a2b-97e8-4ff0-b66f-1281f4695d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:05.369432 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29646a2b-97e8-4ff0-b66f-1281f4695d3e admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:05.369710 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29646a2b-97e8-4ff0-b66f-1281f4695d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:05.369979 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29646a2b-97e8-4ff0-b66f-1281f4695d3e admin admin] PATH_INFO: `/v3/users` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:05.370647 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29646a2b-97e8-4ff0-b66f-1281f4695d3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:05.372629 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29646a2b-97e8-4ff0-b66f-1281f4695d3e admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:05.429601 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1410/2828] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 17:05:05 2022] POST /identity/v3/users => generated 287 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:05:05.433878 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabe8279-831f-4821-b522-c9577cb30e70 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:05.444918 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabe8279-831f-4821-b522-c9577cb30e70 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:05.449498 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37b8921-8600-43c5-a4b1-d269c6c099ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:05.450175 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b8921-8600-43c5-a4b1-d269c6c099ef admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:05.450461 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b8921-8600-43c5-a4b1-d269c6c099ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:05.450734 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b8921-8600-43c5-a4b1-d269c6c099ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:05.451514 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37b8921-8600-43c5-a4b1-d269c6c099ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:05.453151 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37b8921-8600-43c5-a4b1-d269c6c099ef admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:05.463759 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1419/2829] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 17:05:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:05:05.467346 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29646a2b-97e8-4ff0-b66f-1281f4695d3e admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:05.477345 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29646a2b-97e8-4ff0-b66f-1281f4695d3e admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:05.481906 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53475726-cd9d-414b-ba45-78bde1fd1b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:05.483053 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53475726-cd9d-414b-ba45-78bde1fd1b02 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:05.483329 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53475726-cd9d-414b-ba45-78bde1fd1b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:05.483601 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53475726-cd9d-414b-ba45-78bde1fd1b02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:05.484350 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53475726-cd9d-414b-ba45-78bde1fd1b02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:05.485925 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53475726-cd9d-414b-ba45-78bde1fd1b02 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:05.495529 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1411/2830] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 17:05:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:05:05.500090 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37b8921-8600-43c5-a4b1-d269c6c099ef admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:05.510190 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37b8921-8600-43c5-a4b1-d269c6c099ef admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:05.514855 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb613075-efeb-4a2e-9966-ad7b70a0258a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:05.515746 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb613075-efeb-4a2e-9966-ad7b70a0258a admin admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:05.516033 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb613075-efeb-4a2e-9966-ad7b70a0258a admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:05.516309 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb613075-efeb-4a2e-9966-ad7b70a0258a admin admin] PATH_INFO: `/v3/projects/537f83f2eb694b5dabba4607f9532dde/users/32709538de464e86af421edbd6d6e3c8/roles/ad3a2bc7b2094a4da1a95a143c8d9436` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:05.531044 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb613075-efeb-4a2e-9966-ad7b70a0258a admin admin] RBAC: Authorizing `identity:create_grant(project_id=537f83f2eb694b5dabba4607f9532dde, user_id=32709538de464e86af421edbd6d6e3c8, role_id=ad3a2bc7b2094a4da1a95a143c8d9436)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:05.533932 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb613075-efeb-4a2e-9966-ad7b70a0258a admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:05.618953 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1420/2831] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 17:05:05 2022] PUT /identity/v3/projects/537f83f2eb694b5dabba4607f9532dde/users/32709538de464e86af421edbd6d6e3c8/roles/ad3a2bc7b2094a4da1a95a143c8d9436 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:05:05.633570 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e1681-7bb1-4894-b726-7f878db2a972 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:05.633857 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e1681-7bb1-4894-b726-7f878db2a972 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:05.634130 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e1681-7bb1-4894-b726-7f878db2a972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:05.660404 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-d59e1681-7bb1-4894-b726-7f878db2a972 None None] MFA Rules not processed for user `32709538de464e86af421edbd6d6e3c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:05:05.661620 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-d59e1681-7bb1-4894-b726-7f878db2a972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:05.723910 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1412/2832] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:05:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:05:05.734958 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb613075-efeb-4a2e-9966-ad7b70a0258a admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:05.736640 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-cb613075-efeb-4a2e-9966-ad7b70a0258a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:05.750984 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:05:05.807556 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb613075-efeb-4a2e-9966-ad7b70a0258a admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:05.813100 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9341e162-754a-47b4-8893-105a3bae0f9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07f0c5bf1bee48a0bafdf7a9e4537c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:05.813733 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341e162-754a-47b4-8893-105a3bae0f9f service nova] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:05.814013 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341e162-754a-47b4-8893-105a3bae0f9f service nova] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:05.814287 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341e162-754a-47b4-8893-105a3bae0f9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:05.821925 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9341e162-754a-47b4-8893-105a3bae0f9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:05.823729 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9341e162-754a-47b4-8893-105a3bae0f9f service nova] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:05.832638 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1421/2833] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 17:05:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:05:09.277191 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e1681-7bb1-4894-b726-7f878db2a972 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:09.337146 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e1681-7bb1-4894-b726-7f878db2a972 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:09.341640 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a271c7-89fe-4bb6-8d53-99bbccb4a56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:09.342495 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a271c7-89fe-4bb6-8d53-99bbccb4a56e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:09.342778 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a271c7-89fe-4bb6-8d53-99bbccb4a56e admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:09.343054 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a271c7-89fe-4bb6-8d53-99bbccb4a56e admin admin] PATH_INFO: `/v3/users/32709538de464e86af421edbd6d6e3c8` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:09.344243 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a271c7-89fe-4bb6-8d53-99bbccb4a56e admin admin] RBAC: Authorizing `identity:delete_user(user_id=32709538de464e86af421edbd6d6e3c8)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:09.346137 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a271c7-89fe-4bb6-8d53-99bbccb4a56e admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:09.349075 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:05:09.541267 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-76a271c7-89fe-4bb6-8d53-99bbccb4a56e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32709538de464e86af421edbd6d6e3c8'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:09.541848 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-76a271c7-89fe-4bb6-8d53-99bbccb4a56e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32709538de464e86af421edbd6d6e3c8'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:09.554814 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-76a271c7-89fe-4bb6-8d53-99bbccb4a56e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32709538de464e86af421edbd6d6e3c8'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:09.624195 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-76a271c7-89fe-4bb6-8d53-99bbccb4a56e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32709538de464e86af421edbd6d6e3c8'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:09.631562 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-76a271c7-89fe-4bb6-8d53-99bbccb4a56e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32709538de464e86af421edbd6d6e3c8'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:09.637474 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1413/2834] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 17:05:09 2022] DELETE /identity/v3/users/32709538de464e86af421edbd6d6e3c8 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:05:09.642597 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f4e2d3-e006-40d9-97f6-1b0edb8bac64 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:09.645280 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f4e2d3-e006-40d9-97f6-1b0edb8bac64 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:09.645280 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f4e2d3-e006-40d9-97f6-1b0edb8bac64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:09.661288 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-38f4e2d3-e006-40d9-97f6-1b0edb8bac64 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:05:09.662484 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-38f4e2d3-e006-40d9-97f6-1b0edb8bac64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:09.720664 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1422/2835] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:05:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 17:05:09.730203 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a271c7-89fe-4bb6-8d53-99bbccb4a56e admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:09.731679 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-76a271c7-89fe-4bb6-8d53-99bbccb4a56e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:09.788249 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a271c7-89fe-4bb6-8d53-99bbccb4a56e admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:09.791978 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd73d77-d2ca-4025-9330-654fb6f91191 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:09.792558 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd73d77-d2ca-4025-9330-654fb6f91191 service neutron] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:09.792842 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd73d77-d2ca-4025-9330-654fb6f91191 service neutron] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:09.793120 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd73d77-d2ca-4025-9330-654fb6f91191 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:09.802129 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd73d77-d2ca-4025-9330-654fb6f91191 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:09.803548 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd73d77-d2ca-4025-9330-654fb6f91191 service neutron] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:09.812985 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1414/2836] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 17:05:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:05:10.242906 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f4e2d3-e006-40d9-97f6-1b0edb8bac64 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:10.244371 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-38f4e2d3-e006-40d9-97f6-1b0edb8bac64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:10.258519 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f4e2d3-e006-40d9-97f6-1b0edb8bac64 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:10.263167 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed4f89-9191-48e3-bdbc-66796c27c614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:10.264180 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed4f89-9191-48e3-bdbc-66796c27c614 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:10.264462 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed4f89-9191-48e3-bdbc-66796c27c614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:10.264735 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed4f89-9191-48e3-bdbc-66796c27c614 admin admin] PATH_INFO: `/v3/projects/537f83f2eb694b5dabba4607f9532dde` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:10.265919 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caed4f89-9191-48e3-bdbc-66796c27c614 admin admin] RBAC: Authorizing `identity:delete_project(project_id=537f83f2eb694b5dabba4607f9532dde)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:10.267872 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caed4f89-9191-48e3-bdbc-66796c27c614 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:10.384569 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-caed4f89-9191-48e3-bdbc-66796c27c614 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '537f83f2eb694b5dabba4607f9532dde', 'request_id': 'req-caed4f89-9191-48e3-bdbc-66796c27c614'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:10.390479 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-caed4f89-9191-48e3-bdbc-66796c27c614 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '537f83f2eb694b5dabba4607f9532dde', 'request_id': 'req-caed4f89-9191-48e3-bdbc-66796c27c614'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:10.396940 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-caed4f89-9191-48e3-bdbc-66796c27c614 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '537f83f2eb694b5dabba4607f9532dde', 'request_id': 'req-caed4f89-9191-48e3-bdbc-66796c27c614'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:10.475096 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-caed4f89-9191-48e3-bdbc-66796c27c614 admin admin] The token cache is being invalidate because project 537f83f2eb694b5dabba4607f9532dde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:05:10.475391 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-caed4f89-9191-48e3-bdbc-66796c27c614 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:10.476049 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-caed4f89-9191-48e3-bdbc-66796c27c614 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:10.477597 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1423/2837] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 17:05:10 2022] DELETE /identity/v3/projects/537f83f2eb694b5dabba4607f9532dde => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:05:10.482443 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905c5f7-5f13-44bf-9261-9af464cacc6e None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:10.482930 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905c5f7-5f13-44bf-9261-9af464cacc6e None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:10.483026 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905c5f7-5f13-44bf-9261-9af464cacc6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:10.501034 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-1905c5f7-5f13-44bf-9261-9af464cacc6e None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:05:10.502265 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-1905c5f7-5f13-44bf-9261-9af464cacc6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:10.559529 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1415/2838] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:05:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:05:10.567263 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5645f3d1-10bb-4f39-9a09-195e7415eb7e None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:10.567549 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5645f3d1-10bb-4f39-9a09-195e7415eb7e None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:10.567869 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5645f3d1-10bb-4f39-9a09-195e7415eb7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:10.587153 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-5645f3d1-10bb-4f39-9a09-195e7415eb7e None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:05:10.588367 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-5645f3d1-10bb-4f39-9a09-195e7415eb7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:10.596700 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1424/2839] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:05:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:05:10.600707 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1905c5f7-5f13-44bf-9261-9af464cacc6e None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:10.610189 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1905c5f7-5f13-44bf-9261-9af464cacc6e None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:10.614764 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9109c8f-10fc-4244-9630-20ec8ce6232b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:10.615398 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9109c8f-10fc-4244-9630-20ec8ce6232b admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:10.615679 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9109c8f-10fc-4244-9630-20ec8ce6232b admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:10.615987 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9109c8f-10fc-4244-9630-20ec8ce6232b admin admin] PATH_INFO: `/v3/domains` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:10.616705 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9109c8f-10fc-4244-9630-20ec8ce6232b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 17:05:10.617127 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9109c8f-10fc-4244-9630-20ec8ce6232b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:10.618707 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9109c8f-10fc-4244-9630-20ec8ce6232b admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:10.630249 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1416/2840] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Jul 18 17:05:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 17:05:10.634440 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5645f3d1-10bb-4f39-9a09-195e7415eb7e None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:10.644086 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5645f3d1-10bb-4f39-9a09-195e7415eb7e None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:10.648640 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f886693-80e4-431e-bc45-11af043dcd31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:10.649273 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f886693-80e4-431e-bc45-11af043dcd31 admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:10.649554 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f886693-80e4-431e-bc45-11af043dcd31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:10.649831 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f886693-80e4-431e-bc45-11af043dcd31 admin admin] PATH_INFO: `/v3/projects` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:10.650521 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f886693-80e4-431e-bc45-11af043dcd31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:10.652439 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f886693-80e4-431e-bc45-11af043dcd31 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:10.665662 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:05:10.797694 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1425/2841] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 17:05:10 2022] POST /identity/v3/projects => generated 405 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:05:10.802050 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9109c8f-10fc-4244-9630-20ec8ce6232b admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:10.813078 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9109c8f-10fc-4244-9630-20ec8ce6232b admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:10.821032 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:05:10.869275 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88684541-ad88-4e70-87c8-1529ea1511bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:10.869951 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88684541-ad88-4e70-87c8-1529ea1511bc admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:10.870234 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88684541-ad88-4e70-87c8-1529ea1511bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:10.870512 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88684541-ad88-4e70-87c8-1529ea1511bc admin admin] PATH_INFO: `/v3/users` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:10.871204 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88684541-ad88-4e70-87c8-1529ea1511bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:10.873795 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88684541-ad88-4e70-87c8-1529ea1511bc admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:10.973096 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1417/2842] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 17:05:10 2022] POST /identity/v3/users => generated 303 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:05:10.977263 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f886693-80e4-431e-bc45-11af043dcd31 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:10.987639 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f886693-80e4-431e-bc45-11af043dcd31 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:10.992300 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debfe988-f319-4cde-acf5-7e6027e284c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:10.992950 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debfe988-f319-4cde-acf5-7e6027e284c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:10.993232 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debfe988-f319-4cde-acf5-7e6027e284c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:10.993509 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debfe988-f319-4cde-acf5-7e6027e284c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:10.994227 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debfe988-f319-4cde-acf5-7e6027e284c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:10.995979 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debfe988-f319-4cde-acf5-7e6027e284c1 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:11.007042 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1426/2843] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 17:05:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 17:05:11.010842 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88684541-ad88-4e70-87c8-1529ea1511bc admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:11.021601 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88684541-ad88-4e70-87c8-1529ea1511bc admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:11.026474 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62df284-c558-47d4-b43f-0d694b6df81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:11.027138 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62df284-c558-47d4-b43f-0d694b6df81e admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:11.027421 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62df284-c558-47d4-b43f-0d694b6df81e admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:11.027701 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62df284-c558-47d4-b43f-0d694b6df81e admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:11.028503 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62df284-c558-47d4-b43f-0d694b6df81e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:11.030143 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62df284-c558-47d4-b43f-0d694b6df81e admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:11.040484 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1418/2844] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 17:05:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:05:11.044617 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debfe988-f319-4cde-acf5-7e6027e284c1 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:11.054439 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debfe988-f319-4cde-acf5-7e6027e284c1 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:11.059100 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f8da5-591e-48cf-a759-ceb9ba400f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:11.060513 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f8da5-591e-48cf-a759-ceb9ba400f42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:11.060796 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f8da5-591e-48cf-a759-ceb9ba400f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:11.061071 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f8da5-591e-48cf-a759-ceb9ba400f42 admin admin] PATH_INFO: `/v3/projects/1e7710eb57884999bf7bb7108ea4670f/users/e7a1a23647294eed92186d4e6c5378a7/roles/ad3a2bc7b2094a4da1a95a143c8d9436` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:11.075404 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0f8da5-591e-48cf-a759-ceb9ba400f42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e7710eb57884999bf7bb7108ea4670f, user_id=e7a1a23647294eed92186d4e6c5378a7, role_id=ad3a2bc7b2094a4da1a95a143c8d9436)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:11.078653 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0f8da5-591e-48cf-a759-ceb9ba400f42 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:11.139000 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1427/2845] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 17:05:11 2022] PUT /identity/v3/projects/1e7710eb57884999bf7bb7108ea4670f/users/e7a1a23647294eed92186d4e6c5378a7/roles/ad3a2bc7b2094a4da1a95a143c8d9436 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:05:11.144092 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d47bc8-5e86-4b3f-bc8b-8fa68d769179 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:11.144382 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d47bc8-5e86-4b3f-bc8b-8fa68d769179 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:11.144659 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d47bc8-5e86-4b3f-bc8b-8fa68d769179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:11.161958 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-23d47bc8-5e86-4b3f-bc8b-8fa68d769179 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:05:11.163155 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-23d47bc8-5e86-4b3f-bc8b-8fa68d769179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:11.222700 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1419/2846] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:05:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:05:11.232986 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f8da5-591e-48cf-a759-ceb9ba400f42 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:11.239106 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-1e0f8da5-591e-48cf-a759-ceb9ba400f42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:11.290616 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f8da5-591e-48cf-a759-ceb9ba400f42 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:11.294279 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1fc9e9-4616-4dc6-b770-18411b53cd69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:11.294922 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1fc9e9-4616-4dc6-b770-18411b53cd69 service neutron] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:11.295200 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1fc9e9-4616-4dc6-b770-18411b53cd69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:11.295473 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1fc9e9-4616-4dc6-b770-18411b53cd69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:11.304336 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1fc9e9-4616-4dc6-b770-18411b53cd69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:11.305751 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1fc9e9-4616-4dc6-b770-18411b53cd69 service neutron] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:11.314941 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1428/2847] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 17:05:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 17:05:12.522996 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf61c8-ea77-486e-8992-40df21140e17 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:12.523510 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf61c8-ea77-486e-8992-40df21140e17 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:12.523806 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf61c8-ea77-486e-8992-40df21140e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:12.549833 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-4adf61c8-ea77-486e-8992-40df21140e17 None None] MFA Rules not processed for user `e7a1a23647294eed92186d4e6c5378a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:05:12.551055 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-4adf61c8-ea77-486e-8992-40df21140e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:12.626250 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1420/2848] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:05:12 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:05:12.630963 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1fc9e9-4616-4dc6-b770-18411b53cd69 service neutron] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:12.641225 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1fc9e9-4616-4dc6-b770-18411b53cd69 service neutron] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:12.645801 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7465a4e-c768-4853-8d53-788f0fd0e0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:12.646443 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7465a4e-c768-4853-8d53-788f0fd0e0c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:12.646727 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7465a4e-c768-4853-8d53-788f0fd0e0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:12.647005 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7465a4e-c768-4853-8d53-788f0fd0e0c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:12.647688 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7465a4e-c768-4853-8d53-788f0fd0e0c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:12.649615 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7465a4e-c768-4853-8d53-788f0fd0e0c0 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:12.768774 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1429/2849] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 17:05:12 2022] POST /identity/v3/projects => generated 403 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:05:12.772929 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf61c8-ea77-486e-8992-40df21140e17 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:12.783601 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf61c8-ea77-486e-8992-40df21140e17 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:12.800130 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:05:12.838742 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c165556-b37b-45d5-93e0-782ac5b75100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:12.839407 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c165556-b37b-45d5-93e0-782ac5b75100 admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:12.839693 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c165556-b37b-45d5-93e0-782ac5b75100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:12.840034 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c165556-b37b-45d5-93e0-782ac5b75100 admin admin] PATH_INFO: `/v3/users` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:12.840789 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c165556-b37b-45d5-93e0-782ac5b75100 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:12.843078 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c165556-b37b-45d5-93e0-782ac5b75100 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:12.927593 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1421/2850] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 17:05:12 2022] POST /identity/v3/users => generated 308 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:05:12.931437 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7465a4e-c768-4853-8d53-788f0fd0e0c0 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:12.942298 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7465a4e-c768-4853-8d53-788f0fd0e0c0 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:12.946860 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2febc701-7b16-48ce-8dcf-cdfbbc0a5084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:12.947504 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2febc701-7b16-48ce-8dcf-cdfbbc0a5084 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:12.947822 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2febc701-7b16-48ce-8dcf-cdfbbc0a5084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:12.948099 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2febc701-7b16-48ce-8dcf-cdfbbc0a5084 admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:12.948813 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2febc701-7b16-48ce-8dcf-cdfbbc0a5084 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:12.950431 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2febc701-7b16-48ce-8dcf-cdfbbc0a5084 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:12.960909 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1430/2851] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 17:05:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:05:12.964947 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c165556-b37b-45d5-93e0-782ac5b75100 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:12.974864 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c165556-b37b-45d5-93e0-782ac5b75100 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:12.979464 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702b164-03e3-469d-be47-391cb10d30df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:12.980369 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702b164-03e3-469d-be47-391cb10d30df admin admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:12.980658 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702b164-03e3-469d-be47-391cb10d30df admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:12.980936 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702b164-03e3-469d-be47-391cb10d30df admin admin] PATH_INFO: `/v3/projects/a62468b2b4074853bee1a360bf29774a/users/8831c85a8f154993880d9357e84cdfbe/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:12.995988 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7702b164-03e3-469d-be47-391cb10d30df admin admin] RBAC: Authorizing `identity:create_grant(project_id=a62468b2b4074853bee1a360bf29774a, user_id=8831c85a8f154993880d9357e84cdfbe, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:12.999404 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7702b164-03e3-469d-be47-391cb10d30df admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:13.081334 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1422/2852] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 17:05:12 2022] PUT /identity/v3/projects/a62468b2b4074853bee1a360bf29774a/users/8831c85a8f154993880d9357e84cdfbe/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:05:13.086546 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2febc701-7b16-48ce-8dcf-cdfbbc0a5084 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:13.097071 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2febc701-7b16-48ce-8dcf-cdfbbc0a5084 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:13.152137 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e87d4e-5d3a-4f0d-b02c-4b13e9352342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:13.152794 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e87d4e-5d3a-4f0d-b02c-4b13e9352342 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:13.153080 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e87d4e-5d3a-4f0d-b02c-4b13e9352342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:13.153362 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e87d4e-5d3a-4f0d-b02c-4b13e9352342 admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:13.154655 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e87d4e-5d3a-4f0d-b02c-4b13e9352342 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:13.156288 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e87d4e-5d3a-4f0d-b02c-4b13e9352342 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:13.166094 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1431/2853] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 17:05:13 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:05:13.170860 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702b164-03e3-469d-be47-391cb10d30df admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:13.181097 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702b164-03e3-469d-be47-391cb10d30df admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:13.185650 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4f8a1c-cfe3-4758-ad54-ab749d9c9eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:13.186516 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4f8a1c-cfe3-4758-ad54-ab749d9c9eaf admin admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:13.186797 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4f8a1c-cfe3-4758-ad54-ab749d9c9eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:13.187073 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4f8a1c-cfe3-4758-ad54-ab749d9c9eaf admin admin] PATH_INFO: `/v3/projects/a62468b2b4074853bee1a360bf29774a/users/8831c85a8f154993880d9357e84cdfbe/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:13.189070 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4f8a1c-cfe3-4758-ad54-ab749d9c9eaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a62468b2b4074853bee1a360bf29774a, user_id=8831c85a8f154993880d9357e84cdfbe, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:13.191689 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4f8a1c-cfe3-4758-ad54-ab749d9c9eaf admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:13.201675 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1423/2854] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 17:05:13 2022] PUT /identity/v3/projects/a62468b2b4074853bee1a360bf29774a/users/8831c85a8f154993880d9357e84cdfbe/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 17:05:14.443097 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75bceb-1e16-48d2-b203-06558bf74b15 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:14.447874 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75bceb-1e16-48d2-b203-06558bf74b15 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:14.447874 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75bceb-1e16-48d2-b203-06558bf74b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:14.478862 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-dd75bceb-1e16-48d2-b203-06558bf74b15 None None] MFA Rules not processed for user `8831c85a8f154993880d9357e84cdfbe`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:05:14.480149 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-dd75bceb-1e16-48d2-b203-06558bf74b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:14.495293 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:05:14.561195 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1432/2855] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:05:14 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:05:15.767440 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4f8a1c-cfe3-4758-ad54-ab749d9c9eaf admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:15.767440 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-fd4f8a1c-cfe3-4758-ad54-ab749d9c9eaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:15.834050 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4f8a1c-cfe3-4758-ad54-ab749d9c9eaf admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:15.839016 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35255dde-2f80-402e-8a82-2b1ff5223fde service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700ad7df774415b89737c7dddcc5b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:15.839655 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35255dde-2f80-402e-8a82-2b1ff5223fde service placement] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:15.839961 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35255dde-2f80-402e-8a82-2b1ff5223fde service placement] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:15.840234 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35255dde-2f80-402e-8a82-2b1ff5223fde service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:15.842661 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-35255dde-2f80-402e-8a82-2b1ff5223fde service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:15.854430 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35255dde-2f80-402e-8a82-2b1ff5223fde service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:15.856084 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35255dde-2f80-402e-8a82-2b1ff5223fde service placement] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:15.866936 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1424/2856] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 17:05:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:05:15.873864 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd75bceb-1e16-48d2-b203-06558bf74b15 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:15.950315 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd75bceb-1e16-48d2-b203-06558bf74b15 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:15.955404 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92be179d-059d-4a16-9578-9e63298bdf2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:15.956332 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be179d-059d-4a16-9578-9e63298bdf2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:15.956620 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be179d-059d-4a16-9578-9e63298bdf2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:15.956899 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be179d-059d-4a16-9578-9e63298bdf2b admin admin] PATH_INFO: `/v3/users/e7a1a23647294eed92186d4e6c5378a7` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:15.958094 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92be179d-059d-4a16-9578-9e63298bdf2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7a1a23647294eed92186d4e6c5378a7)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:15.960035 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92be179d-059d-4a16-9578-9e63298bdf2b admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:16.232833 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-92be179d-059d-4a16-9578-9e63298bdf2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7a1a23647294eed92186d4e6c5378a7'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:16.245139 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-92be179d-059d-4a16-9578-9e63298bdf2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7a1a23647294eed92186d4e6c5378a7'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:16.245822 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-92be179d-059d-4a16-9578-9e63298bdf2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7a1a23647294eed92186d4e6c5378a7'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:16.253133 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-92be179d-059d-4a16-9578-9e63298bdf2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7a1a23647294eed92186d4e6c5378a7'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:16.361427 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-92be179d-059d-4a16-9578-9e63298bdf2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7a1a23647294eed92186d4e6c5378a7'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:16.368170 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1433/2857] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 17:05:15 2022] DELETE /identity/v3/users/e7a1a23647294eed92186d4e6c5378a7 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:05:16.637714 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35255dde-2f80-402e-8a82-2b1ff5223fde service placement] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:16.648658 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35255dde-2f80-402e-8a82-2b1ff5223fde service placement] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:16.707196 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c61390-1b85-4028-a43d-da0e4380701b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:16.708078 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c61390-1b85-4028-a43d-da0e4380701b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:16.708442 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c61390-1b85-4028-a43d-da0e4380701b admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:16.708723 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c61390-1b85-4028-a43d-da0e4380701b admin admin] PATH_INFO: `/v3/projects/1e7710eb57884999bf7bb7108ea4670f` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:16.709879 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c61390-1b85-4028-a43d-da0e4380701b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e7710eb57884999bf7bb7108ea4670f)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:16.711822 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c61390-1b85-4028-a43d-da0e4380701b admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:16.714025 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:05:16.858908 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-52c61390-1b85-4028-a43d-da0e4380701b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e7710eb57884999bf7bb7108ea4670f', 'request_id': 'req-52c61390-1b85-4028-a43d-da0e4380701b'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:16.944287 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-52c61390-1b85-4028-a43d-da0e4380701b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e7710eb57884999bf7bb7108ea4670f', 'request_id': 'req-52c61390-1b85-4028-a43d-da0e4380701b'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:16.950300 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-52c61390-1b85-4028-a43d-da0e4380701b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e7710eb57884999bf7bb7108ea4670f', 'request_id': 'req-52c61390-1b85-4028-a43d-da0e4380701b'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:16.961505 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-52c61390-1b85-4028-a43d-da0e4380701b admin admin] The token cache is being invalidate because project 1e7710eb57884999bf7bb7108ea4670f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:05:16.961790 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-52c61390-1b85-4028-a43d-da0e4380701b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:16.962417 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-52c61390-1b85-4028-a43d-da0e4380701b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:16.963987 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1425/2858] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 17:05:16 2022] DELETE /identity/v3/projects/1e7710eb57884999bf7bb7108ea4670f => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:05:16.968579 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92be179d-059d-4a16-9578-9e63298bdf2b admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:16.970011 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-92be179d-059d-4a16-9578-9e63298bdf2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:16.983528 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92be179d-059d-4a16-9578-9e63298bdf2b admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:17.009416 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:05:17.039269 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ff6e9-68eb-434e-8ddb-62617457b50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:17.040390 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ff6e9-68eb-434e-8ddb-62617457b50b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:17.040781 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ff6e9-68eb-434e-8ddb-62617457b50b admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:17.041234 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ff6e9-68eb-434e-8ddb-62617457b50b admin admin] PATH_INFO: `/v3/users/8831c85a8f154993880d9357e84cdfbe` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:17.042822 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60ff6e9-68eb-434e-8ddb-62617457b50b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8831c85a8f154993880d9357e84cdfbe)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:17.045340 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60ff6e9-68eb-434e-8ddb-62617457b50b admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:17.231513 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-c60ff6e9-68eb-434e-8ddb-62617457b50b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8831c85a8f154993880d9357e84cdfbe'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:17.243674 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-c60ff6e9-68eb-434e-8ddb-62617457b50b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8831c85a8f154993880d9357e84cdfbe'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:17.244378 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-c60ff6e9-68eb-434e-8ddb-62617457b50b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8831c85a8f154993880d9357e84cdfbe'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:17.251833 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-c60ff6e9-68eb-434e-8ddb-62617457b50b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8831c85a8f154993880d9357e84cdfbe'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:17.338731 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-c60ff6e9-68eb-434e-8ddb-62617457b50b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8831c85a8f154993880d9357e84cdfbe'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:17.345043 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1434/2859] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 17:05:16 2022] DELETE /identity/v3/users/8831c85a8f154993880d9357e84cdfbe => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:05:17.619959 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c61390-1b85-4028-a43d-da0e4380701b admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:17.621379 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-52c61390-1b85-4028-a43d-da0e4380701b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:17.636630 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c61390-1b85-4028-a43d-da0e4380701b admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:17.698553 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb449b13-938d-41f5-b7a3-e3e44ebf6198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:17.699450 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb449b13-938d-41f5-b7a3-e3e44ebf6198 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:17.699752 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb449b13-938d-41f5-b7a3-e3e44ebf6198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:17.700033 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb449b13-938d-41f5-b7a3-e3e44ebf6198 admin admin] PATH_INFO: `/v3/projects/a62468b2b4074853bee1a360bf29774a` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:17.701253 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb449b13-938d-41f5-b7a3-e3e44ebf6198 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a62468b2b4074853bee1a360bf29774a)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:17.703406 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb449b13-938d-41f5-b7a3-e3e44ebf6198 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:17.864746 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-eb449b13-938d-41f5-b7a3-e3e44ebf6198 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a62468b2b4074853bee1a360bf29774a', 'request_id': 'req-eb449b13-938d-41f5-b7a3-e3e44ebf6198'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:17.927250 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-eb449b13-938d-41f5-b7a3-e3e44ebf6198 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a62468b2b4074853bee1a360bf29774a', 'request_id': 'req-eb449b13-938d-41f5-b7a3-e3e44ebf6198'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:17.933154 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-eb449b13-938d-41f5-b7a3-e3e44ebf6198 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a62468b2b4074853bee1a360bf29774a', 'request_id': 'req-eb449b13-938d-41f5-b7a3-e3e44ebf6198'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:17.944297 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-eb449b13-938d-41f5-b7a3-e3e44ebf6198 admin admin] The token cache is being invalidate because project a62468b2b4074853bee1a360bf29774a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:05:17.944591 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-eb449b13-938d-41f5-b7a3-e3e44ebf6198 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:17.945243 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-eb449b13-938d-41f5-b7a3-e3e44ebf6198 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:17.946895 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1426/2860] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 17:05:17 2022] DELETE /identity/v3/projects/a62468b2b4074853bee1a360bf29774a => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:05:17.952565 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba1546-cb67-49d3-a221-f0f2bc9033e5 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:17.952870 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba1546-cb67-49d3-a221-f0f2bc9033e5 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:17.953153 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba1546-cb67-49d3-a221-f0f2bc9033e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:17.972796 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-b8ba1546-cb67-49d3-a221-f0f2bc9033e5 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:05:17.973982 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-b8ba1546-cb67-49d3-a221-f0f2bc9033e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:18.031897 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1435/2861] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:05:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:05:18.039599 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078b1a2-d361-4730-a9fe-bd700a3bc801 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:18.039925 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078b1a2-d361-4730-a9fe-bd700a3bc801 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:18.040205 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078b1a2-d361-4730-a9fe-bd700a3bc801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:18.058448 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-5078b1a2-d361-4730-a9fe-bd700a3bc801 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:05:18.059652 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-5078b1a2-d361-4730-a9fe-bd700a3bc801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:18.068116 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1427/2862] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:05:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:05:18.072201 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba1546-cb67-49d3-a221-f0f2bc9033e5 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:18.081728 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba1546-cb67-49d3-a221-f0f2bc9033e5 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:18.086261 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a4c46-91f3-4455-a70b-77b593f1f5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:18.086905 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a4c46-91f3-4455-a70b-77b593f1f5bd admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:18.087188 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a4c46-91f3-4455-a70b-77b593f1f5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:18.087464 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a4c46-91f3-4455-a70b-77b593f1f5bd admin admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:18.088216 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13a4c46-91f3-4455-a70b-77b593f1f5bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 17:05:18.088520 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13a4c46-91f3-4455-a70b-77b593f1f5bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:18.090125 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13a4c46-91f3-4455-a70b-77b593f1f5bd admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:18.101621 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1436/2863] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Jul 18 17:05:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 17:05:18.105616 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5078b1a2-d361-4730-a9fe-bd700a3bc801 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:18.115161 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5078b1a2-d361-4730-a9fe-bd700a3bc801 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:18.119721 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772262b4-e68a-43c1-9a5a-791421002a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:18.120369 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772262b4-e68a-43c1-9a5a-791421002a3b admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:18.120684 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772262b4-e68a-43c1-9a5a-791421002a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:18.120968 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772262b4-e68a-43c1-9a5a-791421002a3b admin admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:18.121658 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772262b4-e68a-43c1-9a5a-791421002a3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:18.124119 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772262b4-e68a-43c1-9a5a-791421002a3b admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:18.136995 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:05:18.186451 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1428/2864] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 17:05:18 2022] POST /identity/v3/projects => generated 379 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 17:05:18.190046 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a4c46-91f3-4455-a70b-77b593f1f5bd admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:18.200134 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a4c46-91f3-4455-a70b-77b593f1f5bd admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:18.232212 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:05:18.257319 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06f62a4-fcf7-489d-9f0f-08b2a0dd6dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:18.257986 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f62a4-fcf7-489d-9f0f-08b2a0dd6dc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:18.258271 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f62a4-fcf7-489d-9f0f-08b2a0dd6dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:18.258547 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f62a4-fcf7-489d-9f0f-08b2a0dd6dc1 admin admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:18.259237 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06f62a4-fcf7-489d-9f0f-08b2a0dd6dc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:18.261199 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06f62a4-fcf7-489d-9f0f-08b2a0dd6dc1 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:18.345312 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1437/2865] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 17:05:18 2022] POST /identity/v3/users => generated 290 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:05:18.349352 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772262b4-e68a-43c1-9a5a-791421002a3b admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:18.360274 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772262b4-e68a-43c1-9a5a-791421002a3b admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:18.364869 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b96aa-55a4-41d1-a362-46bbba5ab4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:18.365589 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b96aa-55a4-41d1-a362-46bbba5ab4a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:18.365824 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b96aa-55a4-41d1-a362-46bbba5ab4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:18.366101 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b96aa-55a4-41d1-a362-46bbba5ab4a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:18.366829 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2b96aa-55a4-41d1-a362-46bbba5ab4a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:18.368454 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2b96aa-55a4-41d1-a362-46bbba5ab4a1 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:18.378800 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1429/2866] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 17:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:05:18.383062 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06f62a4-fcf7-489d-9f0f-08b2a0dd6dc1 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:18.394318 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06f62a4-fcf7-489d-9f0f-08b2a0dd6dc1 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:18.398979 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fbb198-9b13-43f3-873e-1452fd20a546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:18.399636 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fbb198-9b13-43f3-873e-1452fd20a546 admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:18.399948 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fbb198-9b13-43f3-873e-1452fd20a546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:18.400224 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fbb198-9b13-43f3-873e-1452fd20a546 admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:18.400978 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fbb198-9b13-43f3-873e-1452fd20a546 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:18.402565 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fbb198-9b13-43f3-873e-1452fd20a546 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:18.412942 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1438/2867] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 17:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:05:18.416909 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b96aa-55a4-41d1-a362-46bbba5ab4a1 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:18.427363 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b96aa-55a4-41d1-a362-46bbba5ab4a1 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:18.431981 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f91aecb-1664-41b2-9b5a-9271b0a7d376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:18.439856 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f91aecb-1664-41b2-9b5a-9271b0a7d376 admin admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:18.439856 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f91aecb-1664-41b2-9b5a-9271b0a7d376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:18.439856 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f91aecb-1664-41b2-9b5a-9271b0a7d376 admin admin] PATH_INFO: `/v3/projects/87d38a93e9f64960ba51e2dd12c1b40b/users/8ddc7556b61a4c0199dda272680b8769/roles/ad3a2bc7b2094a4da1a95a143c8d9436` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:18.447557 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f91aecb-1664-41b2-9b5a-9271b0a7d376 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87d38a93e9f64960ba51e2dd12c1b40b, user_id=8ddc7556b61a4c0199dda272680b8769, role_id=ad3a2bc7b2094a4da1a95a143c8d9436)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:18.450213 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f91aecb-1664-41b2-9b5a-9271b0a7d376 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:18.539026 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1430/2868] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 17:05:18 2022] PUT /identity/v3/projects/87d38a93e9f64960ba51e2dd12c1b40b/users/8ddc7556b61a4c0199dda272680b8769/roles/ad3a2bc7b2094a4da1a95a143c8d9436 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:05:18.549250 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962eb326-6c59-4489-9a08-6fe93ab77a13 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:18.549538 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962eb326-6c59-4489-9a08-6fe93ab77a13 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:18.549814 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962eb326-6c59-4489-9a08-6fe93ab77a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:18.576139 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-962eb326-6c59-4489-9a08-6fe93ab77a13 None None] MFA Rules not processed for user `8ddc7556b61a4c0199dda272680b8769`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:05:18.577330 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-962eb326-6c59-4489-9a08-6fe93ab77a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:18.639173 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1439/2869] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:05:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:05:18.643564 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f91aecb-1664-41b2-9b5a-9271b0a7d376 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:18.704586 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f91aecb-1664-41b2-9b5a-9271b0a7d376 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:18.709279 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9141e288-8ed0-46f0-8176-bd9307e59012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:18.709929 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141e288-8ed0-46f0-8176-bd9307e59012 admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:18.710215 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141e288-8ed0-46f0-8176-bd9307e59012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:18.710490 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141e288-8ed0-46f0-8176-bd9307e59012 admin admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:18.711187 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9141e288-8ed0-46f0-8176-bd9307e59012 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:18.713126 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9141e288-8ed0-46f0-8176-bd9307e59012 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:18.831214 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1431/2870] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 17:05:18 2022] POST /identity/v3/projects => generated 375 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 17:05:18.835437 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962eb326-6c59-4489-9a08-6fe93ab77a13 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:18.846645 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962eb326-6c59-4489-9a08-6fe93ab77a13 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:18.902564 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a081565d-e350-492e-8e77-b3bc9f64c482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:18.903168 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081565d-e350-492e-8e77-b3bc9f64c482 admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:18.903458 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081565d-e350-492e-8e77-b3bc9f64c482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:18.903757 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081565d-e350-492e-8e77-b3bc9f64c482 admin admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:18.904454 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a081565d-e350-492e-8e77-b3bc9f64c482 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:18.906363 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a081565d-e350-492e-8e77-b3bc9f64c482 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:18.989891 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1440/2871] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 17:05:18 2022] POST /identity/v3/users => generated 288 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:05:18.993881 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9141e288-8ed0-46f0-8176-bd9307e59012 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:19.005157 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9141e288-8ed0-46f0-8176-bd9307e59012 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:19.009855 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e21f99f-f864-4312-a6d5-1eacc1e5aa0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:19.010512 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e21f99f-f864-4312-a6d5-1eacc1e5aa0c admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:19.010800 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e21f99f-f864-4312-a6d5-1eacc1e5aa0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:19.011081 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e21f99f-f864-4312-a6d5-1eacc1e5aa0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:19.011840 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e21f99f-f864-4312-a6d5-1eacc1e5aa0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:19.013443 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e21f99f-f864-4312-a6d5-1eacc1e5aa0c admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:19.024169 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1432/2872] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 17:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:05:19.028082 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a081565d-e350-492e-8e77-b3bc9f64c482 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:19.038519 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a081565d-e350-492e-8e77-b3bc9f64c482 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:19.043052 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db036457-812f-4257-9fde-ba92cc35d7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:19.043703 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db036457-812f-4257-9fde-ba92cc35d7fc admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:19.044017 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db036457-812f-4257-9fde-ba92cc35d7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:19.044913 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db036457-812f-4257-9fde-ba92cc35d7fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:19.045639 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db036457-812f-4257-9fde-ba92cc35d7fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:19.047221 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db036457-812f-4257-9fde-ba92cc35d7fc admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:19.057585 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1441/2873] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 17:05:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:05:19.061443 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e21f99f-f864-4312-a6d5-1eacc1e5aa0c admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:19.071250 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e21f99f-f864-4312-a6d5-1eacc1e5aa0c admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:19.075844 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8f3597-a8ec-4f43-b5da-397d5606c494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:19.076710 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f3597-a8ec-4f43-b5da-397d5606c494 admin admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:19.076989 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f3597-a8ec-4f43-b5da-397d5606c494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:19.077264 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f3597-a8ec-4f43-b5da-397d5606c494 admin admin] PATH_INFO: `/v3/projects/2502d8679ee9440fa977047455d8791f/users/9efef756f64b40769cdac574467e51a2/roles/ad3a2bc7b2094a4da1a95a143c8d9436` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:19.092030 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8f3597-a8ec-4f43-b5da-397d5606c494 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2502d8679ee9440fa977047455d8791f, user_id=9efef756f64b40769cdac574467e51a2, role_id=ad3a2bc7b2094a4da1a95a143c8d9436)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:19.094680 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8f3597-a8ec-4f43-b5da-397d5606c494 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:19.190567 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1433/2874] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 17:05:19 2022] PUT /identity/v3/projects/2502d8679ee9440fa977047455d8791f/users/9efef756f64b40769cdac574467e51a2/roles/ad3a2bc7b2094a4da1a95a143c8d9436 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:05:19.251952 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0df812-0ef9-4658-8708-4ee44b20194c None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:19.252235 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0df812-0ef9-4658-8708-4ee44b20194c None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:19.252520 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0df812-0ef9-4658-8708-4ee44b20194c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:19.279538 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-fc0df812-0ef9-4658-8708-4ee44b20194c None None] MFA Rules not processed for user `9efef756f64b40769cdac574467e51a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:05:19.280878 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-fc0df812-0ef9-4658-8708-4ee44b20194c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:19.290064 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:05:19.344117 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1442/2875] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:05:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:05:19.348602 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8f3597-a8ec-4f43-b5da-397d5606c494 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:19.410528 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8f3597-a8ec-4f43-b5da-397d5606c494 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:19.415203 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6f8a92-2cb2-40d4-a1a5-a3cdf343512c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:19.415878 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f8a92-2cb2-40d4-a1a5-a3cdf343512c admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:19.416162 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f8a92-2cb2-40d4-a1a5-a3cdf343512c admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:19.416443 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f8a92-2cb2-40d4-a1a5-a3cdf343512c admin admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:19.417130 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6f8a92-2cb2-40d4-a1a5-a3cdf343512c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:19.419038 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6f8a92-2cb2-40d4-a1a5-a3cdf343512c admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:19.431662 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:05:19.552587 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1434/2876] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 17:05:19 2022] POST /identity/v3/projects => generated 379 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:05:19.556995 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0df812-0ef9-4658-8708-4ee44b20194c None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:19.567613 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0df812-0ef9-4658-8708-4ee44b20194c None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:19.623297 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8243362-804c-4294-bc74-c7fe0f19e2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:19.624003 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8243362-804c-4294-bc74-c7fe0f19e2c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:19.624292 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8243362-804c-4294-bc74-c7fe0f19e2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:19.624571 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8243362-804c-4294-bc74-c7fe0f19e2c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:19.625260 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8243362-804c-4294-bc74-c7fe0f19e2c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:19.627176 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8243362-804c-4294-bc74-c7fe0f19e2c9 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:19.710280 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1443/2877] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 17:05:19 2022] POST /identity/v3/users => generated 296 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:05:19.714336 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6f8a92-2cb2-40d4-a1a5-a3cdf343512c admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:19.725563 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6f8a92-2cb2-40d4-a1a5-a3cdf343512c admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:19.730284 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c69940-4833-4600-89f1-9d719d43fe30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:19.730944 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c69940-4833-4600-89f1-9d719d43fe30 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:19.731275 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c69940-4833-4600-89f1-9d719d43fe30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:19.731557 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c69940-4833-4600-89f1-9d719d43fe30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:19.732309 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c69940-4833-4600-89f1-9d719d43fe30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:19.733979 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c69940-4833-4600-89f1-9d719d43fe30 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:19.744482 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1435/2878] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 17:05:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:05:19.748393 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8243362-804c-4294-bc74-c7fe0f19e2c9 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:19.758398 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8243362-804c-4294-bc74-c7fe0f19e2c9 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:19.763644 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da879d4-fc5d-403e-9278-c9bd8baa4dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:19.764620 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da879d4-fc5d-403e-9278-c9bd8baa4dee admin admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:19.764904 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da879d4-fc5d-403e-9278-c9bd8baa4dee admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:19.765181 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da879d4-fc5d-403e-9278-c9bd8baa4dee admin admin] PATH_INFO: `/v3/projects/5e305e53df944547aa5e5452a1428cf1/users/8b9fab4ade134998830fafb238b7faae/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:19.780565 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da879d4-fc5d-403e-9278-c9bd8baa4dee admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e305e53df944547aa5e5452a1428cf1, user_id=8b9fab4ade134998830fafb238b7faae, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:19.783238 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da879d4-fc5d-403e-9278-c9bd8baa4dee admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:19.864917 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1444/2879] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 17:05:19 2022] PUT /identity/v3/projects/5e305e53df944547aa5e5452a1428cf1/users/8b9fab4ade134998830fafb238b7faae/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 17:05:19.868985 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c69940-4833-4600-89f1-9d719d43fe30 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:19.879863 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c69940-4833-4600-89f1-9d719d43fe30 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:19.935829 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a18b4-30fc-4d69-9dc4-75b92d414e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:19.936487 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a18b4-30fc-4d69-9dc4-75b92d414e53 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:19.936768 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a18b4-30fc-4d69-9dc4-75b92d414e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:19.937147 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a18b4-30fc-4d69-9dc4-75b92d414e53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:19.937855 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9a18b4-30fc-4d69-9dc4-75b92d414e53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:19.939480 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9a18b4-30fc-4d69-9dc4-75b92d414e53 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:19.949126 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1436/2880] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 17:05:19 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 17:05:19.953955 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da879d4-fc5d-403e-9278-c9bd8baa4dee admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:19.964068 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da879d4-fc5d-403e-9278-c9bd8baa4dee admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:19.968677 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc66fd-849a-4409-9ad1-fc0032b6bffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:19.969547 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc66fd-849a-4409-9ad1-fc0032b6bffe admin admin] REQUEST_METHOD: `PUT` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:19.969824 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc66fd-849a-4409-9ad1-fc0032b6bffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:19.970095 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc66fd-849a-4409-9ad1-fc0032b6bffe admin admin] PATH_INFO: `/v3/projects/5e305e53df944547aa5e5452a1428cf1/users/8b9fab4ade134998830fafb238b7faae/roles/fd83eab44cb343a2b532ce32a2ac31d8` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:19.972079 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cc66fd-849a-4409-9ad1-fc0032b6bffe admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e305e53df944547aa5e5452a1428cf1, user_id=8b9fab4ade134998830fafb238b7faae, role_id=fd83eab44cb343a2b532ce32a2ac31d8)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:19.974685 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cc66fd-849a-4409-9ad1-fc0032b6bffe admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:19.988688 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1445/2881] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 17:05:19 2022] PUT /identity/v3/projects/5e305e53df944547aa5e5452a1428cf1/users/8b9fab4ade134998830fafb238b7faae/roles/fd83eab44cb343a2b532ce32a2ac31d8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:05:19.995380 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d49ea-d9f3-4379-b292-e00feb6504ab None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:19.995897 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d49ea-d9f3-4379-b292-e00feb6504ab None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:19.996014 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d49ea-d9f3-4379-b292-e00feb6504ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:20.023046 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-e69d49ea-d9f3-4379-b292-e00feb6504ab None None] MFA Rules not processed for user `8b9fab4ade134998830fafb238b7faae`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:05:20.024276 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-e69d49ea-d9f3-4379-b292-e00feb6504ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:20.092362 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1437/2882] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:05:19 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:05:20.103477 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc66fd-849a-4409-9ad1-fc0032b6bffe admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:20.105258 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-66cc66fd-849a-4409-9ad1-fc0032b6bffe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:20.163557 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc66fd-849a-4409-9ad1-fc0032b6bffe admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:20.167216 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f28a709-3a02-4c04-abb4-43152a2bfa8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:20.167887 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28a709-3a02-4c04-abb4-43152a2bfa8b service cinder] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:20.168169 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28a709-3a02-4c04-abb4-43152a2bfa8b service cinder] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:20.168441 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28a709-3a02-4c04-abb4-43152a2bfa8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:20.177987 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f28a709-3a02-4c04-abb4-43152a2bfa8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:20.179397 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f28a709-3a02-4c04-abb4-43152a2bfa8b service cinder] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:20.189272 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1446/2883] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 17:05:20 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:05:20.288943 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69d49ea-d9f3-4379-b292-e00feb6504ab None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:20.290336 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-e69d49ea-d9f3-4379-b292-e00feb6504ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:20.303517 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69d49ea-d9f3-4379-b292-e00feb6504ab None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:20.307232 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f88331e-c55c-4355-8cab-4cc5ca1d8702 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:20.311609 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88331e-c55c-4355-8cab-4cc5ca1d8702 service cinder] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:20.311609 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88331e-c55c-4355-8cab-4cc5ca1d8702 service cinder] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:20.311609 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88331e-c55c-4355-8cab-4cc5ca1d8702 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:20.366956 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f88331e-c55c-4355-8cab-4cc5ca1d8702 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:20.370810 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f88331e-c55c-4355-8cab-4cc5ca1d8702 service cinder] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:20.377984 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1438/2884] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 17:05:20 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:05:24.849201 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f28a709-3a02-4c04-abb4-43152a2bfa8b service cinder] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:24.858267 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:05:24.909703 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f28a709-3a02-4c04-abb4-43152a2bfa8b service cinder] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:24.914291 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee79627-06c8-49ed-be29-64db97e6cf5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:24.919036 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee79627-06c8-49ed-be29-64db97e6cf5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:24.919036 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee79627-06c8-49ed-be29-64db97e6cf5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:24.919036 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee79627-06c8-49ed-be29-64db97e6cf5d admin admin] PATH_INFO: `/v3/users/8ddc7556b61a4c0199dda272680b8769` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:24.919036 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee79627-06c8-49ed-be29-64db97e6cf5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ddc7556b61a4c0199dda272680b8769)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:24.919036 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee79627-06c8-49ed-be29-64db97e6cf5d admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:25.111872 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-1ee79627-06c8-49ed-be29-64db97e6cf5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ddc7556b61a4c0199dda272680b8769'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:25.123354 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-1ee79627-06c8-49ed-be29-64db97e6cf5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ddc7556b61a4c0199dda272680b8769'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:25.124023 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-1ee79627-06c8-49ed-be29-64db97e6cf5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ddc7556b61a4c0199dda272680b8769'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:25.131046 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-1ee79627-06c8-49ed-be29-64db97e6cf5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ddc7556b61a4c0199dda272680b8769'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:25.224193 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-1ee79627-06c8-49ed-be29-64db97e6cf5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ddc7556b61a4c0199dda272680b8769'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:25.230207 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1447/2885] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 17:05:24 2022] DELETE /identity/v3/users/8ddc7556b61a4c0199dda272680b8769 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:05:25.235349 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec19391-053d-4ed6-b0ae-e7c8f27a0746 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:25.241291 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec19391-053d-4ed6-b0ae-e7c8f27a0746 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:25.241291 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec19391-053d-4ed6-b0ae-e7c8f27a0746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:25.241952 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:05:25.255012 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-7ec19391-053d-4ed6-b0ae-e7c8f27a0746 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:05:25.256255 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-7ec19391-053d-4ed6-b0ae-e7c8f27a0746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:25.313012 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1439/2886] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:05:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:05:25.323519 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee79627-06c8-49ed-be29-64db97e6cf5d admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:25.324952 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-1ee79627-06c8-49ed-be29-64db97e6cf5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:25.381438 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee79627-06c8-49ed-be29-64db97e6cf5d admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:25.385011 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a618c-d114-4138-8865-c9272f163414 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:25.385652 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a618c-d114-4138-8865-c9272f163414 service neutron] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:25.385935 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a618c-d114-4138-8865-c9272f163414 service neutron] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:25.386212 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a618c-d114-4138-8865-c9272f163414 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:25.395638 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49a618c-d114-4138-8865-c9272f163414 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:25.397083 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49a618c-d114-4138-8865-c9272f163414 service neutron] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:25.407035 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1448/2887] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 17:05:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:05:25.866108 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec19391-053d-4ed6-b0ae-e7c8f27a0746 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:25.867613 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-7ec19391-053d-4ed6-b0ae-e7c8f27a0746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:25.880719 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec19391-053d-4ed6-b0ae-e7c8f27a0746 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:25.884753 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccffe02b-2437-4435-9131-2adf705689ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:25.885610 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccffe02b-2437-4435-9131-2adf705689ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:25.885890 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccffe02b-2437-4435-9131-2adf705689ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:25.886170 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccffe02b-2437-4435-9131-2adf705689ef admin admin] PATH_INFO: `/v3/projects/87d38a93e9f64960ba51e2dd12c1b40b` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:25.887362 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccffe02b-2437-4435-9131-2adf705689ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=87d38a93e9f64960ba51e2dd12c1b40b)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:25.889355 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccffe02b-2437-4435-9131-2adf705689ef admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:26.116170 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-ccffe02b-2437-4435-9131-2adf705689ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87d38a93e9f64960ba51e2dd12c1b40b', 'request_id': 'req-ccffe02b-2437-4435-9131-2adf705689ef'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:26.258338 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-ccffe02b-2437-4435-9131-2adf705689ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87d38a93e9f64960ba51e2dd12c1b40b', 'request_id': 'req-ccffe02b-2437-4435-9131-2adf705689ef'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:26.264918 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-ccffe02b-2437-4435-9131-2adf705689ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87d38a93e9f64960ba51e2dd12c1b40b', 'request_id': 'req-ccffe02b-2437-4435-9131-2adf705689ef'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:26.280241 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-ccffe02b-2437-4435-9131-2adf705689ef admin admin] The token cache is being invalidate because project 87d38a93e9f64960ba51e2dd12c1b40b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:05:26.280241 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-ccffe02b-2437-4435-9131-2adf705689ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:26.280241 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-ccffe02b-2437-4435-9131-2adf705689ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:26.280241 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1440/2888] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 17:05:25 2022] DELETE /identity/v3/projects/87d38a93e9f64960ba51e2dd12c1b40b => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:05:26.283041 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a618c-d114-4138-8865-c9272f163414 service neutron] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:26.292714 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a618c-d114-4138-8865-c9272f163414 service neutron] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:26.317894 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:05:26.348206 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e806a-16a3-4323-8d28-89115349b7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:26.349113 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e806a-16a3-4323-8d28-89115349b7cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:26.349400 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e806a-16a3-4323-8d28-89115349b7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:26.349675 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e806a-16a3-4323-8d28-89115349b7cb admin admin] PATH_INFO: `/v3/users/9efef756f64b40769cdac574467e51a2` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:26.350847 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8e806a-16a3-4323-8d28-89115349b7cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=9efef756f64b40769cdac574467e51a2)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:26.353086 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8e806a-16a3-4323-8d28-89115349b7cb admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:26.615022 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-4a8e806a-16a3-4323-8d28-89115349b7cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9efef756f64b40769cdac574467e51a2'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:26.626738 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-4a8e806a-16a3-4323-8d28-89115349b7cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9efef756f64b40769cdac574467e51a2'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:26.627413 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-4a8e806a-16a3-4323-8d28-89115349b7cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9efef756f64b40769cdac574467e51a2'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:26.634534 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-4a8e806a-16a3-4323-8d28-89115349b7cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9efef756f64b40769cdac574467e51a2'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:26.732159 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-4a8e806a-16a3-4323-8d28-89115349b7cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9efef756f64b40769cdac574467e51a2'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:26.738916 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1449/2889] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 17:05:26 2022] DELETE /identity/v3/users/9efef756f64b40769cdac574467e51a2 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:05:27.191863 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccffe02b-2437-4435-9131-2adf705689ef admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:27.193330 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-ccffe02b-2437-4435-9131-2adf705689ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:27.206485 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccffe02b-2437-4435-9131-2adf705689ef admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:27.263665 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e29a3f7-53cb-495c-b3c1-ae2a6dd0c733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:27.264555 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29a3f7-53cb-495c-b3c1-ae2a6dd0c733 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:27.264867 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29a3f7-53cb-495c-b3c1-ae2a6dd0c733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:27.265140 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29a3f7-53cb-495c-b3c1-ae2a6dd0c733 admin admin] PATH_INFO: `/v3/projects/2502d8679ee9440fa977047455d8791f` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:27.266329 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e29a3f7-53cb-495c-b3c1-ae2a6dd0c733 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2502d8679ee9440fa977047455d8791f)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:27.268246 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e29a3f7-53cb-495c-b3c1-ae2a6dd0c733 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:27.392057 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:05:27.406852 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-1e29a3f7-53cb-495c-b3c1-ae2a6dd0c733 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2502d8679ee9440fa977047455d8791f', 'request_id': 'req-1e29a3f7-53cb-495c-b3c1-ae2a6dd0c733'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:27.510001 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-1e29a3f7-53cb-495c-b3c1-ae2a6dd0c733 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2502d8679ee9440fa977047455d8791f', 'request_id': 'req-1e29a3f7-53cb-495c-b3c1-ae2a6dd0c733'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:27.515831 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-1e29a3f7-53cb-495c-b3c1-ae2a6dd0c733 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2502d8679ee9440fa977047455d8791f', 'request_id': 'req-1e29a3f7-53cb-495c-b3c1-ae2a6dd0c733'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:27.526570 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-1e29a3f7-53cb-495c-b3c1-ae2a6dd0c733 admin admin] The token cache is being invalidate because project 2502d8679ee9440fa977047455d8791f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:05:27.526876 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-1e29a3f7-53cb-495c-b3c1-ae2a6dd0c733 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:27.527489 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-1e29a3f7-53cb-495c-b3c1-ae2a6dd0c733 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:27.529034 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1441/2890] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 17:05:27 2022] DELETE /identity/v3/projects/2502d8679ee9440fa977047455d8791f => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:05:27.533743 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e806a-16a3-4323-8d28-89115349b7cb admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:27.535162 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-4a8e806a-16a3-4323-8d28-89115349b7cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:27.548866 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e806a-16a3-4323-8d28-89115349b7cb admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:27.605049 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b25fc1-4aa4-4b6b-b4f2-eba2a4f12b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:27.605917 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b25fc1-4aa4-4b6b-b4f2-eba2a4f12b59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:27.606201 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b25fc1-4aa4-4b6b-b4f2-eba2a4f12b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:27.606479 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b25fc1-4aa4-4b6b-b4f2-eba2a4f12b59 admin admin] PATH_INFO: `/v3/users/8b9fab4ade134998830fafb238b7faae` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:27.608197 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b25fc1-4aa4-4b6b-b4f2-eba2a4f12b59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b9fab4ade134998830fafb238b7faae)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:27.610100 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b25fc1-4aa4-4b6b-b4f2-eba2a4f12b59 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:27.722674 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-b8b25fc1-4aa4-4b6b-b4f2-eba2a4f12b59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b9fab4ade134998830fafb238b7faae'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:27.724518 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:05:27.735136 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-b8b25fc1-4aa4-4b6b-b4f2-eba2a4f12b59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b9fab4ade134998830fafb238b7faae'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:27.735902 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-b8b25fc1-4aa4-4b6b-b4f2-eba2a4f12b59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b9fab4ade134998830fafb238b7faae'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:27.742923 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-b8b25fc1-4aa4-4b6b-b4f2-eba2a4f12b59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b9fab4ade134998830fafb238b7faae'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:27.841264 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-b8b25fc1-4aa4-4b6b-b4f2-eba2a4f12b59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b9fab4ade134998830fafb238b7faae'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:27.847571 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1450/2891] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 17:05:27 2022] DELETE /identity/v3/users/8b9fab4ade134998830fafb238b7faae => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:05:28.283411 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e29a3f7-53cb-495c-b3c1-ae2a6dd0c733 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:28.284927 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-1e29a3f7-53cb-495c-b3c1-ae2a6dd0c733 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:28.299866 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e29a3f7-53cb-495c-b3c1-ae2a6dd0c733 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:28.356526 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d05d05-021e-4804-9572-b51ad1bb102b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:28.358107 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d05d05-021e-4804-9572-b51ad1bb102b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:28.358389 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d05d05-021e-4804-9572-b51ad1bb102b admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:28.358662 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d05d05-021e-4804-9572-b51ad1bb102b admin admin] PATH_INFO: `/v3/projects/5e305e53df944547aa5e5452a1428cf1` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:28.359913 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d05d05-021e-4804-9572-b51ad1bb102b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e305e53df944547aa5e5452a1428cf1)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:28.361844 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d05d05-021e-4804-9572-b51ad1bb102b admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:28.505966 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-21d05d05-021e-4804-9572-b51ad1bb102b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e305e53df944547aa5e5452a1428cf1', 'request_id': 'req-21d05d05-021e-4804-9572-b51ad1bb102b'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:28.675756 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-21d05d05-021e-4804-9572-b51ad1bb102b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e305e53df944547aa5e5452a1428cf1', 'request_id': 'req-21d05d05-021e-4804-9572-b51ad1bb102b'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:28.681728 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-21d05d05-021e-4804-9572-b51ad1bb102b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e305e53df944547aa5e5452a1428cf1', 'request_id': 'req-21d05d05-021e-4804-9572-b51ad1bb102b'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:28.693369 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-21d05d05-021e-4804-9572-b51ad1bb102b admin admin] The token cache is being invalidate because project 5e305e53df944547aa5e5452a1428cf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:05:28.693652 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-21d05d05-021e-4804-9572-b51ad1bb102b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:28.694275 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-21d05d05-021e-4804-9572-b51ad1bb102b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:28.695931 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1442/2892] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 17:05:28 2022] DELETE /identity/v3/projects/5e305e53df944547aa5e5452a1428cf1 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:05:28.702776 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ad6a1-22e0-4d19-895c-0eff57569369 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:28.703262 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ad6a1-22e0-4d19-895c-0eff57569369 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:28.703392 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ad6a1-22e0-4d19-895c-0eff57569369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:28.721013 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-1e6ad6a1-22e0-4d19-895c-0eff57569369 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:05:28.722187 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-1e6ad6a1-22e0-4d19-895c-0eff57569369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:28.780584 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1451/2893] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:05:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:05:28.788850 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa1a91-2bac-46ce-ba95-bf0fcc93728e None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:28.789241 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa1a91-2bac-46ce-ba95-bf0fcc93728e None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:28.789527 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa1a91-2bac-46ce-ba95-bf0fcc93728e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:28.808078 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-e0aa1a91-2bac-46ce-ba95-bf0fcc93728e None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:05:28.809276 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-e0aa1a91-2bac-46ce-ba95-bf0fcc93728e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:28.817203 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1443/2894] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:05:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:05:28.821383 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6ad6a1-22e0-4d19-895c-0eff57569369 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:28.831146 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6ad6a1-22e0-4d19-895c-0eff57569369 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:28.835814 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae4d69-940c-4496-8147-fba205d5367c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:28.836459 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae4d69-940c-4496-8147-fba205d5367c admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:28.836743 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae4d69-940c-4496-8147-fba205d5367c admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:28.837021 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae4d69-940c-4496-8147-fba205d5367c admin admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:28.837727 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ae4d69-940c-4496-8147-fba205d5367c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 17:05:28.838040 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ae4d69-940c-4496-8147-fba205d5367c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:28.839624 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ae4d69-940c-4496-8147-fba205d5367c admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:28.851603 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1452/2895] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Jul 18 17:05:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 17:05:28.855521 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa1a91-2bac-46ce-ba95-bf0fcc93728e None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:28.865223 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa1a91-2bac-46ce-ba95-bf0fcc93728e None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:28.870151 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842dbaae-a7c6-4fea-ac23-f8dad8964d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:28.870786 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842dbaae-a7c6-4fea-ac23-f8dad8964d86 admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:28.871064 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842dbaae-a7c6-4fea-ac23-f8dad8964d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:28.871336 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842dbaae-a7c6-4fea-ac23-f8dad8964d86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:28.872053 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842dbaae-a7c6-4fea-ac23-f8dad8964d86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:28.873952 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842dbaae-a7c6-4fea-ac23-f8dad8964d86 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:29.002773 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1444/2896] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 17:05:28 2022] POST /identity/v3/projects => generated 377 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:05:29.007165 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae4d69-940c-4496-8147-fba205d5367c admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:29.017017 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae4d69-940c-4496-8147-fba205d5367c admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:29.073120 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd49ce6-6d7c-48ae-8ae7-093f038277be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:29.073785 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd49ce6-6d7c-48ae-8ae7-093f038277be admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:29.074069 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd49ce6-6d7c-48ae-8ae7-093f038277be admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:29.074345 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd49ce6-6d7c-48ae-8ae7-093f038277be admin admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:29.075064 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd49ce6-6d7c-48ae-8ae7-093f038277be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:29.077069 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd49ce6-6d7c-48ae-8ae7-093f038277be admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:29.202282 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1453/2897] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 17:05:29 2022] POST /identity/v3/users => generated 289 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 17:05:29.207994 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842dbaae-a7c6-4fea-ac23-f8dad8964d86 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:29.219145 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842dbaae-a7c6-4fea-ac23-f8dad8964d86 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:29.223661 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f3bb5-41a3-4aa6-82db-fff01499d952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:29.224347 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f3bb5-41a3-4aa6-82db-fff01499d952 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:29.224631 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f3bb5-41a3-4aa6-82db-fff01499d952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:29.224914 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f3bb5-41a3-4aa6-82db-fff01499d952 admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:29.225635 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052f3bb5-41a3-4aa6-82db-fff01499d952 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:29.227227 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052f3bb5-41a3-4aa6-82db-fff01499d952 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:29.237945 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1445/2898] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 17:05:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:05:29.241964 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd49ce6-6d7c-48ae-8ae7-093f038277be admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:29.251938 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd49ce6-6d7c-48ae-8ae7-093f038277be admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:29.256893 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0f21bc-a5fe-4db7-932d-1a73cc06dfce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:29.257487 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f21bc-a5fe-4db7-932d-1a73cc06dfce admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:29.257775 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f21bc-a5fe-4db7-932d-1a73cc06dfce admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:29.258055 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f21bc-a5fe-4db7-932d-1a73cc06dfce admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:29.258781 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0f21bc-a5fe-4db7-932d-1a73cc06dfce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:29.260426 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0f21bc-a5fe-4db7-932d-1a73cc06dfce admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:29.270929 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1454/2899] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 17:05:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:05:29.274881 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f3bb5-41a3-4aa6-82db-fff01499d952 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:29.285319 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f3bb5-41a3-4aa6-82db-fff01499d952 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:29.289771 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253ef83-8629-42c7-bf1b-8d85a70ad8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:29.290655 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253ef83-8629-42c7-bf1b-8d85a70ad8c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:29.290931 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253ef83-8629-42c7-bf1b-8d85a70ad8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:29.291202 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253ef83-8629-42c7-bf1b-8d85a70ad8c3 admin admin] PATH_INFO: `/v3/projects/c21253aeed8f4f69a9a8f601e954d68d/users/e1edee5ba70445ca8d6623eab86513a3/roles/ad3a2bc7b2094a4da1a95a143c8d9436` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:29.293406 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:05:29.305892 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b253ef83-8629-42c7-bf1b-8d85a70ad8c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c21253aeed8f4f69a9a8f601e954d68d, user_id=e1edee5ba70445ca8d6623eab86513a3, role_id=ad3a2bc7b2094a4da1a95a143c8d9436)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:29.312499 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b253ef83-8629-42c7-bf1b-8d85a70ad8c3 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:29.459837 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1446/2900] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 17:05:29 2022] PUT /identity/v3/projects/c21253aeed8f4f69a9a8f601e954d68d/users/e1edee5ba70445ca8d6623eab86513a3/roles/ad3a2bc7b2094a4da1a95a143c8d9436 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 17:05:29.471644 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c32d1-7d4f-4d17-87f7-f2eb39554a79 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:29.471988 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c32d1-7d4f-4d17-87f7-f2eb39554a79 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:29.472268 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c32d1-7d4f-4d17-87f7-f2eb39554a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:29.500858 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-3b8c32d1-7d4f-4d17-87f7-f2eb39554a79 None None] MFA Rules not processed for user `e1edee5ba70445ca8d6623eab86513a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:05:29.502069 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-3b8c32d1-7d4f-4d17-87f7-f2eb39554a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:29.522283 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:05:29.567125 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1455/2901] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:05:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:05:29.579102 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253ef83-8629-42c7-bf1b-8d85a70ad8c3 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:29.580832 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-b253ef83-8629-42c7-bf1b-8d85a70ad8c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:29.639970 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253ef83-8629-42c7-bf1b-8d85a70ad8c3 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:29.643932 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86f62b-1edd-4d27-b83e-9e1d55d6234b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e638fbc5f1f3447c8e189c228bbae530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:29.644578 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86f62b-1edd-4d27-b83e-9e1d55d6234b service glance] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:29.644861 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86f62b-1edd-4d27-b83e-9e1d55d6234b service glance] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:29.648914 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86f62b-1edd-4d27-b83e-9e1d55d6234b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:29.653652 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e86f62b-1edd-4d27-b83e-9e1d55d6234b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:29.655568 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e86f62b-1edd-4d27-b83e-9e1d55d6234b service glance] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:29.664476 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1447/2902] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 17:05:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:05:39.640823 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=17 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:05:39.660298 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=33,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:05:51.241938 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c32d1-7d4f-4d17-87f7-f2eb39554a79 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:51.305381 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c32d1-7d4f-4d17-87f7-f2eb39554a79 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:51.309964 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cada08-648b-406a-bb5a-7b650be7aa1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:51.310834 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cada08-648b-406a-bb5a-7b650be7aa1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:51.311120 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cada08-648b-406a-bb5a-7b650be7aa1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:51.311405 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cada08-648b-406a-bb5a-7b650be7aa1f admin admin] PATH_INFO: `/v3/users/e1edee5ba70445ca8d6623eab86513a3` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:51.312627 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cada08-648b-406a-bb5a-7b650be7aa1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1edee5ba70445ca8d6623eab86513a3)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:51.314577 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cada08-648b-406a-bb5a-7b650be7aa1f admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:51.469193 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-87cada08-648b-406a-bb5a-7b650be7aa1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1edee5ba70445ca8d6623eab86513a3'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:51.481568 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-87cada08-648b-406a-bb5a-7b650be7aa1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1edee5ba70445ca8d6623eab86513a3'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:51.482240 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-87cada08-648b-406a-bb5a-7b650be7aa1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1edee5ba70445ca8d6623eab86513a3'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:51.490500 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-87cada08-648b-406a-bb5a-7b650be7aa1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1edee5ba70445ca8d6623eab86513a3'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:51.549853 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-87cada08-648b-406a-bb5a-7b650be7aa1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1edee5ba70445ca8d6623eab86513a3'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:51.556172 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1456/2903] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 17:05:51 2022] DELETE /identity/v3/users/e1edee5ba70445ca8d6623eab86513a3 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:05:51.560684 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77073f10-7c8f-4450-9af1-6c59803fd5bd None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:51.562642 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77073f10-7c8f-4450-9af1-6c59803fd5bd None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:51.562642 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77073f10-7c8f-4450-9af1-6c59803fd5bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:51.580326 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-77073f10-7c8f-4450-9af1-6c59803fd5bd None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:05:51.581530 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-77073f10-7c8f-4450-9af1-6c59803fd5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:51.640631 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1448/2904] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:05:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:05:51.650757 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cada08-648b-406a-bb5a-7b650be7aa1f admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:51.652179 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-87cada08-648b-406a-bb5a-7b650be7aa1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:51.708353 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cada08-648b-406a-bb5a-7b650be7aa1f admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:51.712037 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab6697c-238e-46db-90c5-029f04e62fa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:51.712677 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab6697c-238e-46db-90c5-029f04e62fa0 service neutron] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:51.712960 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab6697c-238e-46db-90c5-029f04e62fa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:51.713284 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab6697c-238e-46db-90c5-029f04e62fa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:51.722824 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab6697c-238e-46db-90c5-029f04e62fa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:51.724335 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab6697c-238e-46db-90c5-029f04e62fa0 service neutron] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:51.733847 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1457/2905] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 17:05:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:05:52.208000 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77073f10-7c8f-4450-9af1-6c59803fd5bd None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:52.209435 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-77073f10-7c8f-4450-9af1-6c59803fd5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:52.221484 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77073f10-7c8f-4450-9af1-6c59803fd5bd None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:52.226535 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb1498-6be7-44ad-9a16-b35b64d37fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:52.227387 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb1498-6be7-44ad-9a16-b35b64d37fb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:52.227664 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb1498-6be7-44ad-9a16-b35b64d37fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:52.228010 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb1498-6be7-44ad-9a16-b35b64d37fb5 admin admin] PATH_INFO: `/v3/projects/c21253aeed8f4f69a9a8f601e954d68d` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:52.229620 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcb1498-6be7-44ad-9a16-b35b64d37fb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c21253aeed8f4f69a9a8f601e954d68d)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:52.231562 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcb1498-6be7-44ad-9a16-b35b64d37fb5 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:52.366173 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-dbcb1498-6be7-44ad-9a16-b35b64d37fb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c21253aeed8f4f69a9a8f601e954d68d', 'request_id': 'req-dbcb1498-6be7-44ad-9a16-b35b64d37fb5'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:52.434522 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-dbcb1498-6be7-44ad-9a16-b35b64d37fb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c21253aeed8f4f69a9a8f601e954d68d', 'request_id': 'req-dbcb1498-6be7-44ad-9a16-b35b64d37fb5'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:52.440238 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-dbcb1498-6be7-44ad-9a16-b35b64d37fb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c21253aeed8f4f69a9a8f601e954d68d', 'request_id': 'req-dbcb1498-6be7-44ad-9a16-b35b64d37fb5'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:52.451260 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-dbcb1498-6be7-44ad-9a16-b35b64d37fb5 admin admin] The token cache is being invalidate because project c21253aeed8f4f69a9a8f601e954d68d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:05:52.451549 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-dbcb1498-6be7-44ad-9a16-b35b64d37fb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:52.452260 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-dbcb1498-6be7-44ad-9a16-b35b64d37fb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:52.453828 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1449/2906] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 17:05:52 2022] DELETE /identity/v3/projects/c21253aeed8f4f69a9a8f601e954d68d => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:05:52.459332 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff7d6b-a949-4bff-8934-ee92f119dfd5 None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:52.459860 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff7d6b-a949-4bff-8934-ee92f119dfd5 None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:52.459974 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff7d6b-a949-4bff-8934-ee92f119dfd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:52.478590 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-c5ff7d6b-a949-4bff-8934-ee92f119dfd5 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:05:52.479813 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-c5ff7d6b-a949-4bff-8934-ee92f119dfd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:52.497042 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:05:52.540115 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1458/2907] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:05:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:05:52.548212 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00d99f-c589-4ad0-a5d0-0bce75ba5d04 None None] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:52.548505 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00d99f-c589-4ad0-a5d0-0bce75ba5d04 None None] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:52.548788 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00d99f-c589-4ad0-a5d0-0bce75ba5d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:52.566640 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.auth.core [None req-5d00d99f-c589-4ad0-a5d0-0bce75ba5d04 None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:05:52.567875 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-5d00d99f-c589-4ad0-a5d0-0bce75ba5d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:52.576020 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1450/2908] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:05:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:05:52.580590 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff7d6b-a949-4bff-8934-ee92f119dfd5 None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:52.590387 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff7d6b-a949-4bff-8934-ee92f119dfd5 None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:52.595629 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d54b2-1c4a-4239-825b-28818a4be57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:52.596321 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d54b2-1c4a-4239-825b-28818a4be57c admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:52.596588 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d54b2-1c4a-4239-825b-28818a4be57c admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:52.596863 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d54b2-1c4a-4239-825b-28818a4be57c admin admin] PATH_INFO: `/v3/domains` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:52.597606 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98d54b2-1c4a-4239-825b-28818a4be57c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80544) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 17:05:52.597909 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98d54b2-1c4a-4239-825b-28818a4be57c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:52.599525 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98d54b2-1c4a-4239-825b-28818a4be57c admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:52.610943 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1459/2909] 10.222.0.81 () {58 vars in 1152 bytes} [Mon Jul 18 17:05:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 17:05:52.615159 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d00d99f-c589-4ad0-a5d0-0bce75ba5d04 None None] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:52.624575 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d00d99f-c589-4ad0-a5d0-0bce75ba5d04 None None] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:52.629540 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535fc733-7a64-457f-90f9-cb235d1c87b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:52.630177 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535fc733-7a64-457f-90f9-cb235d1c87b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:52.630463 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535fc733-7a64-457f-90f9-cb235d1c87b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:52.630738 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535fc733-7a64-457f-90f9-cb235d1c87b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:52.631416 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535fc733-7a64-457f-90f9-cb235d1c87b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:52.633344 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535fc733-7a64-457f-90f9-cb235d1c87b5 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:52.728137 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1451/2910] 10.222.0.81 () {60 vars in 1152 bytes} [Mon Jul 18 17:05:52 2022] POST /identity/v3/projects => generated 375 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:05:52.731668 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d54b2-1c4a-4239-825b-28818a4be57c admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:52.741564 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d54b2-1c4a-4239-825b-28818a4be57c admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:52.797391 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89424e9b-9b87-4560-9b01-ec6826dd2a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:52.798060 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89424e9b-9b87-4560-9b01-ec6826dd2a0c admin admin] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:52.798346 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89424e9b-9b87-4560-9b01-ec6826dd2a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:52.798627 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89424e9b-9b87-4560-9b01-ec6826dd2a0c admin admin] PATH_INFO: `/v3/users` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:52.799366 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89424e9b-9b87-4560-9b01-ec6826dd2a0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:52.801435 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89424e9b-9b87-4560-9b01-ec6826dd2a0c admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:52.886158 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1460/2911] 10.222.0.81 () {60 vars in 1143 bytes} [Mon Jul 18 17:05:52 2022] POST /identity/v3/users => generated 288 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:05:52.890451 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535fc733-7a64-457f-90f9-cb235d1c87b5 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:52.901337 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535fc733-7a64-457f-90f9-cb235d1c87b5 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:52.905949 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c14c5-4028-416c-99ed-0341998f1912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:52.906589 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c14c5-4028-416c-99ed-0341998f1912 admin admin] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:52.906867 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c14c5-4028-416c-99ed-0341998f1912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:52.907136 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c14c5-4028-416c-99ed-0341998f1912 admin admin] PATH_INFO: `/v3/roles` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:52.907884 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c14c5-4028-416c-99ed-0341998f1912 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:52.909444 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c14c5-4028-416c-99ed-0341998f1912 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:52.919641 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1452/2912] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 17:05:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:05:52.923504 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89424e9b-9b87-4560-9b01-ec6826dd2a0c admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:52.933599 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89424e9b-9b87-4560-9b01-ec6826dd2a0c admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:52.938208 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d681db1-b5be-4d6f-b9aa-c173af99227e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:52.939376 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d681db1-b5be-4d6f-b9aa-c173af99227e admin admin] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:52.939658 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d681db1-b5be-4d6f-b9aa-c173af99227e admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:52.939966 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d681db1-b5be-4d6f-b9aa-c173af99227e admin admin] PATH_INFO: `/v3/roles` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:52.940690 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d681db1-b5be-4d6f-b9aa-c173af99227e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:52.942271 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d681db1-b5be-4d6f-b9aa-c173af99227e admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:52.952214 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1461/2913] 10.222.0.81 () {58 vars in 1121 bytes} [Mon Jul 18 17:05:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:05:52.956725 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c14c5-4028-416c-99ed-0341998f1912 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:52.966558 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c14c5-4028-416c-99ed-0341998f1912 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:52.971093 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263b76ae-97a4-4871-afb4-8fe9bee3da7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:52.971975 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b76ae-97a4-4871-afb4-8fe9bee3da7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:52.972251 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b76ae-97a4-4871-afb4-8fe9bee3da7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:52.972523 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b76ae-97a4-4871-afb4-8fe9bee3da7e admin admin] PATH_INFO: `/v3/projects/8b604f52551144e4af8e2cebff4c9041/users/24a7b761f4e8497eb2fd5c21240f41af/roles/ad3a2bc7b2094a4da1a95a143c8d9436` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:52.987225 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263b76ae-97a4-4871-afb4-8fe9bee3da7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b604f52551144e4af8e2cebff4c9041, user_id=24a7b761f4e8497eb2fd5c21240f41af, role_id=ad3a2bc7b2094a4da1a95a143c8d9436)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:52.989940 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263b76ae-97a4-4871-afb4-8fe9bee3da7e admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:53.086432 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1453/2914] 10.222.0.81 () {60 vars in 1482 bytes} [Mon Jul 18 17:05:52 2022] PUT /identity/v3/projects/8b604f52551144e4af8e2cebff4c9041/users/24a7b761f4e8497eb2fd5c21240f41af/roles/ad3a2bc7b2094a4da1a95a143c8d9436 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:05:53.097572 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8763cef-e25d-48cd-8872-4f24e44de8eb None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:53.102321 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8763cef-e25d-48cd-8872-4f24e44de8eb None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:53.102321 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8763cef-e25d-48cd-8872-4f24e44de8eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:53.124288 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-b8763cef-e25d-48cd-8872-4f24e44de8eb None None] MFA Rules not processed for user `24a7b761f4e8497eb2fd5c21240f41af`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:05:53.125493 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-b8763cef-e25d-48cd-8872-4f24e44de8eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:53.189382 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1462/2915] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:05:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:05:53.199875 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263b76ae-97a4-4871-afb4-8fe9bee3da7e admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:53.201595 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-263b76ae-97a4-4871-afb4-8fe9bee3da7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:53.222985 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:05:53.259295 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263b76ae-97a4-4871-afb4-8fe9bee3da7e admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:53.262957 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ca616-64e5-43fc-8503-e7ca73881b65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baaee55accfa458a9832127c5ab77656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:53.263593 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ca616-64e5-43fc-8503-e7ca73881b65 service cinder] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:53.267143 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ca616-64e5-43fc-8503-e7ca73881b65 service cinder] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:53.267143 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ca616-64e5-43fc-8503-e7ca73881b65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:53.272508 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663ca616-64e5-43fc-8503-e7ca73881b65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:53.273982 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663ca616-64e5-43fc-8503-e7ca73881b65 service cinder] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:53.283242 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1454/2916] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 17:05:53 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:06:00.522656 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8763cef-e25d-48cd-8872-4f24e44de8eb None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:06:00.524186 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-b8763cef-e25d-48cd-8872-4f24e44de8eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:06:00.545230 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:06:00.582621 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8763cef-e25d-48cd-8872-4f24e44de8eb None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:06:00.586182 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ef4ed-e625-454f-a202-fc07b92db1f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:06:00.586831 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ef4ed-e625-454f-a202-fc07b92db1f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:06:00.587115 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ef4ed-e625-454f-a202-fc07b92db1f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:06:00.587435 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ef4ed-e625-454f-a202-fc07b92db1f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:06:00.590071 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-4f7ef4ed-e625-454f-a202-fc07b92db1f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:06:00.600339 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7ef4ed-e625-454f-a202-fc07b92db1f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:06:00.601763 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7ef4ed-e625-454f-a202-fc07b92db1f3 service neutron] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:06:00.610053 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1463/2917] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 17:06:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:06:03.320372 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=17 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:06:05.839454 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ca616-64e5-43fc-8503-e7ca73881b65 service cinder] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:06:05.900531 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ca616-64e5-43fc-8503-e7ca73881b65 service cinder] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:06:05.905024 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d1090-9736-4c7b-9afc-ac41196df7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:06:05.905882 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d1090-9736-4c7b-9afc-ac41196df7b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:06:05.906161 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d1090-9736-4c7b-9afc-ac41196df7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:06:05.906434 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d1090-9736-4c7b-9afc-ac41196df7b5 admin admin] PATH_INFO: `/v3/users/24a7b761f4e8497eb2fd5c21240f41af` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:06:05.907593 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351d1090-9736-4c7b-9afc-ac41196df7b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24a7b761f4e8497eb2fd5c21240f41af)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:06:05.909530 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351d1090-9736-4c7b-9afc-ac41196df7b5 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:06:06.127472 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-351d1090-9736-4c7b-9afc-ac41196df7b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24a7b761f4e8497eb2fd5c21240f41af'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:06:06.129973 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-351d1090-9736-4c7b-9afc-ac41196df7b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24a7b761f4e8497eb2fd5c21240f41af'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:06:06.142136 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-351d1090-9736-4c7b-9afc-ac41196df7b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24a7b761f4e8497eb2fd5c21240f41af'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:06:06.216885 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-351d1090-9736-4c7b-9afc-ac41196df7b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24a7b761f4e8497eb2fd5c21240f41af'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:06:06.223936 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-351d1090-9736-4c7b-9afc-ac41196df7b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24a7b761f4e8497eb2fd5c21240f41af'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:06:06.229772 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1455/2918] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 17:06:05 2022] DELETE /identity/v3/users/24a7b761f4e8497eb2fd5c21240f41af => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:06:06.234393 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47312866-4182-4825-b2b0-6c15c3d4985e None None] REQUEST_METHOD: `POST` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:06:06.234889 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47312866-4182-4825-b2b0-6c15c3d4985e None None] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:06:06.235009 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47312866-4182-4825-b2b0-6c15c3d4985e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:06:06.252285 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.auth.core [None req-47312866-4182-4825-b2b0-6c15c3d4985e None None] MFA Rules not processed for user `3dccf69cde3442c68200f8a9b9ed4ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80544) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:06:06.254239 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-47312866-4182-4825-b2b0-6c15c3d4985e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:06:06.312885 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1464/2919] 10.222.0.81 () {58 vars in 957 bytes} [Mon Jul 18 17:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:06:06.323127 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d1090-9736-4c7b-9afc-ac41196df7b5 admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:06:06.324561 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-351d1090-9736-4c7b-9afc-ac41196df7b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:06:06.381429 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d1090-9736-4c7b-9afc-ac41196df7b5 admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:06:06.384937 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505aa75b-e773-4a5e-a596-697f03a174b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:06:06.385574 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505aa75b-e773-4a5e-a596-697f03a174b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:06:06.385858 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505aa75b-e773-4a5e-a596-697f03a174b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:06:06.386136 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505aa75b-e773-4a5e-a596-697f03a174b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:06:06.395056 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505aa75b-e773-4a5e-a596-697f03a174b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:06:06.397123 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505aa75b-e773-4a5e-a596-697f03a174b8 service neutron] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:06:06.406511 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1456/2920] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 17:06:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 17:06:06.819378 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47312866-4182-4825-b2b0-6c15c3d4985e None None] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:06:06.820839 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-47312866-4182-4825-b2b0-6c15c3d4985e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:06:06.832825 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47312866-4182-4825-b2b0-6c15c3d4985e None None] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:06:06.837560 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e773f966-6df8-428f-8670-2cd84ad9491a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:06:06.841413 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773f966-6df8-428f-8670-2cd84ad9491a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:06:06.841413 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773f966-6df8-428f-8670-2cd84ad9491a admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:06:06.841413 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773f966-6df8-428f-8670-2cd84ad9491a admin admin] PATH_INFO: `/v3/projects/8b604f52551144e4af8e2cebff4c9041` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:06:06.841413 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e773f966-6df8-428f-8670-2cd84ad9491a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b604f52551144e4af8e2cebff4c9041)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:06:06.842240 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e773f966-6df8-428f-8670-2cd84ad9491a admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:06:06.971679 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-e773f966-6df8-428f-8670-2cd84ad9491a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b604f52551144e4af8e2cebff4c9041', 'request_id': 'req-e773f966-6df8-428f-8670-2cd84ad9491a'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:06:06.977897 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-e773f966-6df8-428f-8670-2cd84ad9491a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b604f52551144e4af8e2cebff4c9041', 'request_id': 'req-e773f966-6df8-428f-8670-2cd84ad9491a'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:06:06.984102 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-e773f966-6df8-428f-8670-2cd84ad9491a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b604f52551144e4af8e2cebff4c9041', 'request_id': 'req-e773f966-6df8-428f-8670-2cd84ad9491a'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:06:07.044840 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-e773f966-6df8-428f-8670-2cd84ad9491a admin admin] The token cache is being invalidate because project 8b604f52551144e4af8e2cebff4c9041 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80544) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:06:07.045129 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-e773f966-6df8-428f-8670-2cd84ad9491a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:06:07.045752 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-e773f966-6df8-428f-8670-2cd84ad9491a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:06:07.047289 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1465/2921] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 17:06:06 2022] DELETE /identity/v3/projects/8b604f52551144e4af8e2cebff4c9041 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:06:16.402327 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:06:17.041768 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=72,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:06:33.131772 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505aa75b-e773-4a5e-a596-697f03a174b8 service neutron] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:06:33.133725 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-505aa75b-e773-4a5e-a596-697f03a174b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:06:33.145029 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505aa75b-e773-4a5e-a596-697f03a174b8 service neutron] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:06:33.191927 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec913a3-1062-4d4b-a808-668e45a57120 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:06:33.192563 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec913a3-1062-4d4b-a808-668e45a57120 service neutron] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:06:33.192843 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec913a3-1062-4d4b-a808-668e45a57120 service neutron] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:06:33.193116 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec913a3-1062-4d4b-a808-668e45a57120 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:06:33.194882 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-3ec913a3-1062-4d4b-a808-668e45a57120 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:06:33.253257 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec913a3-1062-4d4b-a808-668e45a57120 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:06:33.254930 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec913a3-1062-4d4b-a808-668e45a57120 service neutron] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:06:33.264310 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1457/2922] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 17:06:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:06:34.441619 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e773f966-6df8-428f-8670-2cd84ad9491a admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:06:34.443336 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-e773f966-6df8-428f-8670-2cd84ad9491a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:06:34.538827 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e773f966-6df8-428f-8670-2cd84ad9491a admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:06:34.544604 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137d4bd-1cf1-4e03-9cf9-31fecbf38803 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07f0c5bf1bee48a0bafdf7a9e4537c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:06:34.545351 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137d4bd-1cf1-4e03-9cf9-31fecbf38803 service nova] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:06:34.545638 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137d4bd-1cf1-4e03-9cf9-31fecbf38803 service nova] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:06:34.545952 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137d4bd-1cf1-4e03-9cf9-31fecbf38803 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:06:34.548183 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-8137d4bd-1cf1-4e03-9cf9-31fecbf38803 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:06:34.561698 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8137d4bd-1cf1-4e03-9cf9-31fecbf38803 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:06:34.563304 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8137d4bd-1cf1-4e03-9cf9-31fecbf38803 service nova] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:06:34.575563 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1466/2923] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 17:06:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:06:34.888975 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec913a3-1062-4d4b-a808-668e45a57120 service neutron] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:06:34.906786 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-3ec913a3-1062-4d4b-a808-668e45a57120 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:06:34.906786 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec913a3-1062-4d4b-a808-668e45a57120 service neutron] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:06:34.906786 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc5155-0a07-4ce8-afd5-d210b15af0d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:06:34.907126 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc5155-0a07-4ce8-afd5-d210b15af0d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:06:34.907126 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc5155-0a07-4ce8-afd5-d210b15af0d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:06:34.907126 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc5155-0a07-4ce8-afd5-d210b15af0d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:06:34.908712 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-56fc5155-0a07-4ce8-afd5-d210b15af0d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:06:34.922589 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fc5155-0a07-4ce8-afd5-d210b15af0d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:06:34.923926 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fc5155-0a07-4ce8-afd5-d210b15af0d9 service neutron] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:06:34.935645 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1458/2924] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 17:06:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:06:36.116239 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137d4bd-1cf1-4e03-9cf9-31fecbf38803 service nova] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:06:36.125779 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137d4bd-1cf1-4e03-9cf9-31fecbf38803 service nova] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:06:36.129579 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d02192-89f7-4a22-b76e-cadb8b3e5fa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:06:36.130214 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d02192-89f7-4a22-b76e-cadb8b3e5fa7 service neutron] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:06:36.130491 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d02192-89f7-4a22-b76e-cadb8b3e5fa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:06:36.130760 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d02192-89f7-4a22-b76e-cadb8b3e5fa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:06:36.132538 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-10d02192-89f7-4a22-b76e-cadb8b3e5fa7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:06:36.154510 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d02192-89f7-4a22-b76e-cadb8b3e5fa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:06:36.155994 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d02192-89f7-4a22-b76e-cadb8b3e5fa7 service neutron] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:06:36.167908 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1467/2925] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 17:06:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:06:39.912812 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc5155-0a07-4ce8-afd5-d210b15af0d9 service neutron] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:06:39.914285 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-56fc5155-0a07-4ce8-afd5-d210b15af0d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:06:39.924933 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc5155-0a07-4ce8-afd5-d210b15af0d9 service neutron] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:06:39.928533 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ed1ee-4dd1-445f-8447-1849d9b75b4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b742c540de6545249fe3245047d00c81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:06:39.929162 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ed1ee-4dd1-445f-8447-1849d9b75b4c service neutron] REQUEST_METHOD: `GET` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:06:39.929437 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ed1ee-4dd1-445f-8447-1849d9b75b4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:06:39.929708 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ed1ee-4dd1-445f-8447-1849d9b75b4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:06:39.931384 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-026ed1ee-4dd1-445f-8447-1849d9b75b4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:06:40.001571 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026ed1ee-4dd1-445f-8447-1849d9b75b4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:06:40.002950 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026ed1ee-4dd1-445f-8447-1849d9b75b4c service neutron] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:06:40.013328 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1459/2926] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 17:06:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:06:46.162782 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=40 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:06:46.919550 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d02192-89f7-4a22-b76e-cadb8b3e5fa7 service neutron] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:06:46.921071 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-10d02192-89f7-4a22-b76e-cadb8b3e5fa7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:06:46.934883 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d02192-89f7-4a22-b76e-cadb8b3e5fa7 service neutron] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:06:46.939384 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845174af-8715-4999-b072-d71093db3e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:06:46.940280 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845174af-8715-4999-b072-d71093db3e0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:06:46.940558 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845174af-8715-4999-b072-d71093db3e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:06:46.940826 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845174af-8715-4999-b072-d71093db3e0f admin admin] PATH_INFO: `/v3/users/ecc6bf8348ee4c9492066b3920ec4d9b` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:06:46.941993 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845174af-8715-4999-b072-d71093db3e0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecc6bf8348ee4c9492066b3920ec4d9b)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:06:46.943913 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845174af-8715-4999-b072-d71093db3e0f admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:06:47.132498 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-845174af-8715-4999-b072-d71093db3e0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecc6bf8348ee4c9492066b3920ec4d9b'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:06:47.144918 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-845174af-8715-4999-b072-d71093db3e0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecc6bf8348ee4c9492066b3920ec4d9b'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:06:47.145583 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-845174af-8715-4999-b072-d71093db3e0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecc6bf8348ee4c9492066b3920ec4d9b'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:06:47.152664 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-845174af-8715-4999-b072-d71093db3e0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecc6bf8348ee4c9492066b3920ec4d9b'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:06:47.227980 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-845174af-8715-4999-b072-d71093db3e0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecc6bf8348ee4c9492066b3920ec4d9b'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:06:47.234241 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1468/2927] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 17:06:46 2022] DELETE /identity/v3/users/ecc6bf8348ee4c9492066b3920ec4d9b => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:06:47.483937 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ed1ee-4dd1-445f-8447-1849d9b75b4c service neutron] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:06:47.492741 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ed1ee-4dd1-445f-8447-1849d9b75b4c service neutron] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:06:47.527301 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=100 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:06:47.551949 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9c045e-3343-4e78-b228-9a13a8f8695d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:06:47.552808 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c045e-3343-4e78-b228-9a13a8f8695d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:06:47.553090 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c045e-3343-4e78-b228-9a13a8f8695d admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:06:47.553363 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c045e-3343-4e78-b228-9a13a8f8695d admin admin] PATH_INFO: `/v3/projects/5c52bae4d58d4367b640bba767db1c64` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:06:47.555162 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9c045e-3343-4e78-b228-9a13a8f8695d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c52bae4d58d4367b640bba767db1c64)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:06:47.557096 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9c045e-3343-4e78-b228-9a13a8f8695d admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:06:47.667461 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-3c9c045e-3343-4e78-b228-9a13a8f8695d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c52bae4d58d4367b640bba767db1c64', 'request_id': 'req-3c9c045e-3343-4e78-b228-9a13a8f8695d'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:06:47.736457 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-3c9c045e-3343-4e78-b228-9a13a8f8695d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c52bae4d58d4367b640bba767db1c64', 'request_id': 'req-3c9c045e-3343-4e78-b228-9a13a8f8695d'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:06:47.742437 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-3c9c045e-3343-4e78-b228-9a13a8f8695d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c52bae4d58d4367b640bba767db1c64', 'request_id': 'req-3c9c045e-3343-4e78-b228-9a13a8f8695d'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:06:47.753813 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-3c9c045e-3343-4e78-b228-9a13a8f8695d admin admin] The token cache is being invalidate because project 5c52bae4d58d4367b640bba767db1c64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:06:47.754100 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-3c9c045e-3343-4e78-b228-9a13a8f8695d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:06:47.754732 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-3c9c045e-3343-4e78-b228-9a13a8f8695d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:06:47.756317 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1460/2928] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 17:06:47 2022] DELETE /identity/v3/projects/5c52bae4d58d4367b640bba767db1c64 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:06:47.760356 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845174af-8715-4999-b072-d71093db3e0f admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:06:47.761764 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-845174af-8715-4999-b072-d71093db3e0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:06:47.775767 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845174af-8715-4999-b072-d71093db3e0f admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:06:47.830303 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07517860-018b-4cb5-ae17-a70261795bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:06:47.831168 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07517860-018b-4cb5-ae17-a70261795bc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:06:47.831452 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07517860-018b-4cb5-ae17-a70261795bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:06:47.831750 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07517860-018b-4cb5-ae17-a70261795bc4 admin admin] PATH_INFO: `/v3/users/e370db6f143f4cf5aaec84c0c550d574` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:06:47.832946 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07517860-018b-4cb5-ae17-a70261795bc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e370db6f143f4cf5aaec84c0c550d574)` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:06:47.834886 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07517860-018b-4cb5-ae17-a70261795bc4 admin admin] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:06:48.030544 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-07517860-018b-4cb5-ae17-a70261795bc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e370db6f143f4cf5aaec84c0c550d574'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:06:48.042308 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-07517860-018b-4cb5-ae17-a70261795bc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e370db6f143f4cf5aaec84c0c550d574'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:06:48.043011 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-07517860-018b-4cb5-ae17-a70261795bc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e370db6f143f4cf5aaec84c0c550d574'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:06:48.049863 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-07517860-018b-4cb5-ae17-a70261795bc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e370db6f143f4cf5aaec84c0c550d574'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:06:48.051539 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:06:48.147326 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.notifications [None req-07517860-018b-4cb5-ae17-a70261795bc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e370db6f143f4cf5aaec84c0c550d574'} {{(pid=80544) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:06:48.154484 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1469/2929] 10.222.0.81 () {58 vars in 1223 bytes} [Mon Jul 18 17:06:47 2022] DELETE /identity/v3/users/e370db6f143f4cf5aaec84c0c550d574 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:06:48.429881 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9c045e-3343-4e78-b228-9a13a8f8695d admin admin] Authenticating user token {{(pid=80545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:06:48.431309 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.fernet_utils [None req-3c9c045e-3343-4e78-b228-9a13a8f8695d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:06:48.443944 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9c045e-3343-4e78-b228-9a13a8f8695d admin admin] Validating token access rules against request {{(pid=80545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:06:48.505665 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62390417-20fe-41f8-9c09-b536420b0909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dccf69cde3442c68200f8a9b9ed4ebb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33688c7877734008b9dfee18021dbcd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:06:48.506527 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62390417-20fe-41f8-9c09-b536420b0909 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:06:48.506812 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62390417-20fe-41f8-9c09-b536420b0909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:06:48.507087 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62390417-20fe-41f8-9c09-b536420b0909 admin admin] PATH_INFO: `/v3/projects/a0eacaa1adc241dca3c99268c2ccbd22` {{(pid=80545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:06:48.508901 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62390417-20fe-41f8-9c09-b536420b0909 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0eacaa1adc241dca3c99268c2ccbd22)` {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:06:48.510787 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62390417-20fe-41f8-9c09-b536420b0909 admin admin] RBAC: Authorization granted {{(pid=80545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:06:48.684368 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-62390417-20fe-41f8-9c09-b536420b0909 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0eacaa1adc241dca3c99268c2ccbd22', 'request_id': 'req-62390417-20fe-41f8-9c09-b536420b0909'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:06:48.798863 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-62390417-20fe-41f8-9c09-b536420b0909 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0eacaa1adc241dca3c99268c2ccbd22', 'request_id': 'req-62390417-20fe-41f8-9c09-b536420b0909'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:06:48.805500 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-62390417-20fe-41f8-9c09-b536420b0909 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0eacaa1adc241dca3c99268c2ccbd22', 'request_id': 'req-62390417-20fe-41f8-9c09-b536420b0909'} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:06:48.807428 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:06:48.816758 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-62390417-20fe-41f8-9c09-b536420b0909 admin admin] The token cache is being invalidate because project a0eacaa1adc241dca3c99268c2ccbd22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:06:48.817045 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-62390417-20fe-41f8-9c09-b536420b0909 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:06:48.817681 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG keystone.notifications [None req-62390417-20fe-41f8-9c09-b536420b0909 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:06:48.819218 dv-cinder-846173-3-smb devstack@keystone.service[80545]: [pid: 80545|app: 0|req: 1461/2930] 10.222.0.81 () {58 vars in 1232 bytes} [Mon Jul 18 17:06:48 2022] DELETE /identity/v3/projects/a0eacaa1adc241dca3c99268c2ccbd22 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:06:58.312868 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=2 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:06:58.999063 dv-cinder-846173-3-smb devstack@keystone.service[80545]: DEBUG dbcounter [-] [80545] Writing DB stats keystone:SELECT=2 {{(pid=80545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:08:06.810516 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07517860-018b-4cb5-ae17-a70261795bc4 admin admin] Authenticating user token {{(pid=80544) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:08:06.811956 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-07517860-018b-4cb5-ae17-a70261795bc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:08:06.948211 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07517860-018b-4cb5-ae17-a70261795bc4 admin admin] Validating token access rules against request {{(pid=80544) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:08:07.005935 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c229bb36-deef-4eff-99b8-6d18a999621a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5700ad7df774415b89737c7dddcc5b2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d1d84bf334d47e6bfba1141c1fc6f59', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80544) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:08:07.006583 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c229bb36-deef-4eff-99b8-6d18a999621a service placement] REQUEST_METHOD: `GET` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:08:07.006870 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c229bb36-deef-4eff-99b8-6d18a999621a service placement] SCRIPT_NAME: `/identity` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:08:07.007148 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c229bb36-deef-4eff-99b8-6d18a999621a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80544) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:08:07.008933 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.fernet_utils [None req-c229bb36-deef-4eff-99b8-6d18a999621a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80544) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:08:07.020559 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c229bb36-deef-4eff-99b8-6d18a999621a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:08:07.022126 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c229bb36-deef-4eff-99b8-6d18a999621a service placement] RBAC: Authorization granted {{(pid=80544) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:08:07.032187 dv-cinder-846173-3-smb devstack@keystone.service[80544]: [pid: 80544|app: 0|req: 1470/2931] 10.222.0.81 () {60 vars in 1365 bytes} [Mon Jul 18 17:08:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:08:17.027899 dv-cinder-846173-3-smb devstack@keystone.service[80544]: DEBUG dbcounter [-] [80544] Writing DB stats keystone:SELECT=89 {{(pid=80544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}